| Package | Description |
|---|---|
| org.apache.hudi.common.data |
| Modifier and Type | Class and Description |
|---|---|
class |
HoodieListPairData<K,V>
|
| Modifier and Type | Method and Description |
|---|---|
<K,V> HoodiePairData<K,V> |
HoodieData.flatMapToPair(SerializableFunction<T,Iterator<? extends Pair<K,V>>> func)
Maps every element in the collection into a collection of the
Pairs of new elements
using provided mapping func, subsequently flattening the result (by concatenating) into
a single collection
NOTE: That this operation will convert container from HoodieData to HoodiePairData
This is an intermediate operation |
<K,V> HoodiePairData<K,V> |
HoodieListData.flatMapToPair(SerializableFunction<T,Iterator<? extends Pair<K,V>>> func) |
<W> HoodiePairData<K,W> |
HoodieListPairData.flatMapValues(SerializableFunction<V,Iterator<W>> func) |
HoodiePairData<K,Iterable<V>> |
HoodieListPairData.groupByKey() |
HoodiePairData<K,Iterable<V>> |
HoodiePairData.groupByKey()
Groups the values for each key in the dataset into a single sequence
|
<W> HoodiePairData<K,Pair<V,W>> |
HoodieListPairData.join(HoodiePairData<K,W> other) |
<W> HoodiePairData<K,Pair<V,W>> |
HoodiePairData.join(HoodiePairData<K,W> other)
Performs an inner join of this dataset against
other. |
<W> HoodiePairData<K,Pair<V,Option<W>>> |
HoodieListPairData.leftOuterJoin(HoodiePairData<K,W> other) |
<W> HoodiePairData<K,Pair<V,Option<W>>> |
HoodiePairData.leftOuterJoin(HoodiePairData<K,W> other)
Performs a left outer join of this dataset against
other. |
<L,W> HoodiePairData<L,W> |
HoodieListPairData.mapToPair(SerializablePairFunction<Pair<K,V>,L,W> mapToPairFunc) |
<L,W> HoodiePairData<L,W> |
HoodiePairData.mapToPair(SerializablePairFunction<Pair<K,V>,L,W> mapToPairFunc) |
<K,V> HoodiePairData<K,V> |
HoodieData.mapToPair(SerializablePairFunction<T,K,V> func)
Maps every element in the collection using provided mapping
func into a Pair
of elements K and V |
<K,V> HoodiePairData<K,V> |
HoodieListData.mapToPair(SerializablePairFunction<T,K,V> func) |
<W> HoodiePairData<K,W> |
HoodieListPairData.mapValues(SerializableFunction<V,W> func) |
<W> HoodiePairData<K,W> |
HoodiePairData.mapValues(SerializableFunction<V,W> func)
Maps values of this
HoodiePairData container leveraging provided mapper |
HoodiePairData<K,V> |
HoodieListPairData.reduceByKey(SerializableBiFunction<V,V,V> combiner,
int parallelism) |
HoodiePairData<K,V> |
HoodiePairData.reduceByKey(SerializableBiFunction<V,V,V> combiner,
int parallelism)
Reduces original sequence by de-duplicating the pairs w/ the same key, using provided
binary operator
combiner. |
| Modifier and Type | Method and Description |
|---|---|
<W> HoodiePairData<K,Pair<V,W>> |
HoodieListPairData.join(HoodiePairData<K,W> other) |
<W> HoodiePairData<K,Pair<V,W>> |
HoodiePairData.join(HoodiePairData<K,W> other)
Performs an inner join of this dataset against
other. |
<W> HoodiePairData<K,Pair<V,Option<W>>> |
HoodieListPairData.leftOuterJoin(HoodiePairData<K,W> other) |
<W> HoodiePairData<K,Pair<V,Option<W>>> |
HoodiePairData.leftOuterJoin(HoodiePairData<K,W> other)
Performs a left outer join of this dataset against
other. |
Copyright © 2024 The Apache Software Foundation. All rights reserved.