org.apache.hudi.index.bloom

Class HoodieBloomIndexCheckFunction<I>

java.lang.Object

org.apache.hudi.index.bloom.HoodieBloomIndexCheckFunction<I>

Type Parameters:

I - type of the tuple of (HoodieFileGroupId, <record-key>). Note that this is parameterized as generic such that this code could be reused for Spark as well

All Implemented Interfaces:

Serializable, Function<Iterator<I>,Iterator<List<HoodieKeyLookupResult>>>

public class HoodieBloomIndexCheckFunction<I>
extends Object
implements Function<Iterator<I>,Iterator<List<HoodieKeyLookupResult>>>, Serializable

Function accepting a tuple of HoodieFileGroupId and a record key and producing a list of HoodieKeyLookupResult for every file identified by the file-group ids

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	HoodieBloomIndexCheckFunction.LazyKeyCheckIterator

Constructor Summary

Constructors

Constructor and Description
HoodieBloomIndexCheckFunction(HoodieTable hoodieTable, HoodieWriteConfig config, SerializableFunction<I,HoodieFileGroupId> fileGroupIdExtractor, SerializableFunction<I,String> recordKeyExtractor)

Method Summary

Modifier and Type	Method and Description
Iterator<List<HoodieKeyLookupResult>>	apply(Iterator<I> fileGroupIdRecordKeyPairIterator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.function.Function

andThen, compose, identity

Constructor Detail

HoodieBloomIndexCheckFunction

public HoodieBloomIndexCheckFunction(HoodieTable hoodieTable,
                                     HoodieWriteConfig config,
                                     SerializableFunction<I,HoodieFileGroupId> fileGroupIdExtractor,
                                     SerializableFunction<I,String> recordKeyExtractor)

Method Detail

apply

public Iterator<List<HoodieKeyLookupResult>> apply(Iterator<I> fileGroupIdRecordKeyPairIterator)

Specified by:

apply in interface Function<Iterator<I>,Iterator<List<HoodieKeyLookupResult>>>