org.apache.hudi.metadata

Class JavaHoodieMetadataBulkInsertPartitioner<T>

java.lang.Object

org.apache.hudi.metadata.JavaHoodieMetadataBulkInsertPartitioner<T>

Type Parameters:

T - HoodieRecordPayload type

All Implemented Interfaces:

Serializable, BulkInsertPartitioner<List<org.apache.hudi.common.model.HoodieRecord<T>>>

public class JavaHoodieMetadataBulkInsertPartitioner<T>
extends Object
implements BulkInsertPartitioner<List<org.apache.hudi.common.model.HoodieRecord<T>>>

A BulkInsertPartitioner implementation for Metadata Table to improve performance of initialization of metadata table partition when a very large number of records are inserted.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
JavaHoodieMetadataBulkInsertPartitioner()

Method Summary

Modifier and Type	Method and Description
boolean	arePartitionRecordsSorted()
String	getFileIdPfx(int partitionId)
List<org.apache.hudi.common.model.HoodieRecord<T>>	repartitionRecords(List<org.apache.hudi.common.model.HoodieRecord<T>> records, int outputPartitions)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.table.BulkInsertPartitioner

getWriteHandleFactory, tryPrependPartitionPathColumns

Constructor Detail

JavaHoodieMetadataBulkInsertPartitioner

public JavaHoodieMetadataBulkInsertPartitioner()

Method Detail

repartitionRecords

public List<org.apache.hudi.common.model.HoodieRecord<T>> repartitionRecords(List<org.apache.hudi.common.model.HoodieRecord<T>> records,
                                                                             int outputPartitions)

Specified by:

repartitionRecords in interface BulkInsertPartitioner<List<org.apache.hudi.common.model.HoodieRecord<T>>>

arePartitionRecordsSorted

public boolean arePartitionRecordsSorted()

Specified by:

arePartitionRecordsSorted in interface BulkInsertPartitioner<List<org.apache.hudi.common.model.HoodieRecord<T>>>

getFileIdPfx

public String getFileIdPfx(int partitionId)

Specified by:

getFileIdPfx in interface BulkInsertPartitioner<List<org.apache.hudi.common.model.HoodieRecord<T>>>