com.facebook.presto.hudi.split

Class SizeBasedSplitWeightProvider

java.lang.Object

com.facebook.presto.hudi.split.SizeBasedSplitWeightProvider

All Implemented Interfaces:

HudiSplitWeightProvider

public class SizeBasedSplitWeightProvider
extends Object
implements HudiSplitWeightProvider

Hudi split weight provider based on the split size. The standard split size, `standardSplitSize` in bytes, corresponding split weight "1" and the minimum weight `minimumWeight` are given during the initialization. Given the split size in bytes as `splitSizeInBytes`, the raw weight is calculated as `splitSizeInBytes / standardSplitSize`. If the weight is smaller than `minimumWeight`, `minimumWeight` is used. If the weight is larger than 1, 1 is used as the weight. The split weight is always in the range of [`minimumWeight`, 1].

Constructor Summary

Constructors

Constructor and Description
SizeBasedSplitWeightProvider(double minimumWeight, io.airlift.units.DataSize standardSplitSize)

Method Summary

Modifier and Type	Method and Description
SplitWeight	calculateSplitWeight(long splitSizeInBytes)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.facebook.presto.hudi.split.HudiSplitWeightProvider

uniformStandardWeightProvider

Constructor Detail

SizeBasedSplitWeightProvider

public SizeBasedSplitWeightProvider(double minimumWeight,
                                    io.airlift.units.DataSize standardSplitSize)

Method Detail

calculateSplitWeight

public SplitWeight calculateSplitWeight(long splitSizeInBytes)

Specified by:

calculateSplitWeight in interface HudiSplitWeightProvider