Package org.apache.pinot.segment.local.segment.creator.impl

Class SegmentIndexCreationDriverImpl

java.lang.Object

org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl

All Implemented Interfaces:

Serializable, SegmentIndexCreationDriver

public class SegmentIndexCreationDriverImpl
extends Object
implements SegmentIndexCreationDriver

Implementation of an index segment creator.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor	Description
SegmentIndexCreationDriverImpl()

Method Summary

Modifier and Type	Method	Description
void	build()
ColumnStatistics	getColumnStatisticsCollector(String columnName)
IngestionSchemaValidator	getIngestionSchemaValidator()	Returns the schema validator.
File	getOutputDirectory()	Returns the path of the output directory
RecordReader	getRecordReader()
String	getSegmentName()	Returns the name of the segment associated with this index creation driver.
SegmentPreIndexStatsContainer	getSegmentStats()
void	init(SegmentGeneratorConfig config)
void	init(SegmentGeneratorConfig config, SegmentCreationDataSource dataSource, RecordTransformer recordTransformer, ComplexTypeTransformer complexTypeTransformer)	Deprecated.
void	init(SegmentGeneratorConfig config, SegmentCreationDataSource dataSource, TransformPipeline transformPipeline)
void	init(SegmentGeneratorConfig config, RecordReader recordReader)
static void	persistCreationMeta(File indexDir, long crc, long creationTime)
static boolean	shouldUseVarLengthDictionary(String columnName, Set<String> varLengthDictColumns, FieldSpec.DataType columnStoredType, ColumnStatistics columnProfile)	Uses config and column properties like storedType and length of elements to determine if varLengthDictionary should be used for a column

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SegmentIndexCreationDriverImpl

public SegmentIndexCreationDriverImpl()

Method Detail

init

public void init(SegmentGeneratorConfig config)
          throws Exception

Specified by:

init in interface SegmentIndexCreationDriver

Throws:

Exception

getRecordReader

public RecordReader getRecordReader()

init

public void init(SegmentGeneratorConfig config,
                 RecordReader recordReader)
          throws Exception

Throws:

Exception

init

@Deprecated
public void init(SegmentGeneratorConfig config,
                 SegmentCreationDataSource dataSource,
                 RecordTransformer recordTransformer,
                 @Nullable
                 ComplexTypeTransformer complexTypeTransformer)
          throws Exception

Deprecated.

Throws:

Exception

init

public void init(SegmentGeneratorConfig config,
                 SegmentCreationDataSource dataSource,
                 TransformPipeline transformPipeline)
          throws Exception

Throws:

Exception

build

public void build()
           throws Exception

Specified by:

build in interface SegmentIndexCreationDriver

Throws:

Exception

getColumnStatisticsCollector

public ColumnStatistics getColumnStatisticsCollector(String columnName)
                                              throws Exception

Specified by:

getColumnStatisticsCollector in interface SegmentIndexCreationDriver

Throws:

Exception

persistCreationMeta

public static void persistCreationMeta(File indexDir,
                                       long crc,
                                       long creationTime)
                                throws IOException

Throws:

IOException

shouldUseVarLengthDictionary

public static boolean shouldUseVarLengthDictionary(String columnName,
                                                   Set<String> varLengthDictColumns,
                                                   FieldSpec.DataType columnStoredType,
                                                   ColumnStatistics columnProfile)

Uses config and column properties like storedType and length of elements to determine if varLengthDictionary should be used for a column

getSegmentName

public String getSegmentName()

Returns the name of the segment associated with this index creation driver.

Specified by:

getSegmentName in interface SegmentIndexCreationDriver

getOutputDirectory

public File getOutputDirectory()

Returns the path of the output directory

Specified by:

getOutputDirectory in interface SegmentIndexCreationDriver

getIngestionSchemaValidator

public IngestionSchemaValidator getIngestionSchemaValidator()

Returns the schema validator.

Specified by:

getIngestionSchemaValidator in interface SegmentIndexCreationDriver

getSegmentStats

public SegmentPreIndexStatsContainer getSegmentStats()