Interface SegmentIndexCreationDriver
-
- All Superinterfaces:
Serializable
public interface SegmentIndexCreationDriver extends Serializable
Driver that creates and writes index segments to disk from data that is stored on disk. Nov 6, 2014
-
-
Method Summary
Modifier and Type Method Description voidbuild()Builds an index segment and writes it to disk.ColumnStatisticsgetColumnStatisticsCollector(String columnName)Get the stats collector for a columnIngestionSchemaValidatorgetIngestionSchemaValidator()FilegetOutputDirectory()Returns the path of the output directoryStringgetSegmentName()voidinit(SegmentGeneratorConfig config)Configures the segment generator with the given segment generator configuration, which contains the input file location, format, schema and other necessary information to create an index segment.
-
-
-
Method Detail
-
init
void init(SegmentGeneratorConfig config) throws Exception
Configures the segment generator with the given segment generator configuration, which contains the input file location, format, schema and other necessary information to create an index segment.- Parameters:
config- The configuration to use when building an index segment- Throws:
Exception
-
build
void build() throws ExceptionBuilds an index segment and writes it to disk. The index segment creation extracts data from the input files, profiles each column and then builds indices based on the profiling information gathered.- Throws:
Exception
-
getSegmentName
String getSegmentName()
-
getColumnStatisticsCollector
ColumnStatistics getColumnStatisticsCollector(String columnName) throws Exception
Get the stats collector for a column- Parameters:
columnName-- Returns:
- AbstractColumnStatisticsCollector for the column.
- Throws:
Exception
-
getOutputDirectory
File getOutputDirectory()
Returns the path of the output directory
-
getIngestionSchemaValidator
IngestionSchemaValidator getIngestionSchemaValidator()
-
-