org.apache.druid.segment

Interface IndexMerger

All Known Implementing Classes:

IndexMergerV9

public interface IndexMerger

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	IndexMerger.DictionaryMergeIterator
static interface	IndexMerger.IndexSeeker
static class	IndexMerger.IndexSeekerWithConversion Get old dictId from new dictId, and only support access in order

Field Summary

Fields

Modifier and Type	Field and Description
static int	INVALID_ROW
static Logger	log
static SerializerUtils	SERIALIZER_UTILS

Method Summary

Modifier and Type	Method and Description
File	append(List<IndexableAdapter> indexes, AggregatorFactory[] aggregators, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	convert(File inDir, File outDir, IndexSpec indexSpec)
static List<String>	getLexicographicMergedDimensions(List<IndexableAdapter> indexes)
static List<String>	getLongestSharedDimOrder(List<IndexableAdapter> indexes)
static List<String>	getMergedDimensions(List<IndexableAdapter> indexes)
static List<String>	getMergedDimensionsFromQueryableIndexes(List<QueryableIndex> indexes)
static TransformableRowIterator	makeRowIteratorWithConvertedDimensionColumns(TransformableRowIterator sourceRowIterator, ColumnValueSelector[] convertedDimensionSelectors, ColumnValueSelector[] convertedMarkedDimensionSelectors)
File	merge(List<IndexableAdapter> indexes, boolean rollup, AggregatorFactory[] metricAggs, File outDir, IndexSpec indexSpec)
static <T extends Comparable<? super T>> ArrayList<T>	mergeIndexed(List<Iterable<T>> indexedLists)
File	mergeQueryableIndex(List<QueryableIndex> indexes, boolean rollup, AggregatorFactory[] metricAggs, File outDir, IndexSpec indexSpec, ProgressIndicator progress, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	mergeQueryableIndex(List<QueryableIndex> indexes, boolean rollup, AggregatorFactory[] metricAggs, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	persist(IncrementalIndex index, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	persist(IncrementalIndex index, org.joda.time.Interval dataInterval, File outDir, IndexSpec indexSpec, ProgressIndicator progress, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	persist(IncrementalIndex index, org.joda.time.Interval dataInterval, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) This is *not* thread-safe and havok will ensue if this is called and writes are still occurring on the IncrementalIndex object.
static List<IndexableAdapter>	toIndexableAdapters(List<QueryableIndex> indexes)
static TransformableRowIterator	toMergedIndexRowIterator(TransformableRowIterator sourceRowIterator, int indexNumber, List<DimensionMergerV9> mergers) This method applies DimensionMerger.convertSortedSegmentRowValuesToMergedRowValues(int, ColumnValueSelector) to all dimension column selectors of the given sourceRowIterator, using the given index number.

Field Detail

log

static final Logger log

SERIALIZER_UTILS

static final SerializerUtils SERIALIZER_UTILS

INVALID_ROW

static final int INVALID_ROW

See Also:

Constant Field Values

Method Detail

getMergedDimensionsFromQueryableIndexes

static List<String> getMergedDimensionsFromQueryableIndexes(List<QueryableIndex> indexes)

toIndexableAdapters

static List<IndexableAdapter> toIndexableAdapters(List<QueryableIndex> indexes)

getMergedDimensions

static List<String> getMergedDimensions(List<IndexableAdapter> indexes)

getLongestSharedDimOrder

@Nullable
static List<String> getLongestSharedDimOrder(List<IndexableAdapter> indexes)

getLexicographicMergedDimensions

static List<String> getLexicographicMergedDimensions(List<IndexableAdapter> indexes)

mergeIndexed

static <T extends Comparable<? super T>> ArrayList<T> mergeIndexed(List<Iterable<T>> indexedLists)

persist

File persist(IncrementalIndex index,
             File outDir,
             IndexSpec indexSpec,
             @Nullable
             SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
      throws IOException

Throws:

IOException

persist

File persist(IncrementalIndex index,
             org.joda.time.Interval dataInterval,
             File outDir,
             IndexSpec indexSpec,
             @Nullable
             SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
      throws IOException

This is *not* thread-safe and havok will ensue if this is called and writes are still occurring on the IncrementalIndex object.

Parameters:

index - the IncrementalIndex to persist

dataInterval - the Interval that the data represents

outDir - the directory to persist the data to

Returns:

the index output directory

Throws:

IOException - if an IO error occurs persisting the index

persist

File persist(IncrementalIndex index,
             org.joda.time.Interval dataInterval,
             File outDir,
             IndexSpec indexSpec,
             ProgressIndicator progress,
             @Nullable
             SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
      throws IOException

Throws:

IOException

mergeQueryableIndex

File mergeQueryableIndex(List<QueryableIndex> indexes,
                         boolean rollup,
                         AggregatorFactory[] metricAggs,
                         File outDir,
                         IndexSpec indexSpec,
                         @Nullable
                         SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
                  throws IOException

Throws:

IOException

mergeQueryableIndex

File mergeQueryableIndex(List<QueryableIndex> indexes,
                         boolean rollup,
                         AggregatorFactory[] metricAggs,
                         File outDir,
                         IndexSpec indexSpec,
                         ProgressIndicator progress,
                         @Nullable
                         SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
                  throws IOException

Throws:

IOException

merge

File merge(List<IndexableAdapter> indexes,
           boolean rollup,
           AggregatorFactory[] metricAggs,
           File outDir,
           IndexSpec indexSpec)
    throws IOException

Throws:

IOException

convert

File convert(File inDir,
             File outDir,
             IndexSpec indexSpec)
      throws IOException

Throws:

IOException

append

File append(List<IndexableAdapter> indexes,
            AggregatorFactory[] aggregators,
            File outDir,
            IndexSpec indexSpec,
            @Nullable
            SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
     throws IOException

Throws:

IOException

toMergedIndexRowIterator

static TransformableRowIterator toMergedIndexRowIterator(TransformableRowIterator sourceRowIterator,
                                                         int indexNumber,
                                                         List<DimensionMergerV9> mergers)

This method applies DimensionMerger.convertSortedSegmentRowValuesToMergedRowValues(int, ColumnValueSelector) to all dimension column selectors of the given sourceRowIterator, using the given index number.

makeRowIteratorWithConvertedDimensionColumns

static TransformableRowIterator makeRowIteratorWithConvertedDimensionColumns(TransformableRowIterator sourceRowIterator,
                                                                             ColumnValueSelector[] convertedDimensionSelectors,
                                                                             ColumnValueSelector[] convertedMarkedDimensionSelectors)