org.apache.druid.segment.realtime.appenderator

Class UnifiedIndexerAppenderatorsManager.LimitedPoolIndexMerger

java.lang.Object

org.apache.druid.segment.realtime.appenderator.UnifiedIndexerAppenderatorsManager.LimitedPoolIndexMerger

All Implemented Interfaces:

IndexMerger

Enclosing class:

UnifiedIndexerAppenderatorsManager

public static class UnifiedIndexerAppenderatorsManager.LimitedPoolIndexMerger
extends Object
implements IndexMerger

This wrapper around IndexMerger limits concurrent calls to the merge/persist methods used by AppenderatorImpl with a shared executor service. Merge/persist methods that are not used by AppenderatorImpl will throw an exception if called.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.druid.segment.IndexMerger

IndexMerger.DictionaryMergeIterator, IndexMerger.IndexSeeker, IndexMerger.IndexSeekerWithConversion

Field Summary

Fields inherited from interface org.apache.druid.segment.IndexMerger

INVALID_ROW, log, SERIALIZER_UTILS

Constructor Summary

Constructors

Constructor and Description
LimitedPoolIndexMerger(IndexMerger baseMerger, com.google.common.util.concurrent.ListeningExecutorService mergeExecutor)

Method Summary

Modifier and Type	Method and Description
File	append(List<IndexableAdapter> indexes, AggregatorFactory[] aggregators, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	convert(File inDir, File outDir, IndexSpec indexSpec)
File	merge(List<IndexableAdapter> indexes, boolean rollup, AggregatorFactory[] metricAggs, File outDir, IndexSpec indexSpec)
File	mergeQueryableIndex(List<QueryableIndex> indexes, boolean rollup, AggregatorFactory[] metricAggs, File outDir, IndexSpec indexSpec, ProgressIndicator progress, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	mergeQueryableIndex(List<QueryableIndex> indexes, boolean rollup, AggregatorFactory[] metricAggs, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	persist(IncrementalIndex index, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	persist(IncrementalIndex index, org.joda.time.Interval dataInterval, File outDir, IndexSpec indexSpec, ProgressIndicator progress, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
File	persist(IncrementalIndex index, org.joda.time.Interval dataInterval, File outDir, IndexSpec indexSpec, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.druid.segment.IndexMerger

getLexicographicMergedDimensions, getLongestSharedDimOrder, getMergedDimensions, getMergedDimensionsFromQueryableIndexes, makeRowIteratorWithConvertedDimensionColumns, mergeIndexed, toIndexableAdapters, toMergedIndexRowIterator

Constructor Detail

LimitedPoolIndexMerger

public LimitedPoolIndexMerger(IndexMerger baseMerger,
                              com.google.common.util.concurrent.ListeningExecutorService mergeExecutor)

Method Detail

mergeQueryableIndex

public File mergeQueryableIndex(List<QueryableIndex> indexes,
                                boolean rollup,
                                AggregatorFactory[] metricAggs,
                                File outDir,
                                IndexSpec indexSpec,
                                @Nullable
                                SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)

Specified by:

mergeQueryableIndex in interface IndexMerger

persist

public File persist(IncrementalIndex index,
                    org.joda.time.Interval dataInterval,
                    File outDir,
                    IndexSpec indexSpec,
                    @Nullable
                    SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)

Specified by:

persist in interface IndexMerger

merge

public File merge(List<IndexableAdapter> indexes,
                  boolean rollup,
                  AggregatorFactory[] metricAggs,
                  File outDir,
                  IndexSpec indexSpec)

Specified by:

merge in interface IndexMerger

convert

public File convert(File inDir,
                    File outDir,
                    IndexSpec indexSpec)

Specified by:

convert in interface IndexMerger

append

public File append(List<IndexableAdapter> indexes,
                   AggregatorFactory[] aggregators,
                   File outDir,
                   IndexSpec indexSpec,
                   @Nullable
                   SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)

Specified by:

append in interface IndexMerger

persist

public File persist(IncrementalIndex index,
                    File outDir,
                    IndexSpec indexSpec,
                    @Nullable
                    SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)

Specified by:

persist in interface IndexMerger

persist

public File persist(IncrementalIndex index,
                    org.joda.time.Interval dataInterval,
                    File outDir,
                    IndexSpec indexSpec,
                    ProgressIndicator progress,
                    @Nullable
                    SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)

Specified by:

persist in interface IndexMerger

mergeQueryableIndex

public File mergeQueryableIndex(List<QueryableIndex> indexes,
                                boolean rollup,
                                AggregatorFactory[] metricAggs,
                                File outDir,
                                IndexSpec indexSpec,
                                ProgressIndicator progress,
                                @Nullable
                                SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)

Specified by:

mergeQueryableIndex in interface IndexMerger