Package org.apache.druid.segment.realtime.appenderator

Class AppenderatorPlumber

java.lang.Object

org.apache.druid.segment.realtime.appenderator.AppenderatorPlumber

All Implemented Interfaces:

Plumber

public class AppenderatorPlumber
extends Object
implements Plumber

Field Summary

Fields inherited from interface org.apache.druid.segment.realtime.plumber.Plumber

DUPLICATE, NOT_WRITABLE, THROWAWAY

Constructor Summary

Constructors

Constructor	Description
AppenderatorPlumber(DataSchema schema, RealtimeTuningConfig config, FireDepartmentMetrics metrics, DataSegmentAnnouncer segmentAnnouncer, SegmentPublisher segmentPublisher, SegmentHandoffNotifier handoffNotifier, Appenderator appenderator)

Method Summary

Modifier and Type	Method	Description
org.apache.druid.segment.incremental.IncrementalIndexAddResult	add(org.apache.druid.data.input.InputRow row, com.google.common.base.Supplier<org.apache.druid.data.input.Committer> committerSupplier)
void	dropSegment(SegmentIdWithShardSpec identifier)
void	finishJob()	Perform any final processing and clean up after ourselves.
RealtimeTuningConfig	getConfig()
<T> org.apache.druid.query.QueryRunner<T>	getQueryRunner(org.apache.druid.query.Query<T> query)
RejectionPolicy	getRejectionPolicy()
DataSchema	getSchema()
Map<Long,SegmentIdWithShardSpec>	getSegmentsView()
protected void	initializeExecutors()
void	persist(org.apache.druid.data.input.Committer committer)	Persist any in-memory indexed data to durable storage.
protected void	shutdownExecutors()
Object	startJob()	Perform any initial setup.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AppenderatorPlumber

public AppenderatorPlumber(DataSchema schema,
                           RealtimeTuningConfig config,
                           FireDepartmentMetrics metrics,
                           DataSegmentAnnouncer segmentAnnouncer,
                           SegmentPublisher segmentPublisher,
                           SegmentHandoffNotifier handoffNotifier,
                           Appenderator appenderator)

Method Detail

getSegmentsView

public Map<Long,SegmentIdWithShardSpec> getSegmentsView()

getSchema

public DataSchema getSchema()

getConfig

public RealtimeTuningConfig getConfig()

getRejectionPolicy

public RejectionPolicy getRejectionPolicy()

startJob

public Object startJob()

Description copied from interface: Plumber

Perform any initial setup. Should be called before using any other methods, and should be paired with a corresponding call to Plumber.finishJob().

Specified by:

startJob in interface Plumber

Returns:

the metadata of the "newest" segment that might have previously been persisted

add

public org.apache.druid.segment.incremental.IncrementalIndexAddResult add(org.apache.druid.data.input.InputRow row,
                                                                          com.google.common.base.Supplier<org.apache.druid.data.input.Committer> committerSupplier)
                                                                   throws org.apache.druid.segment.incremental.IndexSizeExceededException

Specified by:

add in interface Plumber

Parameters:

row - the row to insert

committerSupplier - supplier of a committer associated with all data that has been added, including this row

Returns:

IncrementalIndexAddResult whose rowCount - positive numbers indicate how many summarized rows exist in the index for that timestamp, -1 means a row was thrown away because it was too late -2 means a row was thrown away because it is duplicate

Throws:

org.apache.druid.segment.incremental.IndexSizeExceededException

getQueryRunner

public <T> org.apache.druid.query.QueryRunner<T> getQueryRunner(org.apache.druid.query.Query<T> query)

Specified by:

getQueryRunner in interface Plumber

persist

public void persist(org.apache.druid.data.input.Committer committer)

Description copied from interface: Plumber

Persist any in-memory indexed data to durable storage. This may be only somewhat durable, e.g. the machine's local disk.

Specified by:

persist in interface Plumber

Parameters:

committer - committer to use after persisting data

finishJob

public void finishJob()

Description copied from interface: Plumber

Perform any final processing and clean up after ourselves. Should be called after all data has been fed into sinks and persisted.

Specified by:

finishJob in interface Plumber

initializeExecutors

protected void initializeExecutors()

shutdownExecutors

protected void shutdownExecutors()

dropSegment

public void dropSegment(SegmentIdWithShardSpec identifier)