Package org.apache.druid.segment.realtime.plumber

Class Sink

java.lang.Object

org.apache.druid.segment.realtime.plumber.Sink

All Implemented Interfaces:

Iterable<FireHydrant>, org.apache.druid.timeline.Overshadowable<Sink>

public class Sink
extends Object
implements Iterable<FireHydrant>, org.apache.druid.timeline.Overshadowable<Sink>

Constructor Summary

Constructors

Constructor	Description
Sink(org.joda.time.Interval interval, DataSchema schema, org.apache.druid.timeline.partition.ShardSpec shardSpec, String version, org.apache.druid.segment.incremental.AppendableIndexSpec appendableIndexSpec, int maxRowsInMemory, long maxBytesInMemory, boolean useMaxMemoryEstimates, String dedupColumn)
Sink(org.joda.time.Interval interval, DataSchema schema, org.apache.druid.timeline.partition.ShardSpec shardSpec, String version, org.apache.druid.segment.incremental.AppendableIndexSpec appendableIndexSpec, int maxRowsInMemory, long maxBytesInMemory, boolean useMaxMemoryEstimates, String dedupColumn, List<FireHydrant> hydrants)

Method Summary

Modifier and Type	Method	Description
List<SinkSegmentReference>	acquireSegmentReferences(Function<org.apache.druid.segment.SegmentReference,org.apache.druid.segment.SegmentReference> segmentMapFn, boolean skipIncrementalSegment)	Acquire references to all FireHydrant that represent this sink.
org.apache.druid.segment.incremental.IncrementalIndexAddResult	add(org.apache.druid.data.input.InputRow row, boolean skipMaxRowsInMemoryCheck)
boolean	canAppendRow()
void	clearDedupCache()
boolean	finished()
boolean	finishWriting()	Marks sink as 'finished', preventing further writes.
short	getAtomicUpdateGroupSize()
long	getBytesInMemory()
FireHydrant	getCurrHydrant()
int	getEndRootPartitionId()
org.joda.time.Interval	getInterval()
short	getMinorVersion()
int	getNumRows()
int	getNumRowsInMemory()
org.apache.druid.timeline.DataSegment	getSegment()
org.apache.druid.segment.column.RowSignature	getSignature()	Get column information from all the FireHydrant's.
int	getStartRootPartitionId()
String	getVersion()
boolean	isEmpty()
boolean	isWritable()
Iterator<FireHydrant>	iterator()
boolean	overshadows(Sink other)
FireHydrant	swap()	If currHydrant is A, creates a new index B, sets currHydrant to B and returns A.
boolean	swappable()
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Methods inherited from interface org.apache.druid.timeline.Overshadowable

containsRootPartition, hasData

Constructor Detail

Sink

public Sink(org.joda.time.Interval interval,
            DataSchema schema,
            org.apache.druid.timeline.partition.ShardSpec shardSpec,
            String version,
            org.apache.druid.segment.incremental.AppendableIndexSpec appendableIndexSpec,
            int maxRowsInMemory,
            long maxBytesInMemory,
            boolean useMaxMemoryEstimates,
            String dedupColumn)

Sink

public Sink(org.joda.time.Interval interval,
            DataSchema schema,
            org.apache.druid.timeline.partition.ShardSpec shardSpec,
            String version,
            org.apache.druid.segment.incremental.AppendableIndexSpec appendableIndexSpec,
            int maxRowsInMemory,
            long maxBytesInMemory,
            boolean useMaxMemoryEstimates,
            String dedupColumn,
            List<FireHydrant> hydrants)

Method Detail

clearDedupCache

public void clearDedupCache()

getInterval

public org.joda.time.Interval getInterval()

getCurrHydrant

public FireHydrant getCurrHydrant()

add

public org.apache.druid.segment.incremental.IncrementalIndexAddResult add(org.apache.druid.data.input.InputRow row,
                                                                          boolean skipMaxRowsInMemoryCheck)
                                                                   throws org.apache.druid.segment.incremental.IndexSizeExceededException

Throws:

org.apache.druid.segment.incremental.IndexSizeExceededException

canAppendRow

public boolean canAppendRow()

isEmpty

public boolean isEmpty()

isWritable

public boolean isWritable()

swap

public FireHydrant swap()

If currHydrant is A, creates a new index B, sets currHydrant to B and returns A.

Returns:

the current index after swapping in a new one

swappable

public boolean swappable()

finished

public boolean finished()

finishWriting

public boolean finishWriting()

Marks sink as 'finished', preventing further writes.

Returns:

'true' if sink was sucessfully finished, 'false' if sink was already finished

getSegment

public org.apache.druid.timeline.DataSegment getSegment()

getNumRows

public int getNumRows()

getNumRowsInMemory

public int getNumRowsInMemory()

getBytesInMemory

public long getBytesInMemory()

acquireSegmentReferences

@Nullable
public List<SinkSegmentReference> acquireSegmentReferences(Function<org.apache.druid.segment.SegmentReference,org.apache.druid.segment.SegmentReference> segmentMapFn,
                                                           boolean skipIncrementalSegment)

Acquire references to all FireHydrant that represent this sink. Returns null if they cannot all be acquired, possibly because they were closed (swapped to null) concurrently with this method being called.

Parameters:

segmentMapFn - from DataSource.createSegmentMapFunction(Query, AtomicLong)

skipIncrementalSegment - whether in-memory IncrementalIndex segments should be skipped

getSignature

public org.apache.druid.segment.column.RowSignature getSignature()

Get column information from all the FireHydrant's.

iterator

public Iterator<FireHydrant> iterator()

Specified by:

iterator in interface Iterable<FireHydrant>

toString

public String toString()

Overrides:

toString in class Object

overshadows

public boolean overshadows(Sink other)

Specified by:

overshadows in interface org.apache.druid.timeline.Overshadowable<Sink>

getStartRootPartitionId

public int getStartRootPartitionId()

Specified by:

getStartRootPartitionId in interface org.apache.druid.timeline.Overshadowable<Sink>

getEndRootPartitionId

public int getEndRootPartitionId()

Specified by:

getEndRootPartitionId in interface org.apache.druid.timeline.Overshadowable<Sink>

getVersion

public String getVersion()

Specified by:

getVersion in interface org.apache.druid.timeline.Overshadowable<Sink>

getMinorVersion

public short getMinorVersion()

Specified by:

getMinorVersion in interface org.apache.druid.timeline.Overshadowable<Sink>

getAtomicUpdateGroupSize

public short getAtomicUpdateGroupSize()

Specified by:

getAtomicUpdateGroupSize in interface org.apache.druid.timeline.Overshadowable<Sink>