Package org.apache.pinot.spi.stream
-
Interface Summary Interface Description MessageBatch<T> Interface wrapping stream consumer.PartitionGroupConsumer Consumer interface for consuming from a partition group of a streamPartitionLevelConsumer Interface for a consumer which fetches messages at the partition level of a stream, for given offsetsRowMetadata A class that provides relevant row-level metadata for rows indexed into a segment.StreamDataDecoder A decoder forStreamMessageStreamDataProducer StreamDataProducer is the interface for stream data sources.StreamDataServerStartable StreamDataServerStartable is the interface for stream data sources.StreamLevelConsumer Interface for a consumer that consumes at stream level and is unaware of any partitions of the streamStreamMessageDecoder<T> Interface for a decoder of messages fetched from the streamStreamMetadataProvider Interface for provider of stream metadata such as partition count, partition offsetsStreamPartitionMsgOffset An interface to be implemented by streams consumed using Pinot LLC consumers.StreamPartitionMsgOffsetFactory An interface to be implemented by streams that are consumed using Pinot LLC consumption. -
Class Summary Class Description ConsumerPartitionState Container for holding the current consumption state at a per-partition levelLongMsgOffset LongMsgOffsetFactory MessageBatch.LegacyStreamMessage OffsetCriteria Defines and builds the offset criteria for consumption from a streamOffsetCriteria.OffsetCriteriaBuilder Builds anOffsetCriteriaPartitionGroupConsumptionStatus A PartitionGroup is a group of partitions/shards that the same consumer should consume from.PartitionGroupMetadata A PartitionGroup is a group of partitions/shards that the same consumer should consume from.PartitionGroupMetadataFetcher Fetches the list ofPartitionGroupMetadatafor all partition groups of the stream, using theStreamMetadataProviderPartitionLagState Container that can be used for holding per-partition consumer lag calculated along standard dimensions such as record offset, ingestion time etc.PartitionLevelStreamConfig AStreamConfigfor LLC partition level stream, which overrides some properties for low-level consumer.StreamConfig Provides all the configs related to the stream as configured in the table configStreamConfigProperties Defines the keys for the stream config properties mapStreamConsumerFactory Factory for a stream which provides a consumer and a metadata provider for the streamStreamConsumerFactoryProvider Provider class forStreamConsumerFactoryStreamDataDecoderImpl StreamDataDecoderResult A container class for holding the result of a decoder At any point in time, only one of Result or exception is set as null.StreamDataProducer.RowWithKey Helper class so the key and payload can be easily tied together instead of using a pair The class is intended for StreamDataProducer onlyStreamDataProvider StreamDataProvider provides StreamDataServerStartable and StreamDataProducer based on given implementation class name.StreamDecoderProvider Provider forStreamMessageDecoderStreamMessage<T> Represents a Stream message which includes the following components: 1.StreamMessageMetadata A class that provides metadata associated with the message of a stream, for e.g., timestamp derived from the incoming record (not the ingestion time).StreamMetadataProvider.UnknownLagState -
Enum Summary Enum Description StreamConfig.ConsumerType The type of the stream consumer either HIGHLEVEL or LOWLEVEL. -
Exception Summary Exception Description PermanentConsumerException A stream subsystem error that indicates a situation that is not likely to clear up by retrying the request (for example, no such topic or offset out of range).TransientConsumerException A stream subsystem error that indicates a situation that is likely to be transient (for example, network error or broker not available).