abstract class GenericKinesis[F[_]] extends Kinesis[F]
- Alphabetic
- By Inheritance
- GenericKinesis
- Kinesis
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new GenericKinesis()(implicit arg0: Async[F], arg1: Concurrent[F])
Abstract Value Members
- abstract def readChunkedFromKinesisStream(consumerConfig: KinesisConsumerSettings): Stream[F, Chunk[CommittableRecord]]
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- consumerConfig
configuration parameters for the KCL
- returns
an infinite fs2 Stream that emits Kinesis Records Chunks
- Definition Classes
- Kinesis
Concrete Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def checkpointRecords(checkpointSettings: KinesisCheckpointSettings): Pipe[F, CommittableRecord, KinesisClientRecord]
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
- checkpointSettings
configure maxBatchSize and maxBatchWait time before triggering a checkpoint
- returns
a stream of Record types representing checkpointed messages
- Definition Classes
- GenericKinesis → Kinesis
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @HotSpotIntrinsicCandidate() @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @HotSpotIntrinsicCandidate() @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @HotSpotIntrinsicCandidate() @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @HotSpotIntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @HotSpotIntrinsicCandidate() @native()
- def readFromKinesisStream(consumerConfig: KinesisConsumerSettings): Stream[F, CommittableRecord]
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- consumerConfig
configuration parameters for the KCL
- returns
an infinite fs2 Stream that emits Kinesis Records
- Definition Classes
- Kinesis
- def readFromKinesisStream(appName: String, streamName: String): Stream[F, CommittableRecord]
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- appName
name of the Kinesis application. Used by KCL when resharding
- streamName
name of the Kinesis stream to consume from
- returns
an infinite fs2 Stream that emits Kinesis Records
- Definition Classes
- Kinesis
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)