Packages

c

org.apache.spark.sql.execution.streaming

ContinuousRecordEndpoint

class ContinuousRecordEndpoint extends ThreadSafeRpcEndpoint

A RPC end point for continuous readers to poll for records from the driver.

Linear Supertypes
ThreadSafeRpcEndpoint, RpcEndpoint, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ContinuousRecordEndpoint
  2. ThreadSafeRpcEndpoint
  3. RpcEndpoint
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new ContinuousRecordEndpoint(buckets: Seq[Seq[UnsafeRow]], lock: AnyRef)

    buckets

    the data buckets. Each bucket contains a sequence of items to be returned for a partition. The number of buckets should be equal to to the number of partitions.

    lock

    a lock object for locking the buckets for read

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  9. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. def onConnected(remoteAddress: RpcAddress): Unit
    Definition Classes
    RpcEndpoint
  16. def onDisconnected(remoteAddress: RpcAddress): Unit
    Definition Classes
    RpcEndpoint
  17. def onError(cause: Throwable): Unit
    Definition Classes
    RpcEndpoint
  18. def onNetworkError(cause: Throwable, remoteAddress: RpcAddress): Unit
    Definition Classes
    RpcEndpoint
  19. def onStart(): Unit
    Definition Classes
    RpcEndpoint
  20. def onStop(): Unit
    Definition Classes
    RpcEndpoint
  21. def receive: PartialFunction[Any, Unit]
    Definition Classes
    RpcEndpoint
  22. def receiveAndReply(context: RpcCallContext): PartialFunction[Any, Unit]

    Process messages from RpcEndpointRef.ask.

    Process messages from RpcEndpointRef.ask. If receiving a unmatched message, SparkException will be thrown and sent to onError.

    Definition Classes
    ContinuousRecordEndpoint → RpcEndpoint
  23. val rpcEnv: RpcEnv
    Definition Classes
    ContinuousRecordEndpoint → RpcEndpoint
  24. final def self: RpcEndpointRef
    Definition Classes
    RpcEndpoint
  25. def setStartOffsets(offsets: Seq[Int]): Unit

    Sets the start offset.

    Sets the start offset.

    offsets

    the base offset per partition to be used while retrieving the data in {#receiveAndReply}.

  26. final def stop(): Unit
    Definition Classes
    RpcEndpoint
  27. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  28. def toString(): String
    Definition Classes
    AnyRef → Any
  29. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  30. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  31. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from ThreadSafeRpcEndpoint

Inherited from RpcEndpoint

Inherited from AnyRef

Inherited from Any

Ungrouped