c

org.apache.spark.sql.kafka011

KafkaStreamWriterFactory

case class KafkaStreamWriterFactory(topic: Option[String], producerParams: Map[String, AnyRef], schema: StructType) extends DataWriterFactory[InternalRow] with Product with Serializable

A DataWriterFactory for Kafka writing. Will be serialized and sent to executors to generate the per-task data writers.

topic

The topic that should be written to. If None, topic will be inferred from a topic field in the incoming data.

producerParams

Parameters for Kafka producers in each task.

schema

The schema of the input data.

Linear Supertypes
Serializable, Product, Equals, DataWriterFactory[InternalRow], Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. KafkaStreamWriterFactory
  2. Serializable
  3. Product
  4. Equals
  5. DataWriterFactory
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new KafkaStreamWriterFactory(topic: Option[String], producerParams: Map[String, AnyRef], schema: StructType)

    topic

    The topic that should be written to. If None, topic will be inferred from a topic field in the incoming data.

    producerParams

    Parameters for Kafka producers in each task.

    schema

    The schema of the input data.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )
  6. def createDataWriter(partitionId: Int, taskId: Long, epochId: Long): DataWriter[InternalRow]
    Definition Classes
    KafkaStreamWriterFactory → DataWriterFactory
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  11. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  13. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. val producerParams: Map[String, AnyRef]
  15. val schema: StructType
  16. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  17. val topic: Option[String]
  18. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from DataWriterFactory[InternalRow]

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped