Package org.apache.beam.runners.spark.translation.streaming

Class UnboundedDataset<T>

  • All Implemented Interfaces:
    java.io.Serializable, Dataset
    public class UnboundedDataset<T>
extends java.lang.Object
implements Dataset
    DStream holder Can also crate a DStream from a supplied queue of values, but mainly for testing.
    See Also:
    Serialized Form

    • Constructor Summary

      Constructors 
      Constructor Description
      UnboundedDataset​(org.apache.spark.streaming.api.java.JavaDStream<org.apache.beam.sdk.util.WindowedValue<T>> dStream, java.util.List<java.lang.Integer> streamSources)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void action()  
      void cache​(java.lang.String storageLevel, org.apache.beam.sdk.coders.Coder<?> coder)  
      org.apache.spark.streaming.api.java.JavaDStream<org.apache.beam.sdk.util.WindowedValue<T>> getDStream()  
      java.util.List<java.lang.Integer> getStreamSources()  
      void setName​(java.lang.String name)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • UnboundedDataset

        public UnboundedDataset​(org.apache.spark.streaming.api.java.JavaDStream<org.apache.beam.sdk.util.WindowedValue<T>> dStream,
                        java.util.List<java.lang.Integer> streamSources)

    • Method Detail

      • getDStream

        public org.apache.spark.streaming.api.java.JavaDStream<org.apache.beam.sdk.util.WindowedValue<T>> getDStream()

      • getStreamSources

        public java.util.List<java.lang.Integer> getStreamSources()

      • cache

        public void cache​(java.lang.String storageLevel,
                  org.apache.beam.sdk.coders.Coder<?> coder)
        Specified by:
        cache in interface Dataset

      • action

        public void action()
        Specified by:
        action in interface Dataset

      • setName

        public void setName​(java.lang.String name)
        Specified by:
        setName in interface Dataset