Package org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions

Class GroupAlsoByWindowViaOutputBufferFn<K,​InputT,​W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.spark.api.java.function.FlatMapGroupsFunction<K,​org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​InputT>>,​org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​java.lang.Iterable<InputT>>>>
    public class GroupAlsoByWindowViaOutputBufferFn<K,​InputT,​W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>
extends java.lang.Object
implements org.apache.spark.api.java.function.FlatMapGroupsFunction<K,​org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​InputT>>,​org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​java.lang.Iterable<InputT>>>>
    A FlatMap function that groups by windows in batch mode using ReduceFnRunner.
    See Also:
    Serialized Form

    • Constructor Summary

      Constructors 
      Constructor Description
      GroupAlsoByWindowViaOutputBufferFn​(org.apache.beam.sdk.values.WindowingStrategy<?,​W> windowingStrategy, org.apache.beam.runners.core.StateInternalsFactory<K> stateInternalsFactory, org.apache.beam.runners.core.SystemReduceFn<K,​InputT,​java.lang.Iterable<InputT>,​java.lang.Iterable<InputT>,​W> reduceFn, java.util.function.Supplier<org.apache.beam.sdk.options.PipelineOptions> options)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​java.lang.Iterable<InputT>>>> call​(K key, java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​InputT>>> iterator)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • GroupAlsoByWindowViaOutputBufferFn

        public GroupAlsoByWindowViaOutputBufferFn​(org.apache.beam.sdk.values.WindowingStrategy<?,​W> windowingStrategy,
                                          org.apache.beam.runners.core.StateInternalsFactory<K> stateInternalsFactory,
                                          org.apache.beam.runners.core.SystemReduceFn<K,​InputT,​java.lang.Iterable<InputT>,​java.lang.Iterable<InputT>,​W> reduceFn,
                                          java.util.function.Supplier<org.apache.beam.sdk.options.PipelineOptions> options)

    • Method Detail

      • call

        public java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​java.lang.Iterable<InputT>>>> call​(K key,
                                                                                                                                          java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<org.apache.beam.sdk.values.KV<K,​InputT>>> iterator)
                                                                                                                                   throws java.lang.Exception
        Specified by:
        call in interface org.apache.spark.api.java.function.FlatMapGroupsFunction<K,​InputT,​W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>
        Throws:
        java.lang.Exception