org.apache.beam.runners.twister2.translators.functions

Class DoFnFunction<OutputT,InputT>

java.lang.Object

org.apache.beam.runners.twister2.translators.functions.DoFnFunction<OutputT,InputT>

All Implemented Interfaces:

edu.iu.dsc.tws.api.compute.modifiers.Closable, edu.iu.dsc.tws.api.tset.fn.ComputeCollectorFunc<org.apache.beam.sdk.transforms.join.RawUnionValue,java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>>>, edu.iu.dsc.tws.api.tset.fn.TFunction<org.apache.beam.sdk.transforms.join.RawUnionValue,java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>>>, java.io.Serializable

public class DoFnFunction<OutputT,InputT>
extends java.lang.Object
implements edu.iu.dsc.tws.api.tset.fn.ComputeCollectorFunc<org.apache.beam.sdk.transforms.join.RawUnionValue,java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>>>

DoFn function.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
DoFnFunction()
DoFnFunction(Twister2TranslationContext context, org.apache.beam.sdk.transforms.DoFn<InputT,OutputT> doFn, org.apache.beam.sdk.coders.Coder<InputT> inputCoder, java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.coders.Coder<?>> outputCoders, java.util.List<org.apache.beam.sdk.values.TupleTag<?>> sideOutputs, org.apache.beam.sdk.values.WindowingStrategy<?,?> windowingStrategy, java.util.Map<org.apache.beam.sdk.values.PCollectionView<?>,org.apache.beam.sdk.values.WindowingStrategy<?,?>> sideInputs, org.apache.beam.sdk.values.TupleTag<OutputT> mainOutput, org.apache.beam.sdk.transforms.DoFnSchemaInformation doFnSchemaInformation, java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,java.lang.Integer> outputMap, java.util.Map<java.lang.String,org.apache.beam.sdk.values.PCollectionView<?>> sideInputMapping)

Method Summary

Modifier and Type	Method and Description
void	close()
void	compute(java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>> input, edu.iu.dsc.tws.api.tset.fn.RecordCollector<org.apache.beam.sdk.transforms.join.RawUnionValue> output)
java.util.Set<java.lang.String>	getSideInputKeys() get the tag id's of all the keys.
void	prepare(edu.iu.dsc.tws.api.tset.TSetContext context)
protected java.lang.Object	readResolve()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.compute.modifiers.Closable

reset

Constructor Detail

DoFnFunction

public DoFnFunction()

DoFnFunction

public DoFnFunction(Twister2TranslationContext context,
                    org.apache.beam.sdk.transforms.DoFn<InputT,OutputT> doFn,
                    org.apache.beam.sdk.coders.Coder<InputT> inputCoder,
                    java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.coders.Coder<?>> outputCoders,
                    java.util.List<org.apache.beam.sdk.values.TupleTag<?>> sideOutputs,
                    org.apache.beam.sdk.values.WindowingStrategy<?,?> windowingStrategy,
                    java.util.Map<org.apache.beam.sdk.values.PCollectionView<?>,org.apache.beam.sdk.values.WindowingStrategy<?,?>> sideInputs,
                    org.apache.beam.sdk.values.TupleTag<OutputT> mainOutput,
                    org.apache.beam.sdk.transforms.DoFnSchemaInformation doFnSchemaInformation,
                    java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,java.lang.Integer> outputMap,
                    java.util.Map<java.lang.String,org.apache.beam.sdk.values.PCollectionView<?>> sideInputMapping)

Method Detail

getSideInputKeys

public java.util.Set<java.lang.String> getSideInputKeys()

get the tag id's of all the keys.

Returns:

A Set of String key values.

prepare

public void prepare(edu.iu.dsc.tws.api.tset.TSetContext context)

Specified by:

prepare in interface edu.iu.dsc.tws.api.tset.fn.TFunction<org.apache.beam.sdk.transforms.join.RawUnionValue,java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>>>

compute

public void compute(java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>> input,
                    edu.iu.dsc.tws.api.tset.fn.RecordCollector<org.apache.beam.sdk.transforms.join.RawUnionValue> output)

Specified by:

compute in interface edu.iu.dsc.tws.api.tset.fn.ComputeCollectorFunc<org.apache.beam.sdk.transforms.join.RawUnionValue,java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>>>

close

public void close()

Specified by:

close in interface edu.iu.dsc.tws.api.compute.modifiers.Closable

Specified by:

close in interface edu.iu.dsc.tws.api.tset.fn.TFunction<org.apache.beam.sdk.transforms.join.RawUnionValue,java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<InputT>>>

readResolve

protected java.lang.Object readResolve()
                                throws java.io.ObjectStreamException

Throws:

java.io.ObjectStreamException