org.apache.beam.examples.complete.datatokenization.transforms

Class DataProtectors.TokenizationFn

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<org.apache.beam.sdk.values.KV<java.lang.Integer,java.lang.Iterable<org.apache.beam.sdk.values.Row>>,org.apache.beam.sdk.values.Row>

org.apache.beam.examples.complete.datatokenization.transforms.DataProtectors.TokenizationFn

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

DataProtectors

public static class DataProtectors.TokenizationFn
extends org.apache.beam.sdk.transforms.DoFn<org.apache.beam.sdk.values.KV<java.lang.Integer,java.lang.Iterable<org.apache.beam.sdk.values.Row>>,org.apache.beam.sdk.values.Row>

Class implements stateful doFn for data tokenization using remote RPC.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

org.apache.beam.sdk.transforms.DoFn.AlwaysFetched, org.apache.beam.sdk.transforms.DoFn.BoundedPerElement, org.apache.beam.sdk.transforms.DoFn.BundleFinalizer, org.apache.beam.sdk.transforms.DoFn.Element, org.apache.beam.sdk.transforms.DoFn.FieldAccess, org.apache.beam.sdk.transforms.DoFn.FinishBundle, org.apache.beam.sdk.transforms.DoFn.FinishBundleContext, org.apache.beam.sdk.transforms.DoFn.GetInitialRestriction, org.apache.beam.sdk.transforms.DoFn.GetInitialWatermarkEstimatorState, org.apache.beam.sdk.transforms.DoFn.GetRestrictionCoder, org.apache.beam.sdk.transforms.DoFn.GetSize, org.apache.beam.sdk.transforms.DoFn.GetWatermarkEstimatorStateCoder, org.apache.beam.sdk.transforms.DoFn.Key, org.apache.beam.sdk.transforms.DoFn.MultiOutputReceiver, org.apache.beam.sdk.transforms.DoFn.NewTracker, org.apache.beam.sdk.transforms.DoFn.NewWatermarkEstimator, org.apache.beam.sdk.transforms.DoFn.OnTimer, org.apache.beam.sdk.transforms.DoFn.OnTimerContext, org.apache.beam.sdk.transforms.DoFn.OnTimerFamily, org.apache.beam.sdk.transforms.DoFn.OnWindowExpiration, org.apache.beam.sdk.transforms.DoFn.OnWindowExpirationContext, org.apache.beam.sdk.transforms.DoFn.OutputReceiver<T>, org.apache.beam.sdk.transforms.DoFn.ProcessContext, org.apache.beam.sdk.transforms.DoFn.ProcessContinuation, org.apache.beam.sdk.transforms.DoFn.ProcessElement, org.apache.beam.sdk.transforms.DoFn.RequiresStableInput, org.apache.beam.sdk.transforms.DoFn.RequiresTimeSortedInput, org.apache.beam.sdk.transforms.DoFn.Restriction, org.apache.beam.sdk.transforms.DoFn.Setup, org.apache.beam.sdk.transforms.DoFn.SideInput, org.apache.beam.sdk.transforms.DoFn.SplitRestriction, org.apache.beam.sdk.transforms.DoFn.StartBundle, org.apache.beam.sdk.transforms.DoFn.StartBundleContext, org.apache.beam.sdk.transforms.DoFn.StateId, org.apache.beam.sdk.transforms.DoFn.Teardown, org.apache.beam.sdk.transforms.DoFn.TimerFamily, org.apache.beam.sdk.transforms.DoFn.TimerId, org.apache.beam.sdk.transforms.DoFn.Timestamp, org.apache.beam.sdk.transforms.DoFn.TruncateRestriction, org.apache.beam.sdk.transforms.DoFn.UnboundedPerElement, org.apache.beam.sdk.transforms.DoFn.WatermarkEstimatorState, org.apache.beam.sdk.transforms.DoFn.WindowedContext

Constructor Summary

Constructors

Constructor and Description
TokenizationFn(org.apache.beam.sdk.schemas.Schema schema, java.lang.String rpcURI, org.apache.beam.sdk.values.TupleTag<FailsafeElement<org.apache.beam.sdk.values.Row,org.apache.beam.sdk.values.Row>> failureTag)

Method Summary

Modifier and Type	Method and Description
void	close()
void	process(org.apache.beam.sdk.values.KV<java.lang.Integer,java.lang.Iterable<org.apache.beam.sdk.values.Row>> element, org.apache.beam.sdk.transforms.DoFn.ProcessContext context)
void	setup()

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenizationFn

public TokenizationFn(org.apache.beam.sdk.schemas.Schema schema,
                      java.lang.String rpcURI,
                      org.apache.beam.sdk.values.TupleTag<FailsafeElement<org.apache.beam.sdk.values.Row,org.apache.beam.sdk.values.Row>> failureTag)

Method Detail

setup

@DoFn.Setup
public void setup()

close

@DoFn.Teardown
public void close()

process

@DoFn.ProcessElement
public void process(@DoFn.Element
                                         org.apache.beam.sdk.values.KV<java.lang.Integer,java.lang.Iterable<org.apache.beam.sdk.values.Row>> element,
                                         org.apache.beam.sdk.transforms.DoFn.ProcessContext context)