org.apache.beam.examples.common

Class WriteOneFilePerWindow

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<java.lang.String>,org.apache.beam.sdk.values.PDone>

org.apache.beam.examples.common.WriteOneFilePerWindow

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class WriteOneFilePerWindow
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<java.lang.String>,org.apache.beam.sdk.values.PDone>

A DoFn that writes elements to files with names deterministically derived from the lower and upper bounds of their key (an IntervalWindow).

This is test utility code, not for end-users, so examples can be focused on their primary lessons.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WriteOneFilePerWindow.PerWindowFiles A FileBasedSink.FilenamePolicy produces a base file name for a write based on metadata about the data being written.

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
WriteOneFilePerWindow(java.lang.String filenamePrefix, java.lang.Integer numShards)

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PDone	expand(org.apache.beam.sdk.values.PCollection<java.lang.String> input)

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

WriteOneFilePerWindow

public WriteOneFilePerWindow(java.lang.String filenamePrefix,
                             java.lang.Integer numShards)

Method Detail

expand

public org.apache.beam.sdk.values.PDone expand(org.apache.beam.sdk.values.PCollection<java.lang.String> input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<java.lang.String>,org.apache.beam.sdk.values.PDone>