org.apache.beam.examples.common

Class WriteOneFilePerWindow.PerWindowFiles

java.lang.Object

org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy

org.apache.beam.examples.common.WriteOneFilePerWindow.PerWindowFiles

All Implemented Interfaces:

java.io.Serializable

Enclosing class:

WriteOneFilePerWindow

public static class WriteOneFilePerWindow.PerWindowFiles
extends org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy

A FileBasedSink.FilenamePolicy produces a base file name for a write based on metadata about the data being written. This always includes the shard number and the total number of shards. For windowed writes, it also includes the window and pane index (a sequence number assigned to each trigger firing).

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PerWindowFiles(org.apache.beam.sdk.io.fs.ResourceId baseFilename)

Method Summary

Modifier and Type	Method and Description
java.lang.String	filenamePrefixForWindow(org.apache.beam.sdk.transforms.windowing.IntervalWindow window)
org.apache.beam.sdk.io.fs.ResourceId	unwindowedFilename(int shardNumber, int numShards, org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)
org.apache.beam.sdk.io.fs.ResourceId	windowedFilename(int shardNumber, int numShards, org.apache.beam.sdk.transforms.windowing.BoundedWindow window, org.apache.beam.sdk.transforms.windowing.PaneInfo paneInfo, org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)

Methods inherited from class org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy

populateDisplayData

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PerWindowFiles

public PerWindowFiles(org.apache.beam.sdk.io.fs.ResourceId baseFilename)

Method Detail

filenamePrefixForWindow

public java.lang.String filenamePrefixForWindow(org.apache.beam.sdk.transforms.windowing.IntervalWindow window)

windowedFilename

public org.apache.beam.sdk.io.fs.ResourceId windowedFilename(int shardNumber,
                                                             int numShards,
                                                             org.apache.beam.sdk.transforms.windowing.BoundedWindow window,
                                                             org.apache.beam.sdk.transforms.windowing.PaneInfo paneInfo,
                                                             org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)

Specified by:

windowedFilename in class org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy

unwindowedFilename

public org.apache.beam.sdk.io.fs.ResourceId unwindowedFilename(int shardNumber,
                                                               int numShards,
                                                               org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)

Specified by:

unwindowedFilename in class org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy