org.apache.beam.examples.subprocess.kernel

Class SubProcessIOFiles

java.lang.Object

org.apache.beam.examples.subprocess.kernel.SubProcessIOFiles

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class SubProcessIOFiles
extends java.lang.Object
implements java.io.Closeable

All information generated from the process will be stored in output files. The local working directory is used to generate three files with extension .err for standard error output .out for standard out output .ret for storing the results from the called library. The files will have a uuid created for them based on java.util.UUID

Constructor Summary

Constructors

Constructor and Description
SubProcessIOFiles(java.lang.String workerWorkingDirectory)

Method Summary

Modifier and Type	Method and Description
void	close() Clean up the files that have been created on the local worker file system.
void	copyOutPutFilesToBucket(SubProcessConfiguration configuration, java.lang.String params) Will copy the output files to the GCS path setup via the configuration.
java.nio.file.Path	getErrFile()
java.lang.String	getErrFileLocation()
java.nio.file.Path	getOutFile()
java.lang.String	getOutFileLocation()
java.nio.file.Path	getResultFile()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SubProcessIOFiles

public SubProcessIOFiles(java.lang.String workerWorkingDirectory)

Parameters:

workerWorkingDirectory -

Method Detail

getErrFileLocation

public java.lang.String getErrFileLocation()

getOutFileLocation

public java.lang.String getOutFileLocation()

getErrFile

public java.nio.file.Path getErrFile()

getOutFile

public java.nio.file.Path getOutFile()

getResultFile

public java.nio.file.Path getResultFile()

close

public void close()
           throws java.io.IOException

Clean up the files that have been created on the local worker file system. Without this expect both performance issues and eventual failure

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Throws:

java.io.IOException

copyOutPutFilesToBucket

public void copyOutPutFilesToBucket(SubProcessConfiguration configuration,
                                    java.lang.String params)

Will copy the output files to the GCS path setup via the configuration.

Parameters:

configuration -

params -