org.apache.parquet.hadoop.rewrite

Class RewriteOptions

java.lang.Object

org.apache.parquet.hadoop.rewrite.RewriteOptions

public class RewriteOptions
extends Object

A set of options to create a ParquetRewriter. See RewriteOptions.Builder for options description.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RewriteOptions.Builder Builder for RewriteOptions which is used for constructing ParquetRewriter.

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf() Gets the Configuration part of the rewrite options.
List<String>	getEncryptColumns()
FileEncryptionProperties	getFileEncryptionProperties()
boolean	getIgnoreJoinFilesMetadata()
IndexCache.CacheStrategy	getIndexCacheStrategy()
List<org.apache.hadoop.fs.Path>	getInputFiles() Gets the input Paths for the rewrite if they exist for all input files, otherwise throws a RuntimeException.
List<org.apache.hadoop.fs.Path>	getInputFilesToJoin() Gets the input Paths for the rewrite if they exist for all input files to join, otherwise throws a RuntimeException.
Map<String,MaskMode>	getMaskColumns()
CompressionCodecName	getNewCodecName()
org.apache.hadoop.fs.Path	getOutputFile() Get the Path for the rewrite if it exists, otherwise throws a RuntimeException.
boolean	getOverwriteInputWithJoinColumns()
ParquetConfiguration	getParquetConfiguration() Gets the ParquetConfiguration part of the rewrite options.
List<InputFile>	getParquetInputFiles() Gets the InputFiles for the rewrite.
List<InputFile>	getParquetInputFilesToJoin() Gets the right InputFiles to join during the rewrite.
OutputFile	getParquetOutputFile() Get the OutputFile for the rewrite.
List<String>	getPruneColumns()
Map<String,String>	getRenameColumns()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getConf

public org.apache.hadoop.conf.Configuration getConf()

Gets the Configuration part of the rewrite options.

Returns:

the associated Configuration

getParquetConfiguration

public ParquetConfiguration getParquetConfiguration()

Gets the ParquetConfiguration part of the rewrite options.

Returns:

the associated ParquetConfiguration

getInputFiles

public List<org.apache.hadoop.fs.Path> getInputFiles()

Gets the input Paths for the rewrite if they exist for all input files, otherwise throws a RuntimeException.

Returns:

a List of the associated input Paths

getInputFilesToJoin

public List<org.apache.hadoop.fs.Path> getInputFilesToJoin()

Gets the input Paths for the rewrite if they exist for all input files to join, otherwise throws a RuntimeException.

Returns:

a List of the associated input Paths to join

getParquetInputFiles

public List<InputFile> getParquetInputFiles()

Gets the InputFiles for the rewrite.

Returns:

a List of the associated InputFiles

getParquetInputFilesToJoin

public List<InputFile> getParquetInputFilesToJoin()

Gets the right InputFiles to join during the rewrite.

Returns:

a List of the associated InputFiles to join

getOutputFile

public org.apache.hadoop.fs.Path getOutputFile()

Get the Path for the rewrite if it exists, otherwise throws a RuntimeException.

Returns:

the associated Path if it exists

getParquetOutputFile

public OutputFile getParquetOutputFile()

Get the OutputFile for the rewrite.

Returns:

the associated OutputFile

getPruneColumns

public List<String> getPruneColumns()

getNewCodecName

public CompressionCodecName getNewCodecName()

getMaskColumns

public Map<String,MaskMode> getMaskColumns()

getRenameColumns

public Map<String,String> getRenameColumns()

getEncryptColumns

public List<String> getEncryptColumns()

getFileEncryptionProperties

public FileEncryptionProperties getFileEncryptionProperties()

getIndexCacheStrategy

public IndexCache.CacheStrategy getIndexCacheStrategy()

getOverwriteInputWithJoinColumns

public boolean getOverwriteInputWithJoinColumns()

getIgnoreJoinFilesMetadata

public boolean getIgnoreJoinFilesMetadata()