org.apache.parquet.hadoop.rewrite

Class ParquetRewriter

java.lang.Object

org.apache.parquet.hadoop.rewrite.ParquetRewriter

All Implemented Interfaces:

Closeable, AutoCloseable

public class ParquetRewriter
extends Object
implements Closeable

Field Summary

Fields

Modifier and Type	Field and Description
static String	ORIGINAL_CREATED_BY_KEY

Constructor Summary

Constructors

Constructor and Description
ParquetRewriter(CompressionConverter.TransParquetFileReader reader, ParquetFileWriter writer, ParquetMetadata meta, MessageType schema, String originalCreatedBy, CompressionCodecName codecName, List<String> maskColumns, MaskMode maskMode)
ParquetRewriter(RewriteOptions options)

Method Summary

Modifier and Type	Method and Description
void	close()
void	processBlocks()
BytesInput	readBlock(int length, CompressionConverter.TransParquetFileReader reader)
BytesInput	readBlockAllocate(int length, CompressionConverter.TransParquetFileReader reader)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ORIGINAL_CREATED_BY_KEY

public static final String ORIGINAL_CREATED_BY_KEY

See Also:

Constant Field Values

Constructor Detail

ParquetRewriter

public ParquetRewriter(RewriteOptions options)
                throws IOException

Throws:

IOException

ParquetRewriter

public ParquetRewriter(CompressionConverter.TransParquetFileReader reader,
                       ParquetFileWriter writer,
                       ParquetMetadata meta,
                       MessageType schema,
                       String originalCreatedBy,
                       CompressionCodecName codecName,
                       List<String> maskColumns,
                       MaskMode maskMode)

Method Detail

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

processBlocks

public void processBlocks()
                   throws IOException

Throws:

IOException

readBlock

public BytesInput readBlock(int length,
                            CompressionConverter.TransParquetFileReader reader)
                     throws IOException

Throws:

IOException

readBlockAllocate

public BytesInput readBlockAllocate(int length,
                                    CompressionConverter.TransParquetFileReader reader)
                             throws IOException

Throws:

IOException