Package org.apache.parquet.hadoop

Class BdecParquetWriter

java.lang.Object

org.apache.parquet.hadoop.BdecParquetWriter

All Implemented Interfaces:

AutoCloseable

public class BdecParquetWriter
extends Object
implements AutoCloseable

BDEC specific parquet writer.

Resides in parquet package because, it uses InternalParquetRecordWriter and CodecFactory that are package private.

Constructor Summary

Constructors

Constructor	Description
BdecParquetWriter(ByteArrayOutputStream stream, org.apache.parquet.schema.MessageType schema, Map<String,String> extraMetaData, String channelName, long maxChunkSizeInBytes, Optional<Integer> maxRowGroups, Constants.BdecParquetCompression bdecParquetCompression)	Creates a BDEC specific parquet writer.

Method Summary

Modifier and Type	Method	Description
void	close()
List<Long>	getRowCountsFromFooter()
long	getRowsWritten()
void	writeRow(List<Object> row)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BdecParquetWriter

public BdecParquetWriter(ByteArrayOutputStream stream,
                         org.apache.parquet.schema.MessageType schema,
                         Map<String,String> extraMetaData,
                         String channelName,
                         long maxChunkSizeInBytes,
                         Optional<Integer> maxRowGroups,
                         Constants.BdecParquetCompression bdecParquetCompression)
                  throws IOException

Creates a BDEC specific parquet writer.

Parameters:

stream - output

schema - row schema

extraMetaData - extra metadata

channelName - name of the channel that is using the writer

maxRowGroups - Optional cap on the max number of row groups to allow per file, if this is exceeded we'll end up throwing

Throws:

IOException

Method Detail

getRowCountsFromFooter

public List<Long> getRowCountsFromFooter()

Returns:

List of row counts per block stored in the parquet footer

writeRow

public void writeRow(List<Object> row)

getRowsWritten

public long getRowsWritten()

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Throws:

IOException