| Package | Description |
|---|---|
| org.apache.parquet.format.converter | |
| org.apache.parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
|
| org.apache.parquet.hadoop.metadata | |
| org.apache.parquet.hadoop.rewrite | |
| org.apache.parquet.hadoop.util |
| Modifier and Type | Method and Description |
|---|---|
ParquetMetadata |
ParquetMetadataConverter.fromParquetMetadata(FileMetaData parquetMetadata) |
ParquetMetadata |
ParquetMetadataConverter.fromParquetMetadata(FileMetaData parquetMetadata,
InternalFileDecryptor fileDecryptor,
boolean encryptedFooter) |
ParquetMetadata |
ParquetMetadataConverter.fromParquetMetadata(FileMetaData parquetMetadata,
InternalFileDecryptor fileDecryptor,
boolean encryptedFooter,
Map<RowGroup,Long> rowGroupToRowIndexOffsetMap) |
ParquetMetadata |
ParquetMetadataConverter.readParquetMetadata(InputStream from)
Deprecated.
|
ParquetMetadata |
ParquetMetadataConverter.readParquetMetadata(InputStream from,
ParquetMetadataConverter.MetadataFilter filter) |
ParquetMetadata |
ParquetMetadataConverter.readParquetMetadata(InputStream fromInputStream,
ParquetMetadataConverter.MetadataFilter filter,
InternalFileDecryptor fileDecryptor,
boolean encryptedFooter,
int combinedFooterLength) |
| Modifier and Type | Method and Description |
|---|---|
FileMetaData |
ParquetMetadataConverter.toParquetMetadata(int currentVersion,
ParquetMetadata parquetMetadata) |
FileMetaData |
ParquetMetadataConverter.toParquetMetadata(int currentVersion,
ParquetMetadata parquetMetadata,
InternalFileEncryptor fileEncryptor) |
| Modifier and Type | Method and Description |
|---|---|
ParquetMetadata |
ParquetWriter.getFooter() |
ParquetMetadata |
ParquetFileReader.getFooter() |
ParquetMetadata |
ParquetFileWriter.getFooter() |
ParquetMetadata |
Footer.getParquetMetadata() |
static ParquetMetadata |
ParquetFileWriter.mergeMetadataFiles(List<org.apache.hadoop.fs.Path> files,
org.apache.hadoop.conf.Configuration conf)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
static ParquetMetadata |
ParquetFileWriter.mergeMetadataFiles(List<org.apache.hadoop.fs.Path> files,
org.apache.hadoop.conf.Configuration conf,
KeyValueMetadataMergeStrategy keyValueMetadataMergeStrategy)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
static ParquetMetadata |
ParquetFileReader.readFooter(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus file)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static ParquetMetadata |
ParquetFileReader.readFooter(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus file,
ParquetMetadataConverter.MetadataFilter filter)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static ParquetMetadata |
ParquetFileReader.readFooter(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path file)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static ParquetMetadata |
ParquetFileReader.readFooter(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path file,
ParquetMetadataConverter.MetadataFilter filter)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static ParquetMetadata |
ParquetFileReader.readFooter(InputFile file,
ParquetMetadataConverter.MetadataFilter filter)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static ParquetMetadata |
ParquetFileReader.readFooter(InputFile file,
ParquetReadOptions options,
SeekableInputStream f) |
| Modifier and Type | Method and Description |
|---|---|
static ParquetFileReader |
ParquetFileReader.open(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path file,
ParquetMetadata footer)
Deprecated.
will be removed in 2.0.0
|
| Constructor and Description |
|---|
Footer(org.apache.hadoop.fs.Path file,
ParquetMetadata parquetMetadata) |
ParquetFileReader(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path file,
ParquetMetadata footer)
Deprecated.
will be removed in 2.0.0.
|
ParquetFileReader(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path file,
ParquetMetadata footer,
ParquetReadOptions options) |
| Modifier and Type | Method and Description |
|---|---|
static ParquetMetadata |
ParquetMetadata.fromJSON(String json) |
| Modifier and Type | Method and Description |
|---|---|
static String |
ParquetMetadata.toJSON(ParquetMetadata parquetMetaData) |
static String |
ParquetMetadata.toPrettyJSON(ParquetMetadata parquetMetaData) |
| Constructor and Description |
|---|
ParquetRewriter(CompressionConverter.TransParquetFileReader reader,
ParquetFileWriter writer,
ParquetMetadata meta,
MessageType schema,
String originalCreatedBy,
CompressionCodecName codecName,
List<String> maskColumns,
MaskMode maskMode) |
| Modifier and Type | Method and Description |
|---|---|
void |
ColumnMasker.processBlocks(CompressionConverter.TransParquetFileReader reader,
ParquetFileWriter writer,
ParquetMetadata meta,
MessageType schema,
List<String> paths,
ColumnMasker.MaskMode maskMode)
Deprecated.
|
void |
CompressionConverter.processBlocks(CompressionConverter.TransParquetFileReader reader,
ParquetFileWriter writer,
ParquetMetadata meta,
MessageType schema,
String createdBy,
CompressionCodecName codecName)
Deprecated.
|
Copyright © 2023 The Apache Software Foundation. All rights reserved.