org.apache.parquet.arrow.schema

Class SchemaConverter

java.lang.Object

org.apache.parquet.arrow.schema.SchemaConverter

public class SchemaConverter
extends Object

Logic to convert Parquet and Arrow Schemas back and forth and maintain the mapping

Constructor Summary

Constructors

Constructor and Description
SchemaConverter() For when we'll need this to be configurable
SchemaConverter(boolean convertInt96ToArrowTimestamp)

Method Summary

Modifier and Type	Method and Description
SchemaMapping	fromArrow(org.apache.arrow.vector.types.pojo.Schema arrowSchema) Creates a Parquet Schema from an Arrow one and returns the mapping
SchemaMapping	fromParquet(MessageType parquetSchema) Creates an Arrow Schema from an Parquet one and returns the mapping
SchemaMapping	map(org.apache.arrow.vector.types.pojo.Schema arrowSchema, MessageType parquetSchema) Maps a Parquet and Arrow Schema For now does not validate primitive type compatibility

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SchemaConverter

public SchemaConverter()

For when we'll need this to be configurable

SchemaConverter

public SchemaConverter(boolean convertInt96ToArrowTimestamp)

Method Detail

fromArrow

public SchemaMapping fromArrow(org.apache.arrow.vector.types.pojo.Schema arrowSchema)

Creates a Parquet Schema from an Arrow one and returns the mapping

Parameters:

arrowSchema - the provided Arrow Schema

Returns:

the mapping between the 2

fromParquet

public SchemaMapping fromParquet(MessageType parquetSchema)

Creates an Arrow Schema from an Parquet one and returns the mapping

Parameters:

parquetSchema - the provided Parquet Schema

Returns:

the mapping between the 2

map

public SchemaMapping map(org.apache.arrow.vector.types.pojo.Schema arrowSchema,
                         MessageType parquetSchema)

Maps a Parquet and Arrow Schema For now does not validate primitive type compatibility

Parameters:

arrowSchema - an Arrow schema

parquetSchema - a Parquet message type

Returns:

the mapping between the 2