org.apache.iceberg.spark.data

Class SparkOrcWriter

java.lang.Object

org.apache.iceberg.spark.data.SparkOrcWriter

All Implemented Interfaces:

org.apache.iceberg.orc.OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

public class SparkOrcWriter
extends java.lang.Object
implements org.apache.iceberg.orc.OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

This class acts as an adaptor from an OrcFileAppender to a FileAppender<InternalRow>.

Constructor Summary

Constructors

Constructor and Description
SparkOrcWriter(org.apache.iceberg.Schema iSchema, org.apache.orc.TypeDescription orcSchema)

Method Summary

Modifier and Type	Method and Description
java.util.stream.Stream<org.apache.iceberg.FieldMetrics<?>>	metrics()
void	write(org.apache.spark.sql.catalyst.InternalRow value, org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output)
java.util.List<org.apache.iceberg.orc.OrcValueWriter<?>>	writers()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkOrcWriter

public SparkOrcWriter(org.apache.iceberg.Schema iSchema,
                      org.apache.orc.TypeDescription orcSchema)

Method Detail

write

public void write(org.apache.spark.sql.catalyst.InternalRow value,
                  org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output)

Specified by:

write in interface org.apache.iceberg.orc.OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

writers

public java.util.List<org.apache.iceberg.orc.OrcValueWriter<?>> writers()

Specified by:

writers in interface org.apache.iceberg.orc.OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

metrics

public java.util.stream.Stream<org.apache.iceberg.FieldMetrics<?>> metrics()

Specified by:

metrics in interface org.apache.iceberg.orc.OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>