org.apache.paimon.format.orc.writer

类 PhysicalWriterImpl

java.lang.Object

org.apache.paimon.format.orc.writer.PhysicalWriterImpl

所有已实现的接口:

org.apache.orc.PhysicalWriter

public class PhysicalWriterImpl
extends Object
implements org.apache.orc.PhysicalWriter

A slightly customised clone of PhysicalFsWriter.

Whereas PhysicalFsWriter implementation works on the basis of a Path, this implementation leverages Paimon's PositionOutputStream to write the compressed data.

NOTE: If the ORC dependency version is updated, this file may have to be updated as well to be in sync with the new version's PhysicalFsWriter.

嵌套类概要

从接口继承的嵌套类/接口 org.apache.orc.PhysicalWriter

org.apache.orc.PhysicalWriter.OutputReceiver

字段概要

字段

限定符和类型	字段和说明
protected org.apache.orc.impl.OutStream	writer

构造器概要

构造器

构造器和说明
PhysicalWriterImpl(org.apache.paimon.fs.PositionOutputStream out, org.apache.orc.OrcFile.WriterOptions opts)

方法概要

限定符和类型	方法和说明
void	appendRawStripe(ByteBuffer buffer, org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
void	close()
org.apache.orc.PhysicalWriter.OutputReceiver	createDataStream(org.apache.orc.impl.StreamName name)
void	finalizeStripe(org.apache.orc.OrcProto.StripeFooter.Builder footerBuilder, org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
void	flush()
org.apache.orc.CompressionCodec	getCompressionCodec()
long	getFileBytes(int column)
void	writeBloomFilter(org.apache.orc.impl.StreamName name, org.apache.orc.OrcProto.BloomFilterIndex.Builder bloom, org.apache.orc.CompressionCodec codec)
void	writeFileFooter(org.apache.orc.OrcProto.Footer.Builder builder)
protected void	writeFileFooter(org.apache.orc.OrcProto.Footer footer)
void	writeFileMetadata(org.apache.orc.OrcProto.Metadata.Builder builder)
void	writeHeader()
void	writeIndex(org.apache.orc.impl.StreamName name, org.apache.orc.OrcProto.RowIndex.Builder index, org.apache.orc.CompressionCodec codec)
protected void	writeMetadata(org.apache.orc.OrcProto.Metadata metadata)
long	writePostScript(org.apache.orc.OrcProto.PostScript.Builder builder)
protected void	writeStripeFooter(org.apache.orc.OrcProto.StripeFooter footer)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

writer

protected final org.apache.orc.impl.OutStream writer

构造器详细资料

PhysicalWriterImpl

public PhysicalWriterImpl(org.apache.paimon.fs.PositionOutputStream out,
                          org.apache.orc.OrcFile.WriterOptions opts)
                   throws IOException

抛出:

IOException

方法详细资料

writeHeader

public void writeHeader()
                 throws IOException

指定者:

writeHeader 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

createDataStream

public org.apache.orc.PhysicalWriter.OutputReceiver createDataStream(org.apache.orc.impl.StreamName name)

指定者:

createDataStream 在接口中 org.apache.orc.PhysicalWriter

writeIndex

public void writeIndex(org.apache.orc.impl.StreamName name,
                       org.apache.orc.OrcProto.RowIndex.Builder index,
                       org.apache.orc.CompressionCodec codec)
                throws IOException

指定者:

writeIndex 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writeBloomFilter

public void writeBloomFilter(org.apache.orc.impl.StreamName name,
                             org.apache.orc.OrcProto.BloomFilterIndex.Builder bloom,
                             org.apache.orc.CompressionCodec codec)
                      throws IOException

指定者:

writeBloomFilter 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

finalizeStripe

public void finalizeStripe(org.apache.orc.OrcProto.StripeFooter.Builder footerBuilder,
                           org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
                    throws IOException

指定者:

finalizeStripe 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writeFileMetadata

public void writeFileMetadata(org.apache.orc.OrcProto.Metadata.Builder builder)
                       throws IOException

指定者:

writeFileMetadata 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writeFileFooter

public void writeFileFooter(org.apache.orc.OrcProto.Footer.Builder builder)
                     throws IOException

指定者:

writeFileFooter 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writePostScript

public long writePostScript(org.apache.orc.OrcProto.PostScript.Builder builder)
                     throws IOException

指定者:

writePostScript 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

close

public void close()

指定者:

close 在接口中 org.apache.orc.PhysicalWriter

flush

public void flush()
           throws IOException

指定者:

flush 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

appendRawStripe

public void appendRawStripe(ByteBuffer buffer,
                            org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
                     throws IOException

指定者:

appendRawStripe 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

getCompressionCodec

public org.apache.orc.CompressionCodec getCompressionCodec()

指定者:

getCompressionCodec 在接口中 org.apache.orc.PhysicalWriter

getFileBytes

public long getFileBytes(int column)

指定者:

getFileBytes 在接口中 org.apache.orc.PhysicalWriter

writeMetadata

protected void writeMetadata(org.apache.orc.OrcProto.Metadata metadata)
                      throws IOException

抛出:

IOException

writeFileFooter

protected void writeFileFooter(org.apache.orc.OrcProto.Footer footer)
                        throws IOException

抛出:

IOException

writeStripeFooter

protected void writeStripeFooter(org.apache.orc.OrcProto.StripeFooter footer)
                          throws IOException

抛出:

IOException