org.apache.orc.impl

类 PhysicalFsWriter

java.lang.Object

org.apache.orc.impl.PhysicalFsWriter

所有已实现的接口:

org.apache.orc.PhysicalWriter

public class PhysicalFsWriter
extends Object
implements org.apache.orc.PhysicalWriter

An orc PhysicalFsWriter.

NOTE: The file was copied and modified to support zstd-jni. This feature is only supported in ORC 2.0, but 2.0 only supports JDK17. We need to support JDK8.

嵌套类概要

嵌套类

限定符和类型	类和说明
protected static class	PhysicalFsWriter.VariantTracker Record the information about each column encryption variant.

从接口继承的嵌套类/接口 org.apache.orc.PhysicalWriter

org.apache.orc.PhysicalWriter.OutputReceiver

构造器概要

构造器

构造器和说明
PhysicalFsWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, OrcFile.WriterOptions opts)
PhysicalFsWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, OrcFile.WriterOptions opts, org.apache.orc.impl.writer.WriterEncryptionVariant[] encryption)
PhysicalFsWriter(org.apache.hadoop.fs.FSDataOutputStream outputStream, OrcFile.WriterOptions opts, org.apache.orc.impl.writer.WriterEncryptionVariant[] encryption)

方法概要

限定符和类型	方法和说明
void	appendRawStripe(ByteBuffer buffer, org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
void	close()
org.apache.orc.impl.PhysicalFsWriter.BufferedStream	createDataStream(org.apache.orc.impl.StreamName name)
protected OutputStream	createIndexStream(org.apache.orc.impl.StreamName name)
void	finalizeStripe(org.apache.orc.OrcProto.StripeFooter.Builder footerBuilder, org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
void	flush()
long	getFileBytes(int column, org.apache.orc.impl.writer.WriterEncryptionVariant variant) Get the number of bytes for a file in a given column by finding all the streams (not suppressed) for a given column and returning the sum of their sizes. excludes index
org.apache.orc.impl.writer.StreamOptions	getStreamOptions()
String	toString()
void	writeBloomFilter(org.apache.orc.impl.StreamName name, org.apache.orc.OrcProto.BloomFilterIndex.Builder bloom)
void	writeFileFooter(org.apache.orc.OrcProto.Footer.Builder builder)
void	writeFileMetadata(org.apache.orc.OrcProto.Metadata.Builder builder)
void	writeHeader()
void	writeIndex(org.apache.orc.impl.StreamName name, org.apache.orc.OrcProto.RowIndex.Builder index)
long	writePostScript(org.apache.orc.OrcProto.PostScript.Builder builder)
void	writeStatistics(org.apache.orc.impl.StreamName name, org.apache.orc.OrcProto.ColumnStatistics.Builder statistics)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

构造器详细资料

PhysicalFsWriter

public PhysicalFsWriter(org.apache.hadoop.fs.FileSystem fs,
                        org.apache.hadoop.fs.Path path,
                        OrcFile.WriterOptions opts)
                 throws IOException

抛出:

IOException

PhysicalFsWriter

public PhysicalFsWriter(org.apache.hadoop.fs.FileSystem fs,
                        org.apache.hadoop.fs.Path path,
                        OrcFile.WriterOptions opts,
                        org.apache.orc.impl.writer.WriterEncryptionVariant[] encryption)
                 throws IOException

抛出:

IOException

PhysicalFsWriter

public PhysicalFsWriter(org.apache.hadoop.fs.FSDataOutputStream outputStream,
                        OrcFile.WriterOptions opts,
                        org.apache.orc.impl.writer.WriterEncryptionVariant[] encryption)
                 throws IOException

抛出:

IOException

方法详细资料

getFileBytes

public long getFileBytes(int column,
                         org.apache.orc.impl.writer.WriterEncryptionVariant variant)

Get the number of bytes for a file in a given column by finding all the streams (not suppressed) for a given column and returning the sum of their sizes. excludes index

指定者:

getFileBytes 在接口中 org.apache.orc.PhysicalWriter

参数:

column - column from which to get file size

返回:

number of bytes for the given column

getStreamOptions

public org.apache.orc.impl.writer.StreamOptions getStreamOptions()

指定者:

getStreamOptions 在接口中 org.apache.orc.PhysicalWriter

writeFileMetadata

public void writeFileMetadata(org.apache.orc.OrcProto.Metadata.Builder builder)
                       throws IOException

指定者:

writeFileMetadata 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writeFileFooter

public void writeFileFooter(org.apache.orc.OrcProto.Footer.Builder builder)
                     throws IOException

指定者:

writeFileFooter 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writePostScript

public long writePostScript(org.apache.orc.OrcProto.PostScript.Builder builder)
                     throws IOException

指定者:

writePostScript 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

close

public void close()
           throws IOException

指定者:

close 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

flush

public void flush()
           throws IOException

指定者:

flush 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

appendRawStripe

public void appendRawStripe(ByteBuffer buffer,
                            org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
                     throws IOException

指定者:

appendRawStripe 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

finalizeStripe

public void finalizeStripe(org.apache.orc.OrcProto.StripeFooter.Builder footerBuilder,
                           org.apache.orc.OrcProto.StripeInformation.Builder dirEntry)
                    throws IOException

指定者:

finalizeStripe 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writeHeader

public void writeHeader()
                 throws IOException

指定者:

writeHeader 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

createDataStream

public org.apache.orc.impl.PhysicalFsWriter.BufferedStream createDataStream(org.apache.orc.impl.StreamName name)

指定者:

createDataStream 在接口中 org.apache.orc.PhysicalWriter

createIndexStream

protected OutputStream createIndexStream(org.apache.orc.impl.StreamName name)

writeIndex

public void writeIndex(org.apache.orc.impl.StreamName name,
                       org.apache.orc.OrcProto.RowIndex.Builder index)
                throws IOException

指定者:

writeIndex 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writeBloomFilter

public void writeBloomFilter(org.apache.orc.impl.StreamName name,
                             org.apache.orc.OrcProto.BloomFilterIndex.Builder bloom)
                      throws IOException

指定者:

writeBloomFilter 在接口中 org.apache.orc.PhysicalWriter

抛出:

IOException

writeStatistics

public void writeStatistics(org.apache.orc.impl.StreamName name,
                            org.apache.orc.OrcProto.ColumnStatistics.Builder statistics)

指定者:

writeStatistics 在接口中 org.apache.orc.PhysicalWriter

toString

public String toString()

覆盖:

toString 在类中 Object