org.apache.spark.sql.execution.datasources.parquet

类 Spark24HoodieVectorizedParquetRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<Void,T>

org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase<Object>

org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

org.apache.spark.sql.execution.datasources.parquet.Spark24HoodieVectorizedParquetRecordReader

所有已实现的接口:

Closeable, AutoCloseable

public class Spark24HoodieVectorizedParquetRecordReader
extends org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

嵌套类概要

从类继承的嵌套类/接口 org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase

org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase.NullIntIterator, org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase.RLEIntIterator, org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase.ValuesReaderIntIterator

字段概要

从类继承的字段 org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase

file, fileSchema, reader, requestedSchema, sparkSchema, totalRowCount

构造器概要

构造器

构造器和说明
Spark24HoodieVectorizedParquetRecordReader(TimeZone convertTz, boolean useOffHeap, int capacity, Map<Integer,Pair<org.apache.spark.sql.types.DataType,org.apache.spark.sql.types.DataType>> typeChangeInfos)

方法概要

限定符和类型	方法和说明
void	close()
void	enableReturningBatches()
Object	getCurrentValue()
void	initBatch(org.apache.spark.sql.types.StructType partitionColumns, org.apache.spark.sql.catalyst.InternalRow partitionValues)
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
boolean	nextBatch()
boolean	nextKeyValue()
org.apache.spark.sql.vectorized.ColumnarBatch	resultBatch()

从类继承的方法 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

getProgress, initialize

从类继承的方法 org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase

createRLEIterator, getCurrentKey, listDirectory

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

Spark24HoodieVectorizedParquetRecordReader

public Spark24HoodieVectorizedParquetRecordReader(TimeZone convertTz,
                                                  boolean useOffHeap,
                                                  int capacity,
                                                  Map<Integer,Pair<org.apache.spark.sql.types.DataType,org.apache.spark.sql.types.DataType>> typeChangeInfos)

方法详细资料

initBatch

public void initBatch(org.apache.spark.sql.types.StructType partitionColumns,
                      org.apache.spark.sql.catalyst.InternalRow partitionValues)

覆盖:

initBatch 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
                throws IOException,
                       InterruptedException,
                       UnsupportedOperationException

覆盖:

initialize 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

抛出:

IOException

InterruptedException

UnsupportedOperationException

close

public void close()
           throws IOException

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

覆盖:

close 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

抛出:

IOException

resultBatch

public org.apache.spark.sql.vectorized.ColumnarBatch resultBatch()

覆盖:

resultBatch 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

nextBatch

public boolean nextBatch()
                  throws IOException

覆盖:

nextBatch 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

抛出:

IOException

enableReturningBatches

public void enableReturningBatches()

覆盖:

enableReturningBatches 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

getCurrentValue

public Object getCurrentValue()

覆盖:

getCurrentValue 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

nextKeyValue

public boolean nextKeyValue()
                     throws IOException

覆盖:

nextKeyValue 在类中 org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader

抛出:

IOException