Skip navigation links
A B C D E F G H I J L M N O P R S T U V W _ 

A

add(long) - Method in class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
 
add(StructField) - Method in class io.delta.kernel.types.StructType
 
add(String, DataType) - Method in class io.delta.kernel.types.StructType
 
add(String, DataType, boolean) - Method in class io.delta.kernel.types.StructType
 
add(String, DataType, FieldMetadata) - Method in class io.delta.kernel.types.StructType
 
add(String, DataType, boolean, FieldMetadata) - Method in class io.delta.kernel.types.StructType
 
ADD_FILE_DV_ORDINAL - Static variable in class io.delta.kernel.internal.replay.LogReplay
 
ADD_FILE_ORDINAL - Static variable in class io.delta.kernel.internal.InternalScanFileUtils
 
ADD_FILE_ORDINAL - Static variable in class io.delta.kernel.internal.replay.LogReplay
 
ADD_FILE_PARTITION_COL_REF - Static variable in class io.delta.kernel.internal.InternalScanFileUtils
Column expression referring to the `partitionValues` in scan `add` file.
ADD_FILE_PATH_ORDINAL - Static variable in class io.delta.kernel.internal.replay.LogReplay
 
ADD_FILE_STATS_ORDINAL - Static variable in class io.delta.kernel.internal.InternalScanFileUtils
 
AddFile - Class in io.delta.kernel.internal.actions
Delta log action representing an `AddFile`
AddFile() - Constructor for class io.delta.kernel.internal.actions.AddFile
 
allLogFilesReversed() - Method in class io.delta.kernel.internal.snapshot.LogSegment
 
allLogFilesUnsorted() - Method in class io.delta.kernel.internal.snapshot.LogSegment
 
ALWAYS_FALSE - Static variable in class io.delta.kernel.expressions.AlwaysFalse
 
ALWAYS_TRUE - Static variable in class io.delta.kernel.expressions.AlwaysTrue
 
AlwaysFalse - Class in io.delta.kernel.expressions
Predicate which always evaluates to false.
AlwaysTrue - Class in io.delta.kernel.expressions
Predicate which always evaluates to true.
And - Class in io.delta.kernel.expressions
AND expression
And(Predicate, Predicate) - Constructor for class io.delta.kernel.expressions.And
 
ArrayType - Class in io.delta.kernel.types
Represent array data type
ArrayType(DataType, boolean) - Constructor for class io.delta.kernel.types.ArrayType
 
ArrayValue - Interface in io.delta.kernel.data
Abstraction to represent a single array value in a ColumnVector.
asPredicate(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
Return an expression cast as a predicate, throw an error if it is not a predicate
at(int) - Method in class io.delta.kernel.types.StructType
 

B

Base85Codec - Class in io.delta.kernel.internal.deletionvectors
This implements Base85 using the 4 byte block aligned encoding and character set from Z85.
Base85Codec() - Constructor for class io.delta.kernel.internal.deletionvectors.Base85Codec
 
BasePrimitiveType - Class in io.delta.kernel.types
Base class for all primitive types DataType.
BINARY - Static variable in class io.delta.kernel.types.BinaryType
 
BinaryType - Class in io.delta.kernel.types
The data type representing byte[] values.
BOOLEAN - Static variable in class io.delta.kernel.types.BooleanType
 
BooleanType - Class in io.delta.kernel.types
Data type representing boolean type values.
build() - Method in class io.delta.kernel.internal.ScanBuilderImpl
 
build() - Method in interface io.delta.kernel.ScanBuilder
 
build() - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
builder() - Static method in class io.delta.kernel.types.FieldMetadata
 
Builder() - Constructor for class io.delta.kernel.types.FieldMetadata.Builder
 
buildLatestSnapshot(TableClient, Path, Path) - Method in class io.delta.kernel.internal.snapshot.SnapshotManager
Construct the latest snapshot for given table.
BYTE - Static variable in class io.delta.kernel.types.ByteType
 
ByteType - Class in io.delta.kernel.types
The data type representing byte type values.

C

checkArgument(boolean) - Static method in class io.delta.kernel.internal.util.Preconditions
Precondition-style validation that throws IllegalArgumentException.
checkArgument(boolean, String) - Static method in class io.delta.kernel.internal.util.Preconditions
Precondition-style validation that throws IllegalArgumentException.
checkArgument(boolean, String, Object...) - Static method in class io.delta.kernel.internal.util.Preconditions
Precondition-style validation that throws IllegalArgumentException.
Checkpointer - Class in io.delta.kernel.internal.checkpoints
Class to load the CheckpointMetaData from `_last_checkpoint` file.
Checkpointer(Path) - Constructor for class io.delta.kernel.internal.checkpoints.Checkpointer
 
checkpointFileSingular(Path, long) - Static method in class io.delta.kernel.internal.util.FileNames
Returns the path for a singular checkpoint up to the given version.
checkpointFileWithParts(Path, long, int) - Static method in class io.delta.kernel.internal.util.FileNames
Returns the paths for all parts of the checkpoint up to the given version.
CheckpointInstance - Class in io.delta.kernel.internal.checkpoints
Metadata about Delta checkpoint.
CheckpointInstance(String) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
CheckpointInstance(long) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
CheckpointInstance(long, Optional<Integer>) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
CheckpointMetaData - Class in io.delta.kernel.internal.checkpoints
 
CheckpointMetaData(long, long, Optional<Long>) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointMetaData
 
checkpoints - Variable in class io.delta.kernel.internal.snapshot.LogSegment
 
checkpointVersion(Path) - Static method in class io.delta.kernel.internal.util.FileNames
Returns the version for the given checkpoint path.
checkpointVersion(String) - Static method in class io.delta.kernel.internal.util.FileNames
 
checkpointVersionOpt - Variable in class io.delta.kernel.internal.snapshot.LogSegment
 
ChildVectorBasedRow - Class in io.delta.kernel.internal.data
A Row implementation that wraps a set of child vectors for a specific rowId.
ChildVectorBasedRow(int, StructType) - Constructor for class io.delta.kernel.internal.data.ChildVectorBasedRow
 
close() - Method in interface io.delta.kernel.data.ColumnVector
Cleans up memory for this column vector.
close() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
 
CloseableIterable<T> - Interface in io.delta.kernel.internal.lang
 
CloseableIterator<T> - Interface in io.delta.kernel.utils
Closeable extension of Iterator
closeCloseables(AutoCloseable...) - Static method in class io.delta.kernel.internal.util.Utils
Close the given one or more AutoCloseables.
closeCloseablesSilently(AutoCloseable...) - Static method in class io.delta.kernel.internal.util.Utils
Close the given list of AutoCloseable objects.
Column - Class in io.delta.kernel.expressions
An expression type that refers to a column (case-sensitive) in the input.
Column(String) - Constructor for class io.delta.kernel.expressions.Column
Create a column expression for referring to a column.
Column(String[]) - Constructor for class io.delta.kernel.expressions.Column
Create a column expression to refer to a nested column.
column(int) - Method in class io.delta.kernel.types.StructType
Creates a Column expression for the field at the given ordinal
COLUMN_MAPPING_ID_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
 
COLUMN_MAPPING_MODE_ID - Static variable in class io.delta.kernel.internal.util.ColumnMapping
 
COLUMN_MAPPING_MODE_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
 
COLUMN_MAPPING_MODE_NAME - Static variable in class io.delta.kernel.internal.util.ColumnMapping
 
COLUMN_MAPPING_MODE_NONE - Static variable in class io.delta.kernel.internal.util.ColumnMapping
 
COLUMN_MAPPING_PHYSICAL_NAME_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
 
ColumnarBatch - Interface in io.delta.kernel.data
Represents zero or more rows of records with same schema type.
ColumnarBatchRow - Class in io.delta.kernel.internal.data
Row abstraction around a columnar batch and a particular row within the columnar batch.
ColumnarBatchRow(ColumnarBatch, int) - Constructor for class io.delta.kernel.internal.data.ColumnarBatchRow
 
ColumnMapping - Class in io.delta.kernel.internal.util
Utilities related to the column mapping feature.
ColumnVector - Interface in io.delta.kernel.data
Represents zero or more values of a single column.
compareTo(CheckpointInstance) - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
Comparison rules: 1.
compareTo(Path) - Method in class io.delta.kernel.internal.fs.Path
 
constructDataSkippingFilter(Predicate, StructType) - Static method in class io.delta.kernel.internal.skipping.DataSkippingUtils
Constructs a data skipping filter to prune files using column statistics given a query data filter if possible.
contains(long) - Method in class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
Checks whether the value is included, which is equivalent to checking if the corresponding bit is set.
contains(String) - Method in class io.delta.kernel.types.FieldMetadata
 
containsNull() - Method in class io.delta.kernel.types.ArrayType
 
convertToPhysicalSchema(StructType, StructType, String) - Static method in class io.delta.kernel.internal.util.ColumnMapping
Helper method that converts the logical schema (requested by the connector) to physical schema of the data stored in data files based on the table's column mapping mode.
create(long...) - Static method in class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
 
createPrimitive(String) - Static method in class io.delta.kernel.types.BasePrimitiveType
Create a primitive type DataType
createSelectionVector(boolean[], int, int) - Method in interface io.delta.kernel.client.ExpressionHandler
Create a selection vector, a boolean type ColumnVector, on top of the range of values given in values array.
CUR_DIR - Static variable in class io.delta.kernel.internal.fs.Path
The current directory, ".".

D

DataSkippingPredicate - Class in io.delta.kernel.internal.skipping
A Predicate with a set of columns referenced by the expression.
DataSkippingUtils - Class in io.delta.kernel.internal.skipping
 
DataSkippingUtils() - Constructor for class io.delta.kernel.internal.skipping.DataSkippingUtils
 
DataType - Class in io.delta.kernel.types
Base class for all data types.
DataType() - Constructor for class io.delta.kernel.types.DataType
 
DATE - Static variable in class io.delta.kernel.types.DateType
 
DateType - Class in io.delta.kernel.types
A date type, supporting "0001-01-01" through "9999-12-31".
daysSinceEpoch(Date) - Static method in class io.delta.kernel.internal.util.InternalUtils
Utility method to get the number of days since epoch this given date is.
DecimalType - Class in io.delta.kernel.types
The data type representing java.math.BigDecimal values.
DecimalType(int, int) - Constructor for class io.delta.kernel.types.DecimalType
 
DECODE_MAP - Static variable in class io.delta.kernel.internal.deletionvectors.Base85Codec
 
decodeAlignedBytes(String) - Static method in class io.delta.kernel.internal.deletionvectors.Base85Codec
Decode an arbitrary byte array.
decodeBytes(String, int) - Static method in class io.delta.kernel.internal.deletionvectors.Base85Codec
Decode an arbitrary byte array.
decodeUUID(String) - Static method in class io.delta.kernel.internal.deletionvectors.Base85Codec
Decode a 16 byte UUID.
DeletionVectorDescriptor - Class in io.delta.kernel.internal.actions
Information about a deletion vector attached to a file action.
DeletionVectorDescriptor(String, String, Optional<Integer>, int, long) - Constructor for class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
DeletionVectorStoredBitmap - Class in io.delta.kernel.internal.deletionvectors
Bitmap for a Deletion Vector, implemented as a thin wrapper around a Deletion Vector Descriptor.
DeletionVectorStoredBitmap(DeletionVectorDescriptor, Optional<String>) - Constructor for class io.delta.kernel.internal.deletionvectors.DeletionVectorStoredBitmap
 
DeletionVectorUtils - Class in io.delta.kernel.internal.deletionvectors
Utility methods regarding deletion vectors.
DeletionVectorUtils() - Constructor for class io.delta.kernel.internal.deletionvectors.DeletionVectorUtils
 
deltaFile(Path, long) - Static method in class io.delta.kernel.internal.util.FileNames
Returns the delta (json format) path for a given delta file.
deltas - Variable in class io.delta.kernel.internal.snapshot.LogSegment
 
deltaVersion(Path) - Static method in class io.delta.kernel.internal.util.FileNames
Returns the version for the given delta path.
deltaVersion(String) - Static method in class io.delta.kernel.internal.util.FileNames
 
depth() - Method in class io.delta.kernel.internal.fs.Path
Returns the number of elements in this path.
deserializeStructType(String) - Method in interface io.delta.kernel.client.JsonHandler
Deserialize the Delta schema from structTypeJson according to the Delta Protocol schema serialization rules .
DOUBLE - Static variable in class io.delta.kernel.types.DoubleType
 
DoubleType - Class in io.delta.kernel.types
The data type representing double type values.

E

empty(Path) - Static method in class io.delta.kernel.internal.snapshot.LogSegment
 
empty() - Static method in class io.delta.kernel.types.FieldMetadata
 
ENCODE_MAP - Static variable in class io.delta.kernel.internal.deletionvectors.Base85Codec
 
encodeBytes(byte[]) - Static method in class io.delta.kernel.internal.deletionvectors.Base85Codec
Encode an arbitrary byte array.
ENCODED_UUID_LENGTH - Static variable in class io.delta.kernel.internal.deletionvectors.Base85Codec
 
encodeUUID(UUID) - Static method in class io.delta.kernel.internal.deletionvectors.Base85Codec
Encode a 16 byte UUID.
equals(Object) - Method in class io.delta.kernel.expressions.Column
 
equals(Object) - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
equals(Object) - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
equals(Object) - Method in class io.delta.kernel.internal.fs.Path
 
equals(Object) - Method in class io.delta.kernel.internal.util.Tuple2
 
equals(Object) - Method in class io.delta.kernel.types.ArrayType
 
equals(Object) - Method in class io.delta.kernel.types.BasePrimitiveType
 
equals(Object) - Method in class io.delta.kernel.types.DataType
 
equals(Object) - Method in class io.delta.kernel.types.DecimalType
 
equals(Object) - Method in class io.delta.kernel.types.FieldMetadata
 
equals(Object) - Method in class io.delta.kernel.types.MapType
 
equals(Object) - Method in class io.delta.kernel.types.StructField
 
equals(Object) - Method in class io.delta.kernel.types.StructType
 
equivalent(DataType) - Method in class io.delta.kernel.types.ArrayType
 
equivalent(DataType) - Method in class io.delta.kernel.types.DataType
Are the data types same? The metadata or column names could be different.
equivalent(DataType) - Method in class io.delta.kernel.types.MapType
 
equivalent(DataType) - Method in class io.delta.kernel.types.StructType
 
eval(ColumnarBatch) - Method in interface io.delta.kernel.expressions.ExpressionEvaluator
Evaluate the expression on given ColumnarBatch data.
eval(ColumnarBatch, Optional<ColumnVector>) - Method in interface io.delta.kernel.expressions.PredicateEvaluator
Evaluate the predicate on given inputData.
Evolving - Annotation Type in io.delta.kernel.annotation
APIs that are meant to evolve towards becoming stable APIs, but are not stable APIs yet.
Expression - Interface in io.delta.kernel.expressions
Base interface for all Kernel expressions.
ExpressionEvaluator - Interface in io.delta.kernel.expressions
Interface for implementing an Expression evaluator.
ExpressionHandler - Interface in io.delta.kernel.client
Provides expression evaluation capability to Delta Kernel.
ExpressionUtils - Class in io.delta.kernel.internal.util
 
ExpressionUtils() - Constructor for class io.delta.kernel.internal.util.ExpressionUtils
 

F

FieldMetadata - Class in io.delta.kernel.types
The metadata for a given StructField.
FieldMetadata.Builder - Class in io.delta.kernel.types
Builder class for FieldMetadata.
fieldNames() - Method in class io.delta.kernel.types.StructType
 
fields() - Method in class io.delta.kernel.types.StructType
 
FileNames - Class in io.delta.kernel.internal.util
 
FileReadRequest - Interface in io.delta.kernel.client
Represents a request to read a range of bytes from a given file.
FileStatus - Class in io.delta.kernel.utils
Class for encapsulating metadata about a file in Delta Lake table.
FileSystemClient - Interface in io.delta.kernel.client
Provides file system related functionalities to Delta Kernel.
FilteredColumnarBatch - Class in io.delta.kernel.data
Represents a filtered version of ColumnarBatch.
FilteredColumnarBatch(ColumnarBatch, Optional<ColumnVector>) - Constructor for class io.delta.kernel.data.FilteredColumnarBatch
 
FLOAT - Static variable in class io.delta.kernel.types.FloatType
 
FloatType - Class in io.delta.kernel.types
The data type representing float type values.
Format - Class in io.delta.kernel.internal.actions
 
Format(String, Map<String, String>) - Constructor for class io.delta.kernel.internal.actions.Format
 
forPath(TableClient, String) - Static method in class io.delta.kernel.internal.TableImpl
 
forPath(TableClient, String) - Static method in interface io.delta.kernel.Table
Instantiate a table object for the Delta Lake table at the given path.
fromColumnVector(ColumnVector, int) - Static method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
fromColumnVector(ColumnVector, int) - Static method in class io.delta.kernel.internal.actions.Format
 
fromColumnVector(ColumnVector, int, TableClient) - Static method in class io.delta.kernel.internal.actions.Metadata
 
fromColumnVector(ColumnVector, int) - Static method in class io.delta.kernel.internal.actions.Protocol
 
fromColumnVector(ColumnVector, int) - Static method in class io.delta.kernel.internal.actions.SetTransaction
 
fromRow(Row) - Static method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
fromRow(Row) - Static method in class io.delta.kernel.internal.checkpoints.CheckpointMetaData
 
fromStructVector(ColumnVector, int) - Static method in class io.delta.kernel.internal.data.StructRow
 

G

generateScanFileRow(FileStatus) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
Create a scan file row conforming to the schema InternalScanFileUtils.SCAN_FILE_SCHEMA for given file status.
GenericRow - Class in io.delta.kernel.internal.data
Exposes a given map of values as a Row
GenericRow(StructType, Map<Integer, Object>) - Constructor for class io.delta.kernel.internal.data.GenericRow
 
get() - Method in class io.delta.kernel.internal.lang.Lazy
 
get(String) - Method in class io.delta.kernel.types.FieldMetadata
 
get(String) - Method in class io.delta.kernel.types.StructType
 
getAbsolutePath(String) - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
getAddFilesAsColumnarBatches(boolean) - Method in class io.delta.kernel.internal.replay.LogReplay
Returns an iterator of FilteredColumnarBatch representing all the active AddFiles in the table.
getAddFileStatus(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
Get the FileStatus of AddFile from given scan file Row.
getAddRemoveReadSchema(boolean) - Static method in class io.delta.kernel.internal.replay.LogReplay
Read schema when searching for all the active AddFiles
getAllPrimitiveTypes() - Static method in class io.delta.kernel.types.BasePrimitiveType
For testing only
getAppId() - Method in class io.delta.kernel.internal.actions.SetTransaction
 
getArray(int) - Method in interface io.delta.kernel.data.ColumnVector
Return the array value located at rowId.
getArray(int) - Method in interface io.delta.kernel.data.Row
Return array value of the column located at the given ordinal.
getArray(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getArray(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getBinary(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the binary type value for rowId.
getBinary(int) - Method in interface io.delta.kernel.data.Row
Return binary value of the column located at the given ordinal.
getBinary(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getBinary(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getBoolean(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the boolean type value for rowId.
getBoolean(int) - Method in interface io.delta.kernel.data.Row
Return boolean value of the column located at the given ordinal.
getBoolean(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getBoolean(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getBoolean(int) - Method in class io.delta.kernel.internal.data.SelectionColumnVector
 
getByte(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the byte type value for rowId.
getByte(int) - Method in interface io.delta.kernel.data.Row
Return byte value of the column located at the given ordinal.
getByte(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getByte(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getCardinality() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
getChild(int) - Method in interface io.delta.kernel.data.ColumnVector
Get the child vector associated with the given ordinal.
getChildren() - Method in class io.delta.kernel.expressions.Column
 
getChildren() - Method in interface io.delta.kernel.expressions.Expression
 
getChildren() - Method in class io.delta.kernel.expressions.Literal
 
getChildren() - Method in class io.delta.kernel.expressions.PartitionValueExpression
 
getChildren() - Method in class io.delta.kernel.expressions.ScalarExpression
 
getColumnMappingMode(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
Get the column mapping mode from the scan state Row returned by Scan.getScanState(TableClient).
getColumnMappingMode(Map<String, String>) - Static method in class io.delta.kernel.internal.util.ColumnMapping
Returns the column mapping mode from the given configuration.
getColumnVector(int) - Method in interface io.delta.kernel.data.ColumnarBatch
Return the ColumnVector for the given ordinal in the columnar batch.
getConfiguration() - Method in class io.delta.kernel.internal.actions.Metadata
 
getConfigurationMapValue() - Method in class io.delta.kernel.internal.actions.Metadata
 
getCorrespondingFiles(Path) - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
getCreatedTime() - Method in class io.delta.kernel.internal.actions.Metadata
 
getData() - Method in class io.delta.kernel.data.FilteredColumnarBatch
Return the data as ColumnarBatch.
getDataSchema() - Method in class io.delta.kernel.internal.actions.Metadata
The logical data schema which excludes partition columns
getDataType() - Method in interface io.delta.kernel.data.ColumnVector
 
getDataType() - Method in class io.delta.kernel.expressions.Literal
Get the datatype of the literal object.
getDataType() - Method in class io.delta.kernel.expressions.PartitionValueExpression
Get the data type of the partition value.
getDataType() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
 
getDataType() - Method in class io.delta.kernel.types.StructField
 
getDecimal(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the decimal type value for rowId.
getDecimal(int) - Method in interface io.delta.kernel.data.Row
Return decimal value of the column located at the given ordinal.
getDecimal(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getDecimal(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getDeletionVectorDescriptorFromRow(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
Create a DeletionVectorDescriptor from add entry in the given scan file row.
getDescription() - Method in class io.delta.kernel.internal.actions.Metadata
 
getDouble(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the double type value for rowId.
getDouble(int) - Method in interface io.delta.kernel.data.Row
Return double value of the column located at the given ordinal.
getDouble(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getDouble(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getElements() - Method in interface io.delta.kernel.data.ArrayValue
A ColumnVector containing the array elements with exactly ArrayValue.getSize() elements.
getElementType() - Method in class io.delta.kernel.types.ArrayType
 
getEntries() - Method in class io.delta.kernel.types.FieldMetadata
 
getEvaluator(StructType, Expression, DataType) - Method in interface io.delta.kernel.client.ExpressionHandler
Create an ExpressionEvaluator that can evaluate the given expression on ColumnarBatchs with the given batchSchema.
getExpressionHandler() - Method in interface io.delta.kernel.client.TableClient
Get the connector provided ExpressionHandler.
getFileSystemClient() - Method in interface io.delta.kernel.client.TableClient
Get the connector provided FileSystemClient.
getFileVersion(Path) - Static method in class io.delta.kernel.internal.util.FileNames
Get the version of the checkpoint, checksum or delta file.
getFloat(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the float type value for rowId.
getFloat(int) - Method in interface io.delta.kernel.data.Row
Return float value of the column located at the given ordinal.
getFloat(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getFloat(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getFormat() - Method in class io.delta.kernel.internal.actions.Metadata
 
getId() - Method in class io.delta.kernel.internal.actions.Metadata
 
getInput() - Method in class io.delta.kernel.expressions.PartitionValueExpression
Get the expression reference to the serialized partition value.
getInt(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the int type value for rowId.
getInt(int) - Method in interface io.delta.kernel.data.Row
Return integer value of the column located at the given ordinal.
getInt(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getInt(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getJsonHandler() - Method in interface io.delta.kernel.client.TableClient
Get the connector provided JsonHandler.
getKeys() - Method in interface io.delta.kernel.data.MapValue
A ColumnVector containing the keys.
getKeyType() - Method in class io.delta.kernel.types.MapType
 
getLastUpdated() - Method in class io.delta.kernel.internal.actions.SetTransaction
 
getLatestCompleteCheckpointFromList(List<CheckpointInstance>, CheckpointInstance) - Static method in class io.delta.kernel.internal.checkpoints.Checkpointer
Given a list of checkpoint files, pick the latest complete checkpoint instance which is not later than `notLaterThan`.
getLatestSnapshot(TableClient) - Method in class io.delta.kernel.internal.TableImpl
 
getLatestSnapshot(TableClient) - Method in interface io.delta.kernel.Table
Get the latest snapshot of the table.
getLatestTransactionIdentifier(String) - Method in class io.delta.kernel.internal.replay.LogReplay
 
getLatestTransactionVersion(String) - Method in class io.delta.kernel.internal.SnapshotImpl
Get the latest transaction version for given applicationId.
getLeft() - Method in class io.delta.kernel.expressions.And
 
getLeft() - Method in class io.delta.kernel.expressions.Or
 
getLeft(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
Utility method to return the left child of the binary input expression
getLogicalSchema(TableClient, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
Utility method to get the logical schema from the scan state Row returned by Scan.getScanState(TableClient).
getLogSegmentForVersion(Path, TableClient, Optional<Long>, Optional<Long>) - Method in class io.delta.kernel.internal.snapshot.SnapshotManager
Get a list of files that can be used to compute a Snapshot at version `versionToLoad`, If `versionToLoad` is not provided, will generate the list of files that are needed to load the latest version of the Delta table.
getLong(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the long type value for rowId.
getLong(int) - Method in interface io.delta.kernel.data.Row
Return long value of the column located at the given ordinal.
getLong(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getLong(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getMap(int) - Method in interface io.delta.kernel.data.ColumnVector
Return the map value located at rowId.
getMap(int) - Method in interface io.delta.kernel.data.Row
Return map value of the column located at the given ordinal.
getMap(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getMap(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getMaxColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Given a logical column in the data schema provided when creating this, return the corresponding MAX column in the statistic schema that stores the MAX values for the provided logical column.
getMessage() - Method in exception io.delta.kernel.TableNotFoundException
 
getMetadata() - Method in class io.delta.kernel.internal.replay.LogReplay
 
getMetadata() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
 
getMetadata() - Method in class io.delta.kernel.internal.SnapshotImpl
 
getMetadata() - Method in class io.delta.kernel.types.StructField
 
getMinColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Given a logical column in the data schema provided when creating this, return the corresponding MIN column in the statistic schema that stores the MIN values for the provided logical column.
getMinReaderVersion() - Method in class io.delta.kernel.internal.actions.Protocol
 
getMinWriterVersion() - Method in class io.delta.kernel.internal.actions.Protocol
 
getModificationTime() - Method in class io.delta.kernel.utils.FileStatus
Get the modification time of the file in epoch millis.
getName() - Method in class io.delta.kernel.expressions.ScalarExpression
 
getName() - Method in class io.delta.kernel.internal.actions.Metadata
 
getName() - Method in class io.delta.kernel.internal.fs.Path
Returns the final component of this path.
getName(String) - Static method in class io.delta.kernel.internal.fs.Path
 
getName() - Method in class io.delta.kernel.types.StructField
 
getNames() - Method in class io.delta.kernel.expressions.Column
 
getNullCountColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Given a logical column in the data schema provided when creating this, return the corresponding NULL_COUNT column in the statistic schema that stores the null count values for the provided logical column.
getNumRecordsColumn() - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Returns the NUM_RECORDS column in the statistic schema
getOffset() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
getOptions() - Method in class io.delta.kernel.internal.actions.Format
 
getParent() - Method in class io.delta.kernel.internal.fs.Path
Returns the parent of a path or null if at root.
getParquetHandler() - Method in interface io.delta.kernel.client.TableClient
Get the connector provided ParquetHandler.
getPartitionColNames() - Method in class io.delta.kernel.internal.actions.Metadata
Set of lowercase partition column names
getPartitionColumns() - Method in class io.delta.kernel.internal.actions.Metadata
 
getPartitionColumns(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
Get the list of partition column names from the scan state Row returned by Scan.getScanState(TableClient).
getPartitionValues(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
Get the partition columns and values belonging to the AddFile from given scan file row.
getPath() - Method in interface io.delta.kernel.client.FileReadRequest
Get the fully qualified path of the file from which to read the data.
getPath() - Method in class io.delta.kernel.utils.FileStatus
Get the path to the file.
getPathOrInlineDv() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
getPathWithoutSchemeAndAuthority(Path) - Static method in class io.delta.kernel.internal.fs.Path
Return a version of the given Path without the scheme information.
getPhysicalDataReadSchema(TableClient, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
Utility method to get the physical data read schema from the scan state Row returned by Scan.getScanState(TableClient).
getPhysicalName(StructField) - Static method in class io.delta.kernel.internal.util.ColumnMapping
Returns the physical name for a given StructField
getPhysicalSchema(TableClient, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
Utility method to get the physical schema from the scan state Row returned by Scan.getScanState(TableClient).
getPrecision() - Method in class io.delta.kernel.types.DecimalType
 
getPredicateEvaluator(StructType, Predicate) - Method in interface io.delta.kernel.client.ExpressionHandler
Create a PredicateEvaluator that can evaluate the given predicate expression and return a selection vector (ColumnVector of boolean type).
getProtocol() - Method in class io.delta.kernel.internal.replay.LogReplay
 
getProtocol() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
 
getProtocol() - Method in class io.delta.kernel.internal.SnapshotImpl
 
getProvider() - Method in class io.delta.kernel.internal.actions.Format
 
getReaderFeatures() - Method in class io.delta.kernel.internal.actions.Protocol
 
getReadLength() - Method in interface io.delta.kernel.client.FileReadRequest
Get the length of the data to read from the file starting at the startOffset.
getReferencedCols() - Method in class io.delta.kernel.internal.skipping.DataSkippingPredicate
 
getRemainingFilter() - Method in class io.delta.kernel.internal.ScanImpl
 
getRemainingFilter() - Method in interface io.delta.kernel.Scan
Get the remaining filter that is not guaranteed to be satisfied for the data Delta Kernel returns.
getRight() - Method in class io.delta.kernel.expressions.And
 
getRight() - Method in class io.delta.kernel.expressions.Or
 
getRight(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
Utility method to return the right child of the binary input expression
getRows() - Method in interface io.delta.kernel.data.ColumnarBatch
 
getRows() - Method in class io.delta.kernel.data.FilteredColumnarBatch
Iterator of rows that survived the filter.
getScale() - Method in class io.delta.kernel.types.DecimalType
 
getScanBuilder(TableClient) - Method in class io.delta.kernel.internal.SnapshotImpl
 
getScanBuilder(TableClient) - Method in interface io.delta.kernel.Snapshot
Create a scan builder to construct a Scan to read data from this snapshot.
getScanFiles(TableClient) - Method in class io.delta.kernel.internal.ScanImpl
Get an iterator of data files in this version of scan that survived the predicate pruning.
getScanFiles(TableClient) - Method in interface io.delta.kernel.Scan
Get an iterator of data files to scan.
getScanState(TableClient) - Method in class io.delta.kernel.internal.ScanImpl
 
getScanState(TableClient) - Method in interface io.delta.kernel.Scan
Get the scan state associated with the current scan.
getSchema() - Method in interface io.delta.kernel.data.ColumnarBatch
 
getSchema() - Method in interface io.delta.kernel.data.Row
 
getSchema() - Method in class io.delta.kernel.internal.actions.Metadata
 
getSchema() - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getSchema() - Method in class io.delta.kernel.internal.data.GenericRow
 
getSchema(TableClient) - Method in class io.delta.kernel.internal.SnapshotImpl
 
getSchema(TableClient) - Method in interface io.delta.kernel.Snapshot
Get the schema of the table at this snapshot.
getSchemaString() - Method in class io.delta.kernel.internal.actions.Metadata
 
getSelectionVector() - Method in class io.delta.kernel.data.FilteredColumnarBatch
Optional selection vector containing one entry for each row in data indicating whether a row is selected or not selected.
getShort(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the short type value for rowId.
getShort(int) - Method in interface io.delta.kernel.data.Row
Return short value of the column located at the given ordinal.
getShort(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getShort(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getSingularElement(CloseableIterator<T>) - Static method in class io.delta.kernel.internal.util.InternalUtils
Utility method to read at most one element from a CloseableIterator.
getSingularRow(CloseableIterator<ColumnarBatch>) - Static method in class io.delta.kernel.internal.util.InternalUtils
Utility method to read at most one row from the given data ColumnarBatch iterator.
getSize() - Method in interface io.delta.kernel.data.ArrayValue
The number of elements in the array
getSize() - Method in interface io.delta.kernel.data.ColumnarBatch
 
getSize() - Method in interface io.delta.kernel.data.ColumnVector
 
getSize() - Method in interface io.delta.kernel.data.MapValue
The number of elements in the map
getSize() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
 
getSize() - Method in class io.delta.kernel.utils.FileStatus
Get the size of the file in bytes.
getSizeInBytes() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
getStartOffset() - Method in interface io.delta.kernel.client.FileReadRequest
Get the start offset in the file from where to start reading the data.
getStatsSchema(StructType) - Static method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Returns the expected statistics schema given a table schema.
getStorageType() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
getString(int) - Method in interface io.delta.kernel.data.ColumnVector
Returns the string type value for rowId.
getString(int) - Method in interface io.delta.kernel.data.Row
Return string value of the column located at the given ordinal.
getString(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getString(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getStruct(int) - Method in interface io.delta.kernel.data.Row
Return struct value of the column located at the given ordinal.
getStruct(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
getStruct(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
getTableRoot(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
Get the table root from scan state Row returned by Scan.getScanState(TableClient)
getUnaryChild(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
Utility method to return the single child of the unary input expression
getUniqueId() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
getValue() - Method in class io.delta.kernel.expressions.Literal
Get the literal value.
getValues() - Method in interface io.delta.kernel.data.MapValue
A ColumnVector containing the values.
getValueType() - Method in class io.delta.kernel.types.MapType
 
getVersion() - Method in class io.delta.kernel.internal.actions.SetTransaction
 
getVersion() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
 
getVersion(TableClient) - Method in class io.delta.kernel.internal.SnapshotImpl
 
getVersion(TableClient) - Method in interface io.delta.kernel.Snapshot
Get the version of this snapshot in the table.
getWriterFeatures() - Method in class io.delta.kernel.internal.actions.Protocol
 

H

hashCode() - Method in class io.delta.kernel.expressions.Column
 
hashCode() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
hashCode() - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
hashCode() - Method in class io.delta.kernel.internal.fs.Path
 
hashCode() - Method in class io.delta.kernel.internal.util.Tuple2
 
hashCode() - Method in class io.delta.kernel.types.ArrayType
 
hashCode() - Method in class io.delta.kernel.types.BasePrimitiveType
 
hashCode() - Method in class io.delta.kernel.types.DataType
 
hashCode() - Method in class io.delta.kernel.types.DecimalType
 
hashCode() - Method in class io.delta.kernel.types.FieldMetadata
 
hashCode() - Method in class io.delta.kernel.types.MapType
 
hashCode() - Method in class io.delta.kernel.types.StructField
 
hashCode() - Method in class io.delta.kernel.types.StructType
 

I

indexOf(String) - Method in class io.delta.kernel.types.StructType
 
INLINE_DV_MARKER - Static variable in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
inlineData() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
INTEGER - Static variable in class io.delta.kernel.types.IntegerType
 
IntegerType - Class in io.delta.kernel.types
The data type representing integer type values.
InternalScanFileUtils - Class in io.delta.kernel.internal
Utilities to extract information out of the scan file rows returned by Scan.getScanFiles(TableClient).
InternalUtils - Class in io.delta.kernel.internal.util
 
io.delta.kernel - package io.delta.kernel
Delta Kernel interfaces for constructing table object representing a Delta Lake table, getting snapshot from the table and building a scan object to scan a subset of the data in the table.
io.delta.kernel.annotation - package io.delta.kernel.annotation
 
io.delta.kernel.client - package io.delta.kernel.client
Interfaces to allow the connector to bring their own implementation of functions such as reading parquet files, listing files in a file system, parsing a JSON string etc.
io.delta.kernel.data - package io.delta.kernel.data
Delta Kernel interfaces for representing data in columnar and row format.
io.delta.kernel.expressions - package io.delta.kernel.expressions
Expressions framework that defines the most common expressions which the connectors can use to pass predicates to Delta Kernel.
io.delta.kernel.internal - package io.delta.kernel.internal
 
io.delta.kernel.internal.actions - package io.delta.kernel.internal.actions
 
io.delta.kernel.internal.checkpoints - package io.delta.kernel.internal.checkpoints
 
io.delta.kernel.internal.data - package io.delta.kernel.internal.data
 
io.delta.kernel.internal.deletionvectors - package io.delta.kernel.internal.deletionvectors
 
io.delta.kernel.internal.fs - package io.delta.kernel.internal.fs
 
io.delta.kernel.internal.lang - package io.delta.kernel.internal.lang
 
io.delta.kernel.internal.replay - package io.delta.kernel.internal.replay
 
io.delta.kernel.internal.skipping - package io.delta.kernel.internal.skipping
 
io.delta.kernel.internal.snapshot - package io.delta.kernel.internal.snapshot
 
io.delta.kernel.internal.util - package io.delta.kernel.internal.util
 
io.delta.kernel.types - package io.delta.kernel.types
Data types defined by the Delta Kernel to exchange the type info between the Delta Kernel and the connectors.
io.delta.kernel.utils - package io.delta.kernel.utils
Utilities.
isAbsolute() - Method in class io.delta.kernel.internal.fs.Path
Returns true if the path component (i.e.
isAbsoluteAndSchemeAuthorityNull() - Method in class io.delta.kernel.internal.fs.Path
Returns true if the path component (i.e.
isCheckpointFile(String) - Static method in class io.delta.kernel.internal.util.FileNames
 
isCommitFile(String) - Static method in class io.delta.kernel.internal.util.FileNames
 
isDataColumn() - Method in class io.delta.kernel.types.StructField
 
isInline() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
isMetadataColumn() - Method in class io.delta.kernel.types.StructField
 
isNullable() - Method in class io.delta.kernel.types.StructField
 
isNullAt(int) - Method in interface io.delta.kernel.data.ColumnVector
 
isNullAt(int) - Method in interface io.delta.kernel.data.Row
 
isNullAt(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
 
isNullAt(int) - Method in class io.delta.kernel.internal.data.GenericRow
 
isNullAt(int) - Method in class io.delta.kernel.internal.data.SelectionColumnVector
 
isOnDisk() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
isPrimitiveType(String) - Static method in class io.delta.kernel.types.BasePrimitiveType
Is the given type name a primitive type?
isRoot() - Method in class io.delta.kernel.internal.fs.Path
Returns true if and only if this path represents the root of a file system.
isSkippingEligibleLiteral(Literal) - Static method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Returns true if the given literal is skipping-eligible.
isSkippingEligibleMinMaxColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Returns true if the given column is skipping-eligible using min/max statistics.
isSkippingEligibleNullCountColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
Returns true if the given column is skipping-eligible using null count statistics.
isUriPathAbsolute() - Method in class io.delta.kernel.internal.fs.Path
Returns true if the path component (i.e.
isValueContainsNull() - Method in class io.delta.kernel.types.MapType
 
isWindowsAbsolutePath(String, boolean) - Static method in class io.delta.kernel.internal.fs.Path
Determine whether a given path string represents an absolute path on Windows.
iterator() - Method in interface io.delta.kernel.internal.lang.CloseableIterable
 

J

JsonHandler - Interface in io.delta.kernel.client
Provides JSON handling functionality to Delta Kernel.

L

LAST_CHECKPOINT_FILE_NAME - Static variable in class io.delta.kernel.internal.checkpoints.Checkpointer
The name of the last checkpoint file
lastCommitTimestamp - Variable in class io.delta.kernel.internal.snapshot.LogSegment
 
Lazy<T> - Class in io.delta.kernel.internal.lang
 
Lazy(Supplier<T>) - Constructor for class io.delta.kernel.internal.lang.Lazy
 
length() - Method in class io.delta.kernel.types.StructType
 
listFrom(String) - Method in interface io.delta.kernel.client.FileSystemClient
List the paths in the same directory that are lexicographically greater or equal to (UTF-8 sorting) the given `path`.
listingPrefix(Path, long) - Static method in class io.delta.kernel.internal.util.FileNames
Returns the prefix of all delta log files for the given version.
ListUtils - Class in io.delta.kernel.internal.lang
 
Literal - Class in io.delta.kernel.expressions
A literal value.
load(FileSystemClient) - Method in class io.delta.kernel.internal.deletionvectors.DeletionVectorStoredBitmap
 
loadNewDvAndBitmap(TableClient, String, DeletionVectorDescriptor) - Static method in class io.delta.kernel.internal.deletionvectors.DeletionVectorUtils
 
logPath - Variable in class io.delta.kernel.internal.snapshot.LogSegment
 
LogReplay - Class in io.delta.kernel.internal.replay
Replays a history of actions, resolving them to produce the current state of the table.
LogReplay(Path, Path, long, TableClient, LogSegment, Optional<SnapshotHint>) - Constructor for class io.delta.kernel.internal.replay.LogReplay
 
LogSegment - Class in io.delta.kernel.internal.snapshot
 
LogSegment(Path, long, List<FileStatus>, List<FileStatus>, Optional<Long>, long) - Constructor for class io.delta.kernel.internal.snapshot.LogSegment
Provides information around which files in the transaction log need to be read to create the given version of the log.
LONG - Static variable in class io.delta.kernel.types.LongType
 
LongType - Class in io.delta.kernel.types
The data type representing long type values.

M

makeQualified(URI, Path) - Method in class io.delta.kernel.internal.fs.Path
Returns a qualified path object.
map(Function<T, U>) - Method in interface io.delta.kernel.utils.CloseableIterator
 
MapType - Class in io.delta.kernel.types
Data type representing a map type.
MapType(DataType, DataType, boolean) - Constructor for class io.delta.kernel.types.MapType
 
MapValue - Interface in io.delta.kernel.data
Abstraction to represent a single map value in a ColumnVector.
MAX_VALUE - Static variable in class io.delta.kernel.internal.checkpoints.CheckpointInstance
Placeholder to identify the version that is always the latest on timeline
mergePaths(Path, Path) - Static method in class io.delta.kernel.internal.fs.Path
Merge 2 paths such that the second path is appended relative to the first.
Metadata - Class in io.delta.kernel.internal.actions
 
Metadata(String, Optional<String>, Optional<String>, Format, String, StructType, ArrayValue, Optional<Long>, MapValue) - Constructor for class io.delta.kernel.internal.actions.Metadata
 
METADATA_ROW_INDEX_COLUMN - Static variable in class io.delta.kernel.types.StructField
 
METADATA_ROW_INDEX_COLUMN_NAME - Static variable in class io.delta.kernel.types.StructField
The name of a row index metadata column.

N

numParts - Variable in class io.delta.kernel.internal.checkpoints.CheckpointInstance
 

O

of(Metadata, Protocol, String, String, String, String) - Static method in class io.delta.kernel.internal.data.ScanStateRow
 
of(String, long, long) - Static method in class io.delta.kernel.utils.FileStatus
Create a FileStatus with the given path, size and modification time.
ofBinary(byte[]) - Static method in class io.delta.kernel.expressions.Literal
Create a binary type literal expression.
ofBoolean(boolean) - Static method in class io.delta.kernel.expressions.Literal
Create a boolean type literal expression.
ofByte(byte) - Static method in class io.delta.kernel.expressions.Literal
Create a byte type literal expression.
ofDate(int) - Static method in class io.delta.kernel.expressions.Literal
Create a date type literal expression.
ofDecimal(BigDecimal, int, int) - Static method in class io.delta.kernel.expressions.Literal
Create a decimal type literal expression.
ofDouble(double) - Static method in class io.delta.kernel.expressions.Literal
Create a double type literal expression.
ofFloat(float) - Static method in class io.delta.kernel.expressions.Literal
Create a float type literal expression.
ofInt(int) - Static method in class io.delta.kernel.expressions.Literal
Create a integer type literal expression.
ofLong(long) - Static method in class io.delta.kernel.expressions.Literal
Create a long type literal expression.
ofNull(DataType) - Static method in class io.delta.kernel.expressions.Literal
Create null value literal.
ofShort(short) - Static method in class io.delta.kernel.expressions.Literal
Create a short type literal expression.
ofString(String) - Static method in class io.delta.kernel.expressions.Literal
Create a string type literal expression.
ofTimestamp(long) - Static method in class io.delta.kernel.expressions.Literal
Create a timestamp type literal expression.
Or - Class in io.delta.kernel.expressions
OR expression
Or(Predicate, Predicate) - Constructor for class io.delta.kernel.expressions.Or
 

P

PARQUET_FIELD_ID_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
 
ParquetHandler - Interface in io.delta.kernel.client
Provides Parquet file related functionalities to Delta Kernel.
parseJson(ColumnVector, StructType, Optional<ColumnVector>) - Method in interface io.delta.kernel.client.JsonHandler
Parse the given json strings and return the fields requested by outputSchema as columns in a ColumnarBatch.
parseJsonStats(TableClient, FilteredColumnarBatch, StructType) - Static method in class io.delta.kernel.internal.skipping.DataSkippingUtils
Given a FilteredColumnarBatch of scan files and the statistics schema to parse, return the parsed JSON stats from the scan files.
partition(List<T>, Predicate<? super T>) - Static method in class io.delta.kernel.internal.lang.ListUtils
 
PartitionUtils - Class in io.delta.kernel.internal.util
 
PartitionValueExpression - Class in io.delta.kernel.expressions
Expression to decode the serialized partition value into partition type value according the Delta Protocol spec.
PartitionValueExpression(Expression, DataType) - Constructor for class io.delta.kernel.expressions.PartitionValueExpression
Create partition_value expression.
parts - Variable in class io.delta.kernel.internal.checkpoints.CheckpointMetaData
 
Path - Class in io.delta.kernel.internal.fs
Names a file or directory in a FileSystem.
Path(String, String) - Constructor for class io.delta.kernel.internal.fs.Path
Create a new Path based on the child path resolved against the parent path.
Path(Path, String) - Constructor for class io.delta.kernel.internal.fs.Path
Create a new Path based on the child path resolved against the parent path.
Path(String, Path) - Constructor for class io.delta.kernel.internal.fs.Path
Create a new Path based on the child path resolved against the parent path.
Path(Path, Path) - Constructor for class io.delta.kernel.internal.fs.Path
Create a new Path based on the child path resolved against the parent path.
Path(String) - Constructor for class io.delta.kernel.internal.fs.Path
Construct a path from a String.
Path(URI) - Constructor for class io.delta.kernel.internal.fs.Path
Construct a path from a URI
Path(String, String, String) - Constructor for class io.delta.kernel.internal.fs.Path
Construct a Path from components.
PATH_DV_MARKER - Static variable in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
physicalSchemaWithoutPartitionColumns(StructType, StructType, Set<String>) - Static method in class io.delta.kernel.internal.util.PartitionUtils
Utility method to remove the given columns (as columnsToRemove) from the given physicalSchema.
Preconditions - Class in io.delta.kernel.internal.util
Static convenience methods that help a method or constructor check whether it was invoked correctly (that is, whether its preconditions were met).
Predicate - Class in io.delta.kernel.expressions
Defines predicate scalar expression which is an extension of ScalarExpression that evaluates to true, false, or null for each input row.
Predicate(String, List<Expression>) - Constructor for class io.delta.kernel.expressions.Predicate
 
Predicate(String, Expression) - Constructor for class io.delta.kernel.expressions.Predicate
Constructor for a unary Predicate expression
Predicate(String, Expression, Expression) - Constructor for class io.delta.kernel.expressions.Predicate
Constructor for a binary Predicate expression
PredicateEvaluator - Interface in io.delta.kernel.expressions
Special interface for evaluating Predicate on input batch and return a selection vector containing one value for each row in input batch indicating whether the row has passed the predicate or not.
Protocol - Class in io.delta.kernel.internal.actions
 
Protocol(int, int, List<String>, List<String>) - Constructor for class io.delta.kernel.internal.actions.Protocol
 
PROTOCOL_METADATA_READ_SCHEMA - Static variable in class io.delta.kernel.internal.replay.LogReplay
Read schema when searching for the latest Protocol and Metadata.
pruneStatsSchema(StructType, Set<Column>) - Static method in class io.delta.kernel.internal.skipping.DataSkippingUtils
Prunes the given schema to only include the referenced leaf columns.
putBoolean(String, boolean) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putBooleanArray(String, Boolean[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putDouble(String, double) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putDoubleArray(String, Double[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putFieldMetadata(String, FieldMetadata) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putFieldMetadataArray(String, FieldMetadata[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putLong(String, long) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putLongArray(String, Long[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putNull(String) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putString(String, String) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 
putStringArray(String, String[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
 

R

READ_SCHEMA - Static variable in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
READ_SCHEMA - Static variable in class io.delta.kernel.internal.actions.Format
 
READ_SCHEMA - Static variable in class io.delta.kernel.internal.actions.Metadata
 
READ_SCHEMA - Static variable in class io.delta.kernel.internal.actions.Protocol
 
READ_SCHEMA - Static variable in class io.delta.kernel.internal.actions.SetTransaction
 
READ_SCHEMA - Static variable in class io.delta.kernel.internal.checkpoints.CheckpointMetaData
 
readFiles(CloseableIterator<FileReadRequest>) - Method in interface io.delta.kernel.client.FileSystemClient
Return an iterator of byte streams one for each read request in readRequests.
readJsonFiles(CloseableIterator<FileStatus>, StructType, Optional<Predicate>) - Method in interface io.delta.kernel.client.JsonHandler
Read and parse the JSON format file at given locations and return the data as a ColumnarBatch with the columns requested by physicalSchema.
readLastCheckpointFile(TableClient) - Method in class io.delta.kernel.internal.checkpoints.Checkpointer
Returns information about the most recent checkpoint.
readParquetFiles(CloseableIterator<FileStatus>, StructType, Optional<Predicate>) - Method in interface io.delta.kernel.client.ParquetHandler
Read the Parquet format files at the given locations and return the data as a ColumnarBatch with the columns requested by physicalSchema.
REMOVE_FILE_DV_ORDINAL - Static variable in class io.delta.kernel.internal.replay.LogReplay
 
REMOVE_FILE_ORDINAL - Static variable in class io.delta.kernel.internal.replay.LogReplay
 
REMOVE_FILE_PATH_ORDINAL - Static variable in class io.delta.kernel.internal.replay.LogReplay
 
requireNonNull(Row, int, String) - Static method in class io.delta.kernel.internal.util.InternalUtils
 
requireNonNull(ColumnVector, int, String) - Static method in class io.delta.kernel.internal.util.InternalUtils
 
resolvePath(String) - Method in interface io.delta.kernel.client.FileSystemClient
Resolve the given path to a fully qualified path.
rewritePartitionPredicateOnScanFileSchema(Predicate, Map<String, StructField>) - Static method in class io.delta.kernel.internal.util.PartitionUtils
Utility method to rewrite the partition predicate referring to the table schema as predicate referring to the partitionValues in scan files read from Delta log.
RoaringBitmapArray - Class in io.delta.kernel.internal.deletionvectors
A 64-bit extension of [[RoaringBitmap]] that is optimized for cases that usually fit within a 32-bit bitmap, but may run over by a few bits on occasion.
RoaringBitmapArray() - Constructor for class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
 
Row - Interface in io.delta.kernel.data
Represent a single record

S

ScalarExpression - Class in io.delta.kernel.expressions
Scalar SQL expressions which take zero or more inputs and for each input row generate one output value.
ScalarExpression(String, List<Expression>) - Constructor for class io.delta.kernel.expressions.ScalarExpression
 
Scan - Interface in io.delta.kernel
Represents a scan of a Delta table.
SCAN_FILE_SCHEMA - Static variable in class io.delta.kernel.internal.InternalScanFileUtils
Scan file rows may have an additional column "add.stats" at the end of the "add" columns that is not represented in the schema here.
ScanBuilder - Interface in io.delta.kernel
Builder to construct Scan object.
ScanBuilderImpl - Class in io.delta.kernel.internal
Implementation of ScanBuilder.
ScanBuilderImpl(Path, Protocol, Metadata, StructType, LogReplay, TableClient) - Constructor for class io.delta.kernel.internal.ScanBuilderImpl
 
ScanImpl - Class in io.delta.kernel.internal
Implementation of Scan
ScanImpl(StructType, StructType, Protocol, Metadata, LogReplay, Optional<Predicate>, Path) - Constructor for class io.delta.kernel.internal.ScanImpl
 
ScanStateRow - Class in io.delta.kernel.internal.data
Encapsulate the scan state (common info for all scan files) as a Row
ScanStateRow(HashMap<Integer, Object>) - Constructor for class io.delta.kernel.internal.data.ScanStateRow
 
SCHEMA_WITH_STATS - Static variable in class io.delta.kernel.internal.actions.AddFile
 
SCHEMA_WITHOUT_STATS - Static variable in class io.delta.kernel.internal.actions.AddFile
 
SelectionColumnVector - Class in io.delta.kernel.internal.data
The selection vector for a columnar batch as a boolean ColumnVector.
SelectionColumnVector(RoaringBitmapArray, ColumnVector) - Constructor for class io.delta.kernel.internal.data.SelectionColumnVector
 
SEPARATOR - Static variable in class io.delta.kernel.internal.fs.Path
The directory separator, a slash.
SEPARATOR_CHAR - Static variable in class io.delta.kernel.internal.fs.Path
The directory separator, a slash, as a character.
SET_TRANSACTION_READ_SCHEMA - Static variable in class io.delta.kernel.internal.replay.LogReplay
Read schema when searching for just the transaction identifiers
SetTransaction - Class in io.delta.kernel.internal.actions
Delta log action representing a transaction identifier action.
SetTransaction(String, Long, Optional<Long>) - Constructor for class io.delta.kernel.internal.actions.SetTransaction
 
SHORT - Static variable in class io.delta.kernel.types.ShortType
 
ShortType - Class in io.delta.kernel.types
The data type representing short type values.
singletonCloseableIterator(T) - Static method in class io.delta.kernel.internal.util.Utils
Utility method to create a singleton CloseableIterator.
singletonStringColumnVector(String) - Static method in class io.delta.kernel.internal.util.InternalUtils
Utility method to create a singleton string ColumnVector
size - Variable in class io.delta.kernel.internal.checkpoints.CheckpointMetaData
 
slice(int, int) - Method in interface io.delta.kernel.data.ColumnarBatch
Return a slice of the current batch.
Snapshot - Interface in io.delta.kernel
Represents the snapshot of a Delta table.
SnapshotHint - Class in io.delta.kernel.internal.snapshot
Contains summary information of a Snapshot.
SnapshotHint(long, Protocol, Metadata) - Constructor for class io.delta.kernel.internal.snapshot.SnapshotHint
 
SnapshotImpl - Class in io.delta.kernel.internal
Implementation of Snapshot.
SnapshotImpl(Path, Path, long, LogSegment, TableClient, long, Optional<SnapshotHint>) - Constructor for class io.delta.kernel.internal.SnapshotImpl
 
SnapshotManager - Class in io.delta.kernel.internal.snapshot
 
SnapshotManager() - Constructor for class io.delta.kernel.internal.snapshot.SnapshotManager
 
splitMetadataAndDataPredicates(Predicate, Set<String>) - Static method in class io.delta.kernel.internal.util.PartitionUtils
Split the given predicate into predicate on partition columns and predicate on data columns.
StatsSchemaHelper - Class in io.delta.kernel.internal.skipping
Provides information and utilities for statistics columns given a table schema.
StatsSchemaHelper(StructType) - Constructor for class io.delta.kernel.internal.skipping.StatsSchemaHelper
 
STRING - Static variable in class io.delta.kernel.types.StringType
 
StringType - Class in io.delta.kernel.types
The data type representing string type values.
StructField - Class in io.delta.kernel.types
Represents a subfield of StructType with additional properties and metadata.
StructField(String, DataType, boolean) - Constructor for class io.delta.kernel.types.StructField
 
StructField(String, DataType, boolean, FieldMetadata) - Constructor for class io.delta.kernel.types.StructField
 
StructRow - Class in io.delta.kernel.internal.data
A Row abstraction for a struct type column vector and a specific rowId.
StructType - Class in io.delta.kernel.types
Struct type which contains one or more columns.
StructType() - Constructor for class io.delta.kernel.types.StructType
 
StructType(List<StructField>) - Constructor for class io.delta.kernel.types.StructType
 
suffix(String) - Method in class io.delta.kernel.internal.fs.Path
Adds a suffix to the final name in the path.

T

Table - Interface in io.delta.kernel
Represents the Delta Lake table for a given path.
TABLE_ROOT_STRUCT_FIELD - Static variable in class io.delta.kernel.internal.InternalScanFileUtils
 
TableClient - Interface in io.delta.kernel.client
Interface encapsulating all clients needed by the Delta Kernel in order to read the Delta table.
TableImpl - Class in io.delta.kernel.internal
 
TableImpl(Path, Path) - Constructor for class io.delta.kernel.internal.TableImpl
 
TableNotFoundException - Exception in io.delta.kernel
Thrown when there is no Delta table at the given location.
TableNotFoundException(String) - Constructor for exception io.delta.kernel.TableNotFoundException
 
TableNotFoundException(String, Throwable) - Constructor for exception io.delta.kernel.TableNotFoundException
 
throwOnUnsupportedColumnMappingMode(Metadata) - Static method in class io.delta.kernel.internal.util.ColumnMapping
Checks if the given column mapping mode in the given table metadata is supported.
TIMESTAMP - Static variable in class io.delta.kernel.types.TimestampType
 
TimestampType - Class in io.delta.kernel.types
A timestamp type, supporting [0001-01-01T00:00:00.000000Z, 9999-12-31T23:59:59.999999Z] where the left/right-bound is a date and time of the proleptic Gregorian calendar in UTC+00:00.
toCloseableIterator(Iterator<T>) - Static method in class io.delta.kernel.internal.util.Utils
Convert a Iterator to CloseableIterator.
toJavaList(ArrayValue) - Static method in class io.delta.kernel.internal.util.VectorUtils
Converts an ArrayValue to a Java list.
toJavaMap(MapValue) - Static method in class io.delta.kernel.internal.util.VectorUtils
Converts a MapValue to a Java map.
toJson() - Method in class io.delta.kernel.types.ArrayType
 
toJson() - Method in class io.delta.kernel.types.BasePrimitiveType
 
toJson() - Method in class io.delta.kernel.types.DataType
Convert the data type to Delta protocol specified serialization format.
toJson() - Method in class io.delta.kernel.types.DecimalType
 
toJson() - Method in class io.delta.kernel.types.FieldMetadata
 
toJson() - Method in class io.delta.kernel.types.MapType
 
toJson() - Method in class io.delta.kernel.types.StructField
 
toJson() - Method in class io.delta.kernel.types.StructType
 
toString() - Method in class io.delta.kernel.expressions.Column
 
toString() - Method in class io.delta.kernel.expressions.Literal
 
toString() - Method in class io.delta.kernel.expressions.PartitionValueExpression
 
toString() - Method in class io.delta.kernel.expressions.Predicate
 
toString() - Method in class io.delta.kernel.expressions.ScalarExpression
 
toString() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 
toString() - Method in class io.delta.kernel.internal.actions.Protocol
 
toString() - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
toString() - Method in class io.delta.kernel.internal.checkpoints.CheckpointMetaData
 
toString() - Method in class io.delta.kernel.internal.fs.Path
 
toString() - Method in class io.delta.kernel.types.ArrayType
 
toString() - Method in class io.delta.kernel.types.BasePrimitiveType
 
toString() - Method in class io.delta.kernel.types.DataType
 
toString() - Method in class io.delta.kernel.types.DecimalType
 
toString() - Method in class io.delta.kernel.types.FieldMetadata
 
toString() - Method in class io.delta.kernel.types.MapType
 
toString() - Method in class io.delta.kernel.types.StructField
 
toString() - Method in class io.delta.kernel.types.StructType
 
toUri() - Method in class io.delta.kernel.internal.fs.Path
Convert this Path to a URI.
transformPhysicalData(TableClient, Row, Row, CloseableIterator<ColumnarBatch>) - Static method in interface io.delta.kernel.Scan
Transform the physical data read from the table data file into the logical data that expected out of the Delta table.
Tuple2<K,V> - Class in io.delta.kernel.internal.util
Represents tuple of objects.
Tuple2(K, V) - Constructor for class io.delta.kernel.internal.util.Tuple2
 

U

USER_DEFAULT - Static variable in class io.delta.kernel.types.DecimalType
 
Utils - Class in io.delta.kernel.internal.util
Various utility methods to help the connectors work with data objects returned by Kernel
Utils() - Constructor for class io.delta.kernel.internal.util.Utils
 
UUID_DV_MARKER - Static variable in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
 

V

validateObject() - Method in class io.delta.kernel.internal.fs.Path
Validate the contents of a deserialized Path, so as to defend against malicious object streams.
VectorUtils - Class in io.delta.kernel.internal.util
 
verifyDeltaVersions(List<Long>, Optional<Long>, Optional<Long>) - Static method in class io.delta.kernel.internal.snapshot.SnapshotManager
- Verify the versions are contiguous.
version - Variable in class io.delta.kernel.internal.checkpoints.CheckpointInstance
 
version - Variable in class io.delta.kernel.internal.checkpoints.CheckpointMetaData
 
version - Variable in class io.delta.kernel.internal.snapshot.LogSegment
 

W

WINDOWS - Static variable in class io.delta.kernel.internal.fs.Path
Whether the current host is a Windows machine.
withDeletedColumnAt(int) - Method in interface io.delta.kernel.data.ColumnarBatch
Return a copy of this ColumnarBatch with the column at given ordinal removed.
withFilter(TableClient, Predicate) - Method in class io.delta.kernel.internal.ScanBuilderImpl
 
withFilter(TableClient, Predicate) - Method in interface io.delta.kernel.ScanBuilder
Apply the given filter expression to prune any files that do not contain data satisfying the given filter.
withNewColumn(int, StructField, ColumnVector) - Method in interface io.delta.kernel.data.ColumnarBatch
Return a copy of the ColumnarBatch with given new column vector inserted at the given columnVector at given ordinal.
withNewSchema(StructType) - Method in interface io.delta.kernel.data.ColumnarBatch
Generate a copy of this ColumnarBatch with the given newSchema.
withPartitionColumns(ExpressionHandler, ColumnarBatch, Map<String, String>, StructType) - Static method in class io.delta.kernel.internal.util.PartitionUtils
 
withReadSchema(TableClient, StructType) - Method in class io.delta.kernel.internal.ScanBuilderImpl
 
withReadSchema(TableClient, StructType) - Method in interface io.delta.kernel.ScanBuilder
Apply the given readSchema.

_

_1 - Variable in class io.delta.kernel.internal.util.Tuple2
 
_2 - Variable in class io.delta.kernel.internal.util.Tuple2
 
A B C D E F G H I J L M N O P R S T U V W _ 
Skip navigation links