- checkArgument(boolean) - Static method in class io.delta.kernel.internal.util.Preconditions
-
Precondition-style validation that throws IllegalArgumentException.
- checkArgument(boolean, String) - Static method in class io.delta.kernel.internal.util.Preconditions
-
Precondition-style validation that throws IllegalArgumentException.
- checkArgument(boolean, String, Object...) - Static method in class io.delta.kernel.internal.util.Preconditions
-
Precondition-style validation that throws IllegalArgumentException.
- Checkpointer - Class in io.delta.kernel.internal.checkpoints
-
- Checkpointer(Path) - Constructor for class io.delta.kernel.internal.checkpoints.Checkpointer
-
- checkpointFileSingular(Path, long) - Static method in class io.delta.kernel.internal.util.FileNames
-
Returns the path for a singular checkpoint up to the given version.
- checkpointFileWithParts(Path, long, int) - Static method in class io.delta.kernel.internal.util.FileNames
-
Returns the paths for all parts of the checkpoint up to the given version.
- CheckpointInstance - Class in io.delta.kernel.internal.checkpoints
-
Metadata about Delta checkpoint.
- CheckpointInstance(String) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- CheckpointInstance(long) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- CheckpointInstance(long, Optional<Integer>) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- CheckpointMetaData - Class in io.delta.kernel.internal.checkpoints
-
- CheckpointMetaData(long, long, Optional<Long>) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointMetaData
-
- checkpoints - Variable in class io.delta.kernel.internal.snapshot.LogSegment
-
- checkpointVersion(Path) - Static method in class io.delta.kernel.internal.util.FileNames
-
Returns the version for the given checkpoint path.
- checkpointVersion(String) - Static method in class io.delta.kernel.internal.util.FileNames
-
- checkpointVersionOpt - Variable in class io.delta.kernel.internal.snapshot.LogSegment
-
- ChildVectorBasedRow - Class in io.delta.kernel.internal.data
-
A
Row implementation that wraps a set of child vectors for a specific
rowId.
- ChildVectorBasedRow(int, StructType) - Constructor for class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- close() - Method in interface io.delta.kernel.data.ColumnVector
-
Cleans up memory for this column vector.
- close() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- CloseableIterable<T> - Interface in io.delta.kernel.internal.lang
-
- CloseableIterator<T> - Interface in io.delta.kernel.utils
-
Closeable extension of Iterator
- closeCloseables(AutoCloseable...) - Static method in class io.delta.kernel.internal.util.Utils
-
Close the given one or more AutoCloseables.
- closeCloseablesSilently(AutoCloseable...) - Static method in class io.delta.kernel.internal.util.Utils
-
Close the given list of AutoCloseable objects.
- Column - Class in io.delta.kernel.expressions
-
An expression type that refers to a column (case-sensitive) in the input.
- Column(String) - Constructor for class io.delta.kernel.expressions.Column
-
Create a column expression for referring to a column.
- Column(String[]) - Constructor for class io.delta.kernel.expressions.Column
-
Create a column expression to refer to a nested column.
- column(int) - Method in class io.delta.kernel.types.StructType
-
Creates a
Column expression for the field at the given
ordinal
- COLUMN_MAPPING_ID_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_ID - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_NAME - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_NONE - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_PHYSICAL_NAME_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- ColumnarBatch - Interface in io.delta.kernel.data
-
Represents zero or more rows of records with same schema type.
- ColumnarBatchRow - Class in io.delta.kernel.internal.data
-
Row abstraction around a columnar batch and a particular row within the columnar batch.
- ColumnarBatchRow(ColumnarBatch, int) - Constructor for class io.delta.kernel.internal.data.ColumnarBatchRow
-
- ColumnMapping - Class in io.delta.kernel.internal.util
-
Utilities related to the column mapping feature.
- ColumnVector - Interface in io.delta.kernel.data
-
Represents zero or more values of a single column.
- compareTo(CheckpointInstance) - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
Comparison rules:
1.
- compareTo(Path) - Method in class io.delta.kernel.internal.fs.Path
-
- constructDataSkippingFilter(Predicate, StructType) - Static method in class io.delta.kernel.internal.skipping.DataSkippingUtils
-
Constructs a data skipping filter to prune files using column statistics given
a query data filter if possible.
- contains(long) - Method in class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
-
Checks whether the value is included,
which is equivalent to checking if the corresponding bit is set.
- contains(String) - Method in class io.delta.kernel.types.FieldMetadata
-
- containsNull() - Method in class io.delta.kernel.types.ArrayType
-
- convertToPhysicalSchema(StructType, StructType, String) - Static method in class io.delta.kernel.internal.util.ColumnMapping
-
Helper method that converts the logical schema (requested by the connector) to physical
schema of the data stored in data files based on the table's column mapping mode.
- create(long...) - Static method in class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
-
- createPrimitive(String) - Static method in class io.delta.kernel.types.BasePrimitiveType
-
- createSelectionVector(boolean[], int, int) - Method in interface io.delta.kernel.client.ExpressionHandler
-
Create a selection vector, a boolean type
ColumnVector, on top of the range of values
given in
values array.
- CUR_DIR - Static variable in class io.delta.kernel.internal.fs.Path
-
The current directory, ".".
- generateScanFileRow(FileStatus) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
- GenericRow - Class in io.delta.kernel.internal.data
-
Exposes a given map of values as a
Row
- GenericRow(StructType, Map<Integer, Object>) - Constructor for class io.delta.kernel.internal.data.GenericRow
-
- get() - Method in class io.delta.kernel.internal.lang.Lazy
-
- get(String) - Method in class io.delta.kernel.types.FieldMetadata
-
- get(String) - Method in class io.delta.kernel.types.StructType
-
- getAbsolutePath(String) - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getAddFilesAsColumnarBatches(boolean) - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getAddFileStatus(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
- getAddRemoveReadSchema(boolean) - Static method in class io.delta.kernel.internal.replay.LogReplay
-
Read schema when searching for all the active AddFiles
- getAllPrimitiveTypes() - Static method in class io.delta.kernel.types.BasePrimitiveType
-
For testing only
- getAppId() - Method in class io.delta.kernel.internal.actions.SetTransaction
-
- getArray(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Return the array value located at rowId.
- getArray(int) - Method in interface io.delta.kernel.data.Row
-
Return array value of the column located at the given ordinal.
- getArray(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getArray(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getBinary(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the binary type value for rowId.
- getBinary(int) - Method in interface io.delta.kernel.data.Row
-
Return binary value of the column located at the given ordinal.
- getBinary(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getBinary(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getBoolean(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the boolean type value for rowId.
- getBoolean(int) - Method in interface io.delta.kernel.data.Row
-
Return boolean value of the column located at the given ordinal.
- getBoolean(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getBoolean(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getBoolean(int) - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- getByte(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the byte type value for rowId.
- getByte(int) - Method in interface io.delta.kernel.data.Row
-
Return byte value of the column located at the given ordinal.
- getByte(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getByte(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getCardinality() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getChild(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Get the child vector associated with the given ordinal.
- getChildren() - Method in class io.delta.kernel.expressions.Column
-
- getChildren() - Method in interface io.delta.kernel.expressions.Expression
-
- getChildren() - Method in class io.delta.kernel.expressions.Literal
-
- getChildren() - Method in class io.delta.kernel.expressions.PartitionValueExpression
-
- getChildren() - Method in class io.delta.kernel.expressions.ScalarExpression
-
- getColumnMappingMode(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getColumnMappingMode(Map<String, String>) - Static method in class io.delta.kernel.internal.util.ColumnMapping
-
Returns the column mapping mode from the given configuration.
- getColumnVector(int) - Method in interface io.delta.kernel.data.ColumnarBatch
-
Return the
ColumnVector for the given ordinal in the columnar batch.
- getConfiguration() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getConfigurationMapValue() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getCorrespondingFiles(Path) - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- getCreatedTime() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getData() - Method in class io.delta.kernel.data.FilteredColumnarBatch
-
- getDataSchema() - Method in class io.delta.kernel.internal.actions.Metadata
-
The logical data schema which excludes partition columns
- getDataType() - Method in interface io.delta.kernel.data.ColumnVector
-
- getDataType() - Method in class io.delta.kernel.expressions.Literal
-
Get the datatype of the literal object.
- getDataType() - Method in class io.delta.kernel.expressions.PartitionValueExpression
-
Get the data type of the partition value.
- getDataType() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- getDataType() - Method in class io.delta.kernel.types.StructField
-
- getDecimal(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the decimal type value for rowId.
- getDecimal(int) - Method in interface io.delta.kernel.data.Row
-
Return decimal value of the column located at the given ordinal.
- getDecimal(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getDecimal(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getDeletionVectorDescriptorFromRow(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
- getDescription() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getDouble(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the double type value for rowId.
- getDouble(int) - Method in interface io.delta.kernel.data.Row
-
Return double value of the column located at the given ordinal.
- getDouble(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getDouble(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getElements() - Method in interface io.delta.kernel.data.ArrayValue
-
- getElementType() - Method in class io.delta.kernel.types.ArrayType
-
- getEntries() - Method in class io.delta.kernel.types.FieldMetadata
-
- getEvaluator(StructType, Expression, DataType) - Method in interface io.delta.kernel.client.ExpressionHandler
-
- getExpressionHandler() - Method in interface io.delta.kernel.client.TableClient
-
- getFileSystemClient() - Method in interface io.delta.kernel.client.TableClient
-
- getFileVersion(Path) - Static method in class io.delta.kernel.internal.util.FileNames
-
Get the version of the checkpoint, checksum or delta file.
- getFloat(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the float type value for rowId.
- getFloat(int) - Method in interface io.delta.kernel.data.Row
-
Return float value of the column located at the given ordinal.
- getFloat(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getFloat(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getFormat() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getId() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getInput() - Method in class io.delta.kernel.expressions.PartitionValueExpression
-
Get the expression reference to the serialized partition value.
- getInt(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the int type value for rowId.
- getInt(int) - Method in interface io.delta.kernel.data.Row
-
Return integer value of the column located at the given ordinal.
- getInt(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getInt(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getJsonHandler() - Method in interface io.delta.kernel.client.TableClient
-
- getKeys() - Method in interface io.delta.kernel.data.MapValue
-
- getKeyType() - Method in class io.delta.kernel.types.MapType
-
- getLastUpdated() - Method in class io.delta.kernel.internal.actions.SetTransaction
-
- getLatestCompleteCheckpointFromList(List<CheckpointInstance>, CheckpointInstance) - Static method in class io.delta.kernel.internal.checkpoints.Checkpointer
-
Given a list of checkpoint files, pick the latest complete checkpoint instance which is not
later than `notLaterThan`.
- getLatestSnapshot(TableClient) - Method in class io.delta.kernel.internal.TableImpl
-
- getLatestSnapshot(TableClient) - Method in interface io.delta.kernel.Table
-
Get the latest snapshot of the table.
- getLatestTransactionIdentifier(String) - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getLatestTransactionVersion(String) - Method in class io.delta.kernel.internal.SnapshotImpl
-
Get the latest transaction version for given applicationId.
- getLeft() - Method in class io.delta.kernel.expressions.And
-
- getLeft() - Method in class io.delta.kernel.expressions.Or
-
- getLeft(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
-
Utility method to return the left child of the binary input expression
- getLogicalSchema(TableClient, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getLogSegmentForVersion(Path, TableClient, Optional<Long>, Optional<Long>) - Method in class io.delta.kernel.internal.snapshot.SnapshotManager
-
Get a list of files that can be used to compute a Snapshot at version `versionToLoad`, If
`versionToLoad` is not provided, will generate the list of files that are needed to load the
latest version of the Delta table.
- getLong(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the long type value for rowId.
- getLong(int) - Method in interface io.delta.kernel.data.Row
-
Return long value of the column located at the given ordinal.
- getLong(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getLong(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getMap(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Return the map value located at rowId.
- getMap(int) - Method in interface io.delta.kernel.data.Row
-
Return map value of the column located at the given ordinal.
- getMap(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getMap(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getMaxColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Given a logical column in the data schema provided when creating this, return
the corresponding MAX column in the statistic schema that stores the MAX values for the
provided logical column.
- getMessage() - Method in exception io.delta.kernel.TableNotFoundException
-
- getMetadata() - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getMetadata() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
-
- getMetadata() - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getMetadata() - Method in class io.delta.kernel.types.StructField
-
- getMinColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Given a logical column in the data schema provided when creating this, return
the corresponding MIN column in the statistic schema that stores the MIN values for the
provided logical column.
- getMinReaderVersion() - Method in class io.delta.kernel.internal.actions.Protocol
-
- getMinWriterVersion() - Method in class io.delta.kernel.internal.actions.Protocol
-
- getModificationTime() - Method in class io.delta.kernel.utils.FileStatus
-
Get the modification time of the file in epoch millis.
- getName() - Method in class io.delta.kernel.expressions.ScalarExpression
-
- getName() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getName() - Method in class io.delta.kernel.internal.fs.Path
-
Returns the final component of this path.
- getName(String) - Static method in class io.delta.kernel.internal.fs.Path
-
- getName() - Method in class io.delta.kernel.types.StructField
-
- getNames() - Method in class io.delta.kernel.expressions.Column
-
- getNullCountColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Given a logical column in the data schema provided when creating this, return
the corresponding NULL_COUNT column in the statistic schema that stores the null count values
for the provided logical column.
- getNumRecordsColumn() - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Returns the NUM_RECORDS column in the statistic schema
- getOffset() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getOptions() - Method in class io.delta.kernel.internal.actions.Format
-
- getParent() - Method in class io.delta.kernel.internal.fs.Path
-
Returns the parent of a path or null if at root.
- getParquetHandler() - Method in interface io.delta.kernel.client.TableClient
-
- getPartitionColNames() - Method in class io.delta.kernel.internal.actions.Metadata
-
Set of lowercase partition column names
- getPartitionColumns() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getPartitionColumns(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getPartitionValues(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
Get the partition columns and values belonging to the AddFile from given scan file
row.
- getPath() - Method in interface io.delta.kernel.client.FileReadRequest
-
Get the fully qualified path of the file from which to read the data.
- getPath() - Method in class io.delta.kernel.utils.FileStatus
-
Get the path to the file.
- getPathOrInlineDv() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getPathWithoutSchemeAndAuthority(Path) - Static method in class io.delta.kernel.internal.fs.Path
-
Return a version of the given Path without the scheme information.
- getPhysicalDataReadSchema(TableClient, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getPhysicalName(StructField) - Static method in class io.delta.kernel.internal.util.ColumnMapping
-
- getPhysicalSchema(TableClient, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getPrecision() - Method in class io.delta.kernel.types.DecimalType
-
- getPredicateEvaluator(StructType, Predicate) - Method in interface io.delta.kernel.client.ExpressionHandler
-
- getProtocol() - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getProtocol() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
-
- getProtocol() - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getProvider() - Method in class io.delta.kernel.internal.actions.Format
-
- getReaderFeatures() - Method in class io.delta.kernel.internal.actions.Protocol
-
- getReadLength() - Method in interface io.delta.kernel.client.FileReadRequest
-
Get the length of the data to read from the file starting at the startOffset.
- getReferencedCols() - Method in class io.delta.kernel.internal.skipping.DataSkippingPredicate
-
- getRemainingFilter() - Method in class io.delta.kernel.internal.ScanImpl
-
- getRemainingFilter() - Method in interface io.delta.kernel.Scan
-
Get the remaining filter that is not guaranteed to be satisfied for the data Delta Kernel
returns.
- getRight() - Method in class io.delta.kernel.expressions.And
-
- getRight() - Method in class io.delta.kernel.expressions.Or
-
- getRight(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
-
Utility method to return the right child of the binary input expression
- getRows() - Method in interface io.delta.kernel.data.ColumnarBatch
-
- getRows() - Method in class io.delta.kernel.data.FilteredColumnarBatch
-
Iterator of rows that survived the filter.
- getScale() - Method in class io.delta.kernel.types.DecimalType
-
- getScanBuilder(TableClient) - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getScanBuilder(TableClient) - Method in interface io.delta.kernel.Snapshot
-
Create a scan builder to construct a
Scan to read data from this snapshot.
- getScanFiles(TableClient) - Method in class io.delta.kernel.internal.ScanImpl
-
Get an iterator of data files in this version of scan that survived the predicate pruning.
- getScanFiles(TableClient) - Method in interface io.delta.kernel.Scan
-
Get an iterator of data files to scan.
- getScanState(TableClient) - Method in class io.delta.kernel.internal.ScanImpl
-
- getScanState(TableClient) - Method in interface io.delta.kernel.Scan
-
Get the scan state associated with the current scan.
- getSchema() - Method in interface io.delta.kernel.data.ColumnarBatch
-
- getSchema() - Method in interface io.delta.kernel.data.Row
-
- getSchema() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getSchema() - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getSchema() - Method in class io.delta.kernel.internal.data.GenericRow
-
- getSchema(TableClient) - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getSchema(TableClient) - Method in interface io.delta.kernel.Snapshot
-
Get the schema of the table at this snapshot.
- getSchemaString() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getSelectionVector() - Method in class io.delta.kernel.data.FilteredColumnarBatch
-
Optional selection vector containing one entry for each row in data indicating whether
a row is selected or not selected.
- getShort(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the short type value for rowId.
- getShort(int) - Method in interface io.delta.kernel.data.Row
-
Return short value of the column located at the given ordinal.
- getShort(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getShort(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getSingularElement(CloseableIterator<T>) - Static method in class io.delta.kernel.internal.util.InternalUtils
-
- getSingularRow(CloseableIterator<ColumnarBatch>) - Static method in class io.delta.kernel.internal.util.InternalUtils
-
Utility method to read at most one row from the given data
ColumnarBatch
iterator.
- getSize() - Method in interface io.delta.kernel.data.ArrayValue
-
The number of elements in the array
- getSize() - Method in interface io.delta.kernel.data.ColumnarBatch
-
- getSize() - Method in interface io.delta.kernel.data.ColumnVector
-
- getSize() - Method in interface io.delta.kernel.data.MapValue
-
The number of elements in the map
- getSize() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- getSize() - Method in class io.delta.kernel.utils.FileStatus
-
Get the size of the file in bytes.
- getSizeInBytes() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getStartOffset() - Method in interface io.delta.kernel.client.FileReadRequest
-
Get the start offset in the file from where to start reading the data.
- getStatsSchema(StructType) - Static method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Returns the expected statistics schema given a table schema.
- getStorageType() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getString(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the string type value for rowId.
- getString(int) - Method in interface io.delta.kernel.data.Row
-
Return string value of the column located at the given ordinal.
- getString(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getString(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getStruct(int) - Method in interface io.delta.kernel.data.Row
-
Return struct value of the column located at the given ordinal.
- getStruct(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getStruct(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getTableRoot(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getUnaryChild(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
-
Utility method to return the single child of the unary input expression
- getUniqueId() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getValue() - Method in class io.delta.kernel.expressions.Literal
-
Get the literal value.
- getValues() - Method in interface io.delta.kernel.data.MapValue
-
- getValueType() - Method in class io.delta.kernel.types.MapType
-
- getVersion() - Method in class io.delta.kernel.internal.actions.SetTransaction
-
- getVersion() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
-
- getVersion(TableClient) - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getVersion(TableClient) - Method in interface io.delta.kernel.Snapshot
-
Get the version of this snapshot in the table.
- getWriterFeatures() - Method in class io.delta.kernel.internal.actions.Protocol
-
- indexOf(String) - Method in class io.delta.kernel.types.StructType
-
- INLINE_DV_MARKER - Static variable in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- inlineData() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- INTEGER - Static variable in class io.delta.kernel.types.IntegerType
-
- IntegerType - Class in io.delta.kernel.types
-
The data type representing integer type values.
- InternalScanFileUtils - Class in io.delta.kernel.internal
-
- InternalUtils - Class in io.delta.kernel.internal.util
-
- io.delta.kernel - package io.delta.kernel
-
Delta Kernel interfaces for constructing table object representing a Delta Lake table, getting
snapshot from the table and building a scan object to scan a subset of the data in the table.
- io.delta.kernel.annotation - package io.delta.kernel.annotation
-
- io.delta.kernel.client - package io.delta.kernel.client
-
Interfaces to allow the connector to bring their own implementation of functions such
as reading parquet files, listing files in a file system, parsing a JSON string etc.
- io.delta.kernel.data - package io.delta.kernel.data
-
Delta Kernel interfaces for representing data in columnar and row format.
- io.delta.kernel.expressions - package io.delta.kernel.expressions
-
Expressions framework that defines the most common expressions which the connectors
can use to pass predicates to Delta Kernel.
- io.delta.kernel.internal - package io.delta.kernel.internal
-
- io.delta.kernel.internal.actions - package io.delta.kernel.internal.actions
-
- io.delta.kernel.internal.checkpoints - package io.delta.kernel.internal.checkpoints
-
- io.delta.kernel.internal.data - package io.delta.kernel.internal.data
-
- io.delta.kernel.internal.deletionvectors - package io.delta.kernel.internal.deletionvectors
-
- io.delta.kernel.internal.fs - package io.delta.kernel.internal.fs
-
- io.delta.kernel.internal.lang - package io.delta.kernel.internal.lang
-
- io.delta.kernel.internal.replay - package io.delta.kernel.internal.replay
-
- io.delta.kernel.internal.skipping - package io.delta.kernel.internal.skipping
-
- io.delta.kernel.internal.snapshot - package io.delta.kernel.internal.snapshot
-
- io.delta.kernel.internal.util - package io.delta.kernel.internal.util
-
- io.delta.kernel.types - package io.delta.kernel.types
-
Data types defined by the Delta Kernel to exchange the type info between the Delta Kernel and
the connectors.
- io.delta.kernel.utils - package io.delta.kernel.utils
-
Utilities.
- isAbsolute() - Method in class io.delta.kernel.internal.fs.Path
-
Returns true if the path component (i.e.
- isAbsoluteAndSchemeAuthorityNull() - Method in class io.delta.kernel.internal.fs.Path
-
Returns true if the path component (i.e.
- isCheckpointFile(String) - Static method in class io.delta.kernel.internal.util.FileNames
-
- isCommitFile(String) - Static method in class io.delta.kernel.internal.util.FileNames
-
- isDataColumn() - Method in class io.delta.kernel.types.StructField
-
- isInline() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- isMetadataColumn() - Method in class io.delta.kernel.types.StructField
-
- isNullable() - Method in class io.delta.kernel.types.StructField
-
- isNullAt(int) - Method in interface io.delta.kernel.data.ColumnVector
-
- isNullAt(int) - Method in interface io.delta.kernel.data.Row
-
- isNullAt(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- isNullAt(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- isNullAt(int) - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- isOnDisk() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- isPrimitiveType(String) - Static method in class io.delta.kernel.types.BasePrimitiveType
-
Is the given type name a primitive type?
- isRoot() - Method in class io.delta.kernel.internal.fs.Path
-
Returns true if and only if this path represents the root of a file system.
- isSkippingEligibleLiteral(Literal) - Static method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Returns true if the given literal is skipping-eligible.
- isSkippingEligibleMinMaxColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Returns true if the given column is skipping-eligible using min/max statistics.
- isSkippingEligibleNullCountColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Returns true if the given column is skipping-eligible using null count statistics.
- isUriPathAbsolute() - Method in class io.delta.kernel.internal.fs.Path
-
Returns true if the path component (i.e.
- isValueContainsNull() - Method in class io.delta.kernel.types.MapType
-
- isWindowsAbsolutePath(String, boolean) - Static method in class io.delta.kernel.internal.fs.Path
-
Determine whether a given path string represents an absolute path on
Windows.
- iterator() - Method in interface io.delta.kernel.internal.lang.CloseableIterable
-
- PARQUET_FIELD_ID_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- ParquetHandler - Interface in io.delta.kernel.client
-
Provides Parquet file related functionalities to Delta Kernel.
- parseJson(ColumnVector, StructType, Optional<ColumnVector>) - Method in interface io.delta.kernel.client.JsonHandler
-
Parse the given
json strings and return the fields requested by
outputSchema
as columns in a
ColumnarBatch.
- parseJsonStats(TableClient, FilteredColumnarBatch, StructType) - Static method in class io.delta.kernel.internal.skipping.DataSkippingUtils
-
Given a FilteredColumnarBatch of scan files and the statistics schema to parse,
return the parsed JSON stats from the scan files.
- partition(List<T>, Predicate<? super T>) - Static method in class io.delta.kernel.internal.lang.ListUtils
-
- PartitionUtils - Class in io.delta.kernel.internal.util
-
- PartitionValueExpression - Class in io.delta.kernel.expressions
-
Expression to decode the serialized partition value into partition type value according the
Delta Protocol spec.
- PartitionValueExpression(Expression, DataType) - Constructor for class io.delta.kernel.expressions.PartitionValueExpression
-
Create partition_value expression.
- parts - Variable in class io.delta.kernel.internal.checkpoints.CheckpointMetaData
-
- Path - Class in io.delta.kernel.internal.fs
-
Names a file or directory in a FileSystem.
- Path(String, String) - Constructor for class io.delta.kernel.internal.fs.Path
-
Create a new Path based on the child path resolved against the parent path.
- Path(Path, String) - Constructor for class io.delta.kernel.internal.fs.Path
-
Create a new Path based on the child path resolved against the parent path.
- Path(String, Path) - Constructor for class io.delta.kernel.internal.fs.Path
-
Create a new Path based on the child path resolved against the parent path.
- Path(Path, Path) - Constructor for class io.delta.kernel.internal.fs.Path
-
Create a new Path based on the child path resolved against the parent path.
- Path(String) - Constructor for class io.delta.kernel.internal.fs.Path
-
Construct a path from a String.
- Path(URI) - Constructor for class io.delta.kernel.internal.fs.Path
-
Construct a path from a URI
- Path(String, String, String) - Constructor for class io.delta.kernel.internal.fs.Path
-
Construct a Path from components.
- PATH_DV_MARKER - Static variable in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- physicalSchemaWithoutPartitionColumns(StructType, StructType, Set<String>) - Static method in class io.delta.kernel.internal.util.PartitionUtils
-
Utility method to remove the given columns (as columnsToRemove) from the
given physicalSchema.
- Preconditions - Class in io.delta.kernel.internal.util
-
Static convenience methods that help a method or constructor check whether it was invoked
correctly (that is, whether its preconditions were met).
- Predicate - Class in io.delta.kernel.expressions
-
Defines predicate scalar expression which is an extension of
ScalarExpression
that evaluates to true, false, or null for each input row.
- Predicate(String, List<Expression>) - Constructor for class io.delta.kernel.expressions.Predicate
-
- Predicate(String, Expression) - Constructor for class io.delta.kernel.expressions.Predicate
-
Constructor for a unary Predicate expression
- Predicate(String, Expression, Expression) - Constructor for class io.delta.kernel.expressions.Predicate
-
Constructor for a binary Predicate expression
- PredicateEvaluator - Interface in io.delta.kernel.expressions
-
Special interface for evaluating
Predicate on input batch and return a selection
vector containing one value for each row in input batch indicating whether the row has passed
the predicate or not.
- Protocol - Class in io.delta.kernel.internal.actions
-
- Protocol(int, int, List<String>, List<String>) - Constructor for class io.delta.kernel.internal.actions.Protocol
-
- PROTOCOL_METADATA_READ_SCHEMA - Static variable in class io.delta.kernel.internal.replay.LogReplay
-
Read schema when searching for the latest Protocol and Metadata.
- pruneStatsSchema(StructType, Set<Column>) - Static method in class io.delta.kernel.internal.skipping.DataSkippingUtils
-
Prunes the given schema to only include the referenced leaf columns.
- putBoolean(String, boolean) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putBooleanArray(String, Boolean[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putDouble(String, double) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putDoubleArray(String, Double[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putFieldMetadata(String, FieldMetadata) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putFieldMetadataArray(String, FieldMetadata[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putLong(String, long) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putLongArray(String, Long[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putNull(String) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putString(String, String) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-
- putStringArray(String, String[]) - Method in class io.delta.kernel.types.FieldMetadata.Builder
-