- casePreservingPartitionColNames(StructType, List<String>) - Static method in class io.delta.kernel.internal.util.SchemaUtils
-
Delta expects partition column names to be same case preserving as the name in the schema.
- casePreservingPartitionColNames(List<String>, Map<String, Literal>) - Static method in class io.delta.kernel.internal.util.SchemaUtils
-
Convert the partition column names in partitionValues map into the same case as the
column in the table metadata.
- checkArgument(boolean) - Static method in class io.delta.kernel.internal.util.Preconditions
-
Precondition-style validation that throws IllegalArgumentException.
- checkArgument(boolean, String) - Static method in class io.delta.kernel.internal.util.Preconditions
-
Precondition-style validation that throws IllegalArgumentException.
- checkArgument(boolean, String, Object...) - Static method in class io.delta.kernel.internal.util.Preconditions
-
Precondition-style validation that throws IllegalArgumentException.
- checkpoint(Engine, long) - Method in class io.delta.kernel.internal.snapshot.SnapshotManager
-
- checkpoint(Engine, long) - Method in class io.delta.kernel.internal.TableImpl
-
- checkpoint(Engine, long) - Method in interface io.delta.kernel.Table
-
Checkpoint the table at given version.
- CHECKPOINT_INTERVAL - Static variable in class io.delta.kernel.internal.TableConfig
-
How often to checkpoint the delta log? For every N (this config) commits to the log, we will
suggest write out a checkpoint file that can speed up the Delta table state reconstruction.
- CHECKPOINT_SCHEMA - Static variable in class io.delta.kernel.internal.actions.SingleAction
-
Get the schema of reading entries from Delta Log delta and checkpoint files for construction
of new checkpoint.
- CheckpointAlreadyExistsException - Exception in io.delta.kernel.exceptions
-
Thrown when trying to create a checkpoint at version v, but there already exists
a checkpoint at version v.
- CheckpointAlreadyExistsException(long) - Constructor for exception io.delta.kernel.exceptions.CheckpointAlreadyExistsException
-
- Checkpointer - Class in io.delta.kernel.internal.checkpoints
-
- Checkpointer(Path) - Constructor for class io.delta.kernel.internal.checkpoints.Checkpointer
-
- checkpointFileSingular(Path, long) - Static method in class io.delta.kernel.internal.util.FileNames
-
Returns the path for a singular checkpoint up to the given version.
- checkpointFileWithParts(Path, long, int) - Static method in class io.delta.kernel.internal.util.FileNames
-
Returns the paths for all parts of the checkpoint up to the given version.
- CheckpointInstance - Class in io.delta.kernel.internal.checkpoints
-
Metadata about Delta checkpoint.
- CheckpointInstance(String) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- CheckpointInstance(long) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- CheckpointInstance(long, Optional<Integer>) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- CheckpointInstance.CheckpointFormat - Enum in io.delta.kernel.internal.checkpoints
-
- CheckpointMetaData - Class in io.delta.kernel.internal.checkpoints
-
- CheckpointMetaData(long, long, Optional<Long>) - Constructor for class io.delta.kernel.internal.checkpoints.CheckpointMetaData
-
- checkpoints - Variable in class io.delta.kernel.internal.snapshot.LogSegment
-
- checkpointVersion(Path) - Static method in class io.delta.kernel.internal.util.FileNames
-
Returns the version for the given checkpoint path.
- checkpointVersion(String) - Static method in class io.delta.kernel.internal.util.FileNames
-
- checkpointVersionOpt - Variable in class io.delta.kernel.internal.snapshot.LogSegment
-
- checkState(boolean, String) - Static method in class io.delta.kernel.internal.util.Preconditions
-
Ensures the truth of an expression involving the state of the calling instance.
- ChildVectorBasedRow - Class in io.delta.kernel.internal.data
-
A
Row implementation that wraps a set of child vectors for a specific
rowId.
- ChildVectorBasedRow(int, StructType) - Constructor for class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- close() - Method in interface io.delta.kernel.data.ColumnVector
-
Cleans up memory for this column vector.
- close() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- close() - Method in class io.delta.kernel.internal.replay.CreateCheckpointIterator
-
- CloseableIterable<T> - Interface in io.delta.kernel.utils
-
Extend the Java Iterable interface to provide a way to close the iterator.
- CloseableIterator<T> - Interface in io.delta.kernel.utils
-
Closeable extension of Iterator
- closeCloseables(AutoCloseable...) - Static method in class io.delta.kernel.internal.util.Utils
-
Close the given one or more AutoCloseables.
- closeCloseablesSilently(AutoCloseable...) - Static method in class io.delta.kernel.internal.util.Utils
-
Close the given list of AutoCloseable objects.
- Column - Class in io.delta.kernel.expressions
-
An expression type that refers to a column (case-sensitive) in the input.
- Column(String) - Constructor for class io.delta.kernel.expressions.Column
-
Create a column expression for referring to a column.
- Column(String[]) - Constructor for class io.delta.kernel.expressions.Column
-
Create a column expression to refer to a nested column.
- column(int) - Method in class io.delta.kernel.types.StructType
-
Creates a
Column expression for the field at the given
ordinal
- COLUMN_MAPPING_ID_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_ID - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_NAME - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_MODE_NONE - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- COLUMN_MAPPING_PHYSICAL_NAME_KEY - Static variable in class io.delta.kernel.internal.util.ColumnMapping
-
- ColumnarBatch - Interface in io.delta.kernel.data
-
Represents zero or more rows of records with same schema type.
- ColumnarBatchRow - Class in io.delta.kernel.internal.data
-
Row abstraction around a columnar batch and a particular row within the columnar batch.
- ColumnarBatchRow(ColumnarBatch, int) - Constructor for class io.delta.kernel.internal.data.ColumnarBatchRow
-
- columnInvariantsNotSupported() - Static method in class io.delta.kernel.internal.DeltaErrors
-
- ColumnMapping - Class in io.delta.kernel.internal.util
-
Utilities related to the column mapping feature.
- ColumnVector - Interface in io.delta.kernel.data
-
Represents zero or more values of a single column.
- combine(CloseableIterator<T>) - Method in interface io.delta.kernel.utils.CloseableIterator
-
Combine the current iterator with another iterator.
- commit(Engine, CloseableIterable<Row>) - Method in class io.delta.kernel.internal.TransactionImpl
-
- commit(Engine, CloseableIterable<Row>) - Method in interface io.delta.kernel.Transaction
-
- CommitInfo - Class in io.delta.kernel.internal.actions
-
Delta log action representing a commit information action.
- CommitInfo(long, String, String, Map<String, String>, boolean, String) - Constructor for class io.delta.kernel.internal.actions.CommitInfo
-
- compareTo(CheckpointInstance) - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
Comparison rules:
1.
- compareTo(Path) - Method in class io.delta.kernel.internal.fs.Path
-
- concurrentTransaction(String, long, long) - Static method in class io.delta.kernel.internal.DeltaErrors
-
- ConcurrentTransactionException - Exception in io.delta.kernel.exceptions
-
- ConcurrentTransactionException(String, long, long) - Constructor for exception io.delta.kernel.exceptions.ConcurrentTransactionException
-
- ConcurrentWriteException - Exception in io.delta.kernel.exceptions
-
Thrown when a concurrent transaction has written data after the current transaction has started.
- ConcurrentWriteException() - Constructor for exception io.delta.kernel.exceptions.ConcurrentWriteException
-
- ConcurrentWriteException(String) - Constructor for exception io.delta.kernel.exceptions.ConcurrentWriteException
-
- CONFLICT_RESOLUTION_SCHEMA - Static variable in class io.delta.kernel.internal.actions.SingleAction
-
Schema to use when reading the winning commit files for conflict resolution.
- ConflictChecker - Class in io.delta.kernel.internal.replay
-
Class containing the conflict resolution logic when writing to a Delta table.
- ConflictChecker.TransactionRebaseState - Class in io.delta.kernel.internal.replay
-
Class containing the rebase state from winning transactions that the current transaction
needs to rebase against before attempting the commit.
- constructDataSkippingFilter(Predicate, StructType) - Static method in class io.delta.kernel.internal.skipping.DataSkippingUtils
-
Constructs a data skipping filter to prune files using column statistics given
a query data filter if possible.
- contains(long) - Method in class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
-
Checks whether the value is included,
which is equivalent to checking if the corresponding bit is set.
- contains(String) - Method in class io.delta.kernel.types.FieldMetadata
-
- containsAddOrRemoveFileActions(StructType) - Static method in class io.delta.kernel.internal.replay.LogReplay
-
- containsNull() - Method in class io.delta.kernel.types.ArrayType
-
- convertDataFileStatus(URI, DataFileStatus, Map<String, Literal>, boolean) - Static method in class io.delta.kernel.internal.actions.AddFile
-
Utility to generate `AddFile` row from the given
DataFileStatus and partition values.
- convertToPhysicalSchema(StructType, StructType, String) - Static method in class io.delta.kernel.internal.util.ColumnMapping
-
Helper method that converts the logical schema (requested by the connector) to physical
schema of the data stored in data files based on the table's column mapping mode.
- create(long...) - Static method in class io.delta.kernel.internal.deletionvectors.RoaringBitmapArray
-
- createAddFileSingleAction(Row) - Static method in class io.delta.kernel.internal.actions.SingleAction
-
- CreateCheckpointIterator - Class in io.delta.kernel.internal.replay
-
Replays a history of actions from the transaction log to reconstruct the checkpoint state of the
table.
- CreateCheckpointIterator(Engine, LogSegment, long) - Constructor for class io.delta.kernel.internal.replay.CreateCheckpointIterator
-
- createCommitInfoSingleAction(Row) - Static method in class io.delta.kernel.internal.actions.SingleAction
-
- createMetadataSingleAction(Row) - Static method in class io.delta.kernel.internal.actions.SingleAction
-
- createPrimitive(String) - Static method in class io.delta.kernel.types.BasePrimitiveType
-
- createProtocolSingleAction(Row) - Static method in class io.delta.kernel.internal.actions.SingleAction
-
- createRemoveFileSingleAction(Row) - Static method in class io.delta.kernel.internal.actions.SingleAction
-
- createSelectionVector(boolean[], int, int) - Method in interface io.delta.kernel.engine.ExpressionHandler
-
Create a selection vector, a boolean type
ColumnVector, on top of the range of values
given in
values array.
- createTransactionBuilder(Engine, String, Operation) - Method in class io.delta.kernel.internal.TableImpl
-
- createTransactionBuilder(Engine, String, Operation) - Method in interface io.delta.kernel.Table
-
- createTxnSingleAction(Row) - Static method in class io.delta.kernel.internal.actions.SingleAction
-
- CUR_DIR - Static variable in class io.delta.kernel.internal.fs.Path
-
The current directory, ".".
- generateAppendActions(Engine, Row, CloseableIterator<DataFileStatus>, DataWriteContext) - Static method in interface io.delta.kernel.Transaction
-
For given data files, generate Delta actions that can be committed in a transaction.
- generateScanFileRow(FileStatus) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
- GenericRow - Class in io.delta.kernel.internal.data
-
Exposes a given map of values as a
Row
- GenericRow(StructType, Map<Integer, Object>) - Constructor for class io.delta.kernel.internal.data.GenericRow
-
- get() - Method in class io.delta.kernel.internal.lang.Lazy
-
- get(String) - Method in class io.delta.kernel.types.FieldMetadata
-
- get(String) - Method in class io.delta.kernel.types.StructType
-
- getAbsolutePath(String) - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getActiveCommitAtTimestamp(Engine, Path, long) - Static method in class io.delta.kernel.internal.DeltaHistoryManager
-
Returns the latest recreatable commit that happened at or before timestamp.
- getAddFilesAsColumnarBatches(boolean, Optional<Predicate>) - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getAddFileStatus(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
- getAddRemoveReadSchema(boolean) - Static method in class io.delta.kernel.internal.replay.LogReplay
-
Read schema when searching for all the active AddFiles
- getAllPrimitiveTypes() - Static method in class io.delta.kernel.types.BasePrimitiveType
-
For testing only
- getAppId() - Method in class io.delta.kernel.internal.actions.SetTransaction
-
- getArray(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Return the array value located at rowId.
- getArray(int) - Method in interface io.delta.kernel.data.Row
-
Return array value of the column located at the given ordinal.
- getArray(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getArray(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getBinary(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the binary type value for rowId.
- getBinary(int) - Method in interface io.delta.kernel.data.Row
-
Return binary value of the column located at the given ordinal.
- getBinary(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getBinary(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getBoolean(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the boolean type value for rowId.
- getBoolean(int) - Method in interface io.delta.kernel.data.Row
-
Return boolean value of the column located at the given ordinal.
- getBoolean(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getBoolean(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getBoolean(int) - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- getByte(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the byte type value for rowId.
- getByte(int) - Method in interface io.delta.kernel.data.Row
-
Return byte value of the column located at the given ordinal.
- getByte(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getByte(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getCardinality() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getChild(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Get the child vector associated with the given ordinal.
- getChildren() - Method in class io.delta.kernel.expressions.Column
-
- getChildren() - Method in interface io.delta.kernel.expressions.Expression
-
- getChildren() - Method in class io.delta.kernel.expressions.Literal
-
- getChildren() - Method in class io.delta.kernel.expressions.PartitionValueExpression
-
- getChildren() - Method in class io.delta.kernel.expressions.ScalarExpression
-
- getColumnMappingMode(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getColumnMappingMode(Map<String, String>) - Static method in class io.delta.kernel.internal.util.ColumnMapping
-
Returns the column mapping mode from the given configuration.
- getColumnVector(int) - Method in interface io.delta.kernel.data.ColumnarBatch
-
Return the
ColumnVector for the given ordinal in the columnar batch.
- getConfiguration() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getConfigurationMapValue() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getCorrespondingFiles(Path) - Method in class io.delta.kernel.internal.checkpoints.CheckpointInstance
-
- getCreateCheckpointIterator(Engine) - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getCreatedTime() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getData() - Method in class io.delta.kernel.data.FilteredColumnarBatch
-
- getDataPath() - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getDataSchema() - Method in class io.delta.kernel.internal.actions.Metadata
-
The logical data schema which excludes partition columns
- getDataType() - Method in interface io.delta.kernel.data.ColumnVector
-
- getDataType() - Method in class io.delta.kernel.expressions.Literal
-
Get the datatype of the literal object.
- getDataType() - Method in class io.delta.kernel.expressions.PartitionValueExpression
-
Get the data type of the partition value.
- getDataType() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- getDataType() - Method in class io.delta.kernel.types.StructField
-
- getDecimal(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the decimal type value for rowId.
- getDecimal(int) - Method in interface io.delta.kernel.data.Row
-
Return decimal value of the column located at the given ordinal.
- getDecimal(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getDecimal(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getDeletionVectorDescriptorFromRow(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
- getDescription() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getDescription() - Method in enum io.delta.kernel.Operation
-
Returns the string that will be recorded in the transaction log.
- getDouble(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the double type value for rowId.
- getDouble(int) - Method in interface io.delta.kernel.data.Row
-
Return double value of the column located at the given ordinal.
- getDouble(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getDouble(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getEarliestRecreatableCommit(Engine, Path) - Static method in class io.delta.kernel.internal.DeltaHistoryManager
-
Gets the earliest commit that we can recreate.
- getElements() - Method in interface io.delta.kernel.data.ArrayValue
-
- getElementType() - Method in class io.delta.kernel.types.ArrayType
-
- getEngineInfo() - Method in class io.delta.kernel.internal.actions.CommitInfo
-
- getEntries() - Method in class io.delta.kernel.types.FieldMetadata
-
- getEvaluator(StructType, Expression, DataType) - Method in interface io.delta.kernel.engine.ExpressionHandler
-
- getExpressionHandler() - Method in interface io.delta.kernel.engine.Engine
-
- getFile() - Method in class io.delta.kernel.internal.replay.DeltaLogFile
-
- getFileSystemClient() - Method in interface io.delta.kernel.engine.Engine
-
- getFileVersion(Path) - Static method in class io.delta.kernel.internal.util.FileNames
-
Get the version of the checkpoint, checksum or delta file.
- getFloat(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the float type value for rowId.
- getFloat(int) - Method in interface io.delta.kernel.data.Row
-
Return float value of the column located at the given ordinal.
- getFloat(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getFloat(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getFormat() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getId() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getInput() - Method in class io.delta.kernel.expressions.PartitionValueExpression
-
Get the expression reference to the serialized partition value.
- getInt(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the int type value for rowId.
- getInt(int) - Method in interface io.delta.kernel.data.Row
-
Return integer value of the column located at the given ordinal.
- getInt(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getInt(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getJsonHandler() - Method in interface io.delta.kernel.engine.Engine
-
- getKeys() - Method in interface io.delta.kernel.data.MapValue
-
- getKeyType() - Method in class io.delta.kernel.types.MapType
-
- getLastUpdated() - Method in class io.delta.kernel.internal.actions.SetTransaction
-
- getLatestCompleteCheckpointFromList(List<CheckpointInstance>, CheckpointInstance) - Static method in class io.delta.kernel.internal.checkpoints.Checkpointer
-
Given a list of checkpoint files, pick the latest complete checkpoint instance which is not
later than `notLaterThan`.
- getLatestSnapshot(Engine) - Method in class io.delta.kernel.internal.TableImpl
-
- getLatestSnapshot(Engine) - Method in interface io.delta.kernel.Table
-
Get the latest snapshot of the table.
- getLatestTransactionIdentifier(String) - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getLatestTransactionVersion(String) - Method in class io.delta.kernel.internal.SnapshotImpl
-
Get the latest transaction version for given applicationId.
- getLatestVersion() - Method in class io.delta.kernel.internal.replay.ConflictChecker.TransactionRebaseState
-
Return the latest winning version of the table.
- getLeft() - Method in class io.delta.kernel.expressions.And
-
- getLeft() - Method in class io.delta.kernel.expressions.Or
-
- getLeft(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
-
Utility method to return the left child of the binary input expression
- getLogicalSchema(Engine, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getLogicalSchema(Engine, Row) - Static method in class io.delta.kernel.internal.data.TransactionStateRow
-
- getLogPath() - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getLogSegment() - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getLogSegmentForVersion(Engine, Optional<Long>, Optional<Long>) - Method in class io.delta.kernel.internal.snapshot.SnapshotManager
-
Get a list of files that can be used to compute a Snapshot at version `versionToLoad`, If
`versionToLoad` is not provided, will generate the list of files that are needed to load the
latest version of the Delta table.
- getLogType() - Method in class io.delta.kernel.internal.replay.DeltaLogFile
-
- getLong(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the long type value for rowId.
- getLong(int) - Method in interface io.delta.kernel.data.Row
-
Return long value of the column located at the given ordinal.
- getLong(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getLong(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getMap(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Return the map value located at rowId.
- getMap(int) - Method in interface io.delta.kernel.data.Row
-
Return map value of the column located at the given ordinal.
- getMap(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getMap(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getMaxColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Given a logical column in the data schema provided when creating this, return
the corresponding MAX column in the statistic schema that stores the MAX values for the
provided logical column.
- getMaxValues() - Method in class io.delta.kernel.utils.DataFileStatistics
-
Get the maximum values of the columns in the data file.
- getMessage() - Method in exception io.delta.kernel.exceptions.TableAlreadyExistsException
-
- getMetadata() - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getMetadata() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
-
- getMetadata() - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getMetadata() - Method in class io.delta.kernel.types.StructField
-
- getMinColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Given a logical column in the data schema provided when creating this, return
the corresponding MIN column in the statistic schema that stores the MIN values for the
provided logical column.
- getMinReaderVersion() - Method in class io.delta.kernel.internal.actions.Protocol
-
- getMinValues() - Method in class io.delta.kernel.utils.DataFileStatistics
-
Get the minimum values of the columns in the data file.
- getMinWriterVersion() - Method in class io.delta.kernel.internal.actions.Protocol
-
- getModificationTime() - Method in class io.delta.kernel.internal.checkpoints.SidecarFile
-
- getModificationTime() - Method in class io.delta.kernel.utils.FileStatus
-
Get the modification time of the file in epoch millis.
- getName() - Method in class io.delta.kernel.expressions.ScalarExpression
-
- getName() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getName() - Method in class io.delta.kernel.internal.fs.Path
-
Returns the final component of this path.
- getName(String) - Static method in class io.delta.kernel.internal.fs.Path
-
- getName() - Method in class io.delta.kernel.types.StructField
-
- getNames() - Method in class io.delta.kernel.expressions.Column
-
- getNullCountColumn(Column) - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Given a logical column in the data schema provided when creating this, return
the corresponding NULL_COUNT column in the statistic schema that stores the null count values
for the provided logical column.
- getNullCounts() - Method in class io.delta.kernel.utils.DataFileStatistics
-
Get the number of nulls of columns in the data file.
- getNumberOfAddActions() - Method in class io.delta.kernel.internal.replay.CreateCheckpointIterator
-
Number of add files in the final checkpoint.
- getNumRecords() - Method in class io.delta.kernel.utils.DataFileStatistics
-
Get the number of records in the data file.
- getNumRecordsColumn() - Method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Returns the NUM_RECORDS column in the statistic schema
- getOffset() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getOperation() - Method in class io.delta.kernel.internal.actions.CommitInfo
-
- getOptions() - Method in class io.delta.kernel.internal.actions.Format
-
- getParent() - Method in class io.delta.kernel.internal.fs.Path
-
Returns the parent of a path or null if at root.
- getParquetHandler() - Method in interface io.delta.kernel.engine.Engine
-
- getPartitionColNames() - Method in class io.delta.kernel.internal.actions.Metadata
-
Set of lowercase partition column names
- getPartitionColumns() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getPartitionColumns(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getPartitionColumns(Engine) - Method in class io.delta.kernel.internal.TransactionImpl
-
- getPartitionColumns(Engine) - Method in interface io.delta.kernel.Transaction
-
Get the list of logical names of the partition columns.
- getPartitionColumnsList(Row) - Static method in class io.delta.kernel.internal.data.TransactionStateRow
-
- getPartitionValues() - Method in class io.delta.kernel.internal.DataWriteContextImpl
-
Returns the partition values for the data to be written.
- getPartitionValues(Row) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
Get the partition columns and values belonging to the AddFile from given scan file
row.
- getPartitionValuesParsedRefInAddFile(String) - Static method in class io.delta.kernel.internal.InternalScanFileUtils
-
Get a references column for given partition column name in partitionValues_parsed column in
scan file row.
- getPath() - Method in interface io.delta.kernel.engine.FileReadRequest
-
Get the fully qualified path of the file from which to read the data.
- getPath() - Method in class io.delta.kernel.internal.checkpoints.SidecarFile
-
- getPath(Engine) - Method in class io.delta.kernel.internal.TableImpl
-
- getPath(Engine) - Method in interface io.delta.kernel.Table
-
The fully qualified path of this
Table instance.
- getPath() - Method in class io.delta.kernel.utils.FileStatus
-
Get the path to the file.
- getPathOrInlineDv() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getPathWithoutSchemeAndAuthority(Path) - Static method in class io.delta.kernel.internal.fs.Path
-
Return a version of the given Path without the scheme information.
- getPhysicalDataReadSchema(Engine, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getPhysicalName(StructField) - Static method in class io.delta.kernel.internal.util.ColumnMapping
-
- getPhysicalSchema(Engine, Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getPrecision() - Method in class io.delta.kernel.types.DecimalType
-
- getPredicateEvaluator(StructType, Predicate) - Method in interface io.delta.kernel.engine.ExpressionHandler
-
- getProtocol() - Method in class io.delta.kernel.internal.replay.LogReplay
-
- getProtocol() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
-
- getProtocol() - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getProvider() - Method in class io.delta.kernel.internal.actions.Format
-
- getReaderFeatures() - Method in class io.delta.kernel.internal.actions.Protocol
-
- getReadLength() - Method in interface io.delta.kernel.engine.FileReadRequest
-
Get the length of the data to read from the file starting at the startOffset.
- getReferencedCols() - Method in class io.delta.kernel.internal.skipping.DataSkippingPredicate
-
- getRemainingFilter() - Method in class io.delta.kernel.internal.ScanImpl
-
- getRemainingFilter() - Method in interface io.delta.kernel.Scan
-
Get the remaining filter that is not guaranteed to be satisfied for the data Delta Kernel
returns.
- getRight() - Method in class io.delta.kernel.expressions.And
-
- getRight() - Method in class io.delta.kernel.expressions.Or
-
- getRight(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
-
Utility method to return the right child of the binary input expression
- getRows() - Method in interface io.delta.kernel.data.ColumnarBatch
-
- getRows() - Method in class io.delta.kernel.data.FilteredColumnarBatch
-
Iterator of rows that survived the filter.
- getScale() - Method in class io.delta.kernel.types.DecimalType
-
- getScanBuilder(Engine) - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getScanBuilder(Engine) - Method in interface io.delta.kernel.Snapshot
-
Create a scan builder to construct a
Scan to read data from this snapshot.
- getScanFiles(Engine) - Method in class io.delta.kernel.internal.ScanImpl
-
Get an iterator of data files in this version of scan that survived the predicate pruning.
- getScanFiles(Engine, boolean) - Method in class io.delta.kernel.internal.ScanImpl
-
Get an iterator of data files in this version of scan that survived the predicate pruning.
- getScanFiles(Engine) - Method in interface io.delta.kernel.Scan
-
Get an iterator of data files to scan.
- getScanState(Engine) - Method in class io.delta.kernel.internal.ScanImpl
-
- getScanState(Engine) - Method in interface io.delta.kernel.Scan
-
Get the scan state associated with the current scan.
- getSchema() - Method in interface io.delta.kernel.data.ColumnarBatch
-
- getSchema() - Method in interface io.delta.kernel.data.Row
-
- getSchema() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getSchema() - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getSchema() - Method in class io.delta.kernel.internal.data.GenericRow
-
- getSchema(Engine) - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getSchema(Engine) - Method in class io.delta.kernel.internal.TransactionImpl
-
- getSchema(Engine) - Method in interface io.delta.kernel.Snapshot
-
Get the schema of the table at this snapshot.
- getSchema(Engine) - Method in interface io.delta.kernel.Transaction
-
Get the schema of the table.
- getSchemaString() - Method in class io.delta.kernel.internal.actions.Metadata
-
- getSelectionVector() - Method in class io.delta.kernel.data.FilteredColumnarBatch
-
Optional selection vector containing one entry for each row in data indicating whether
a row is selected or not selected.
- getSetTxnOpt() - Method in class io.delta.kernel.internal.TransactionImpl
-
- getShort(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the short type value for rowId.
- getShort(int) - Method in interface io.delta.kernel.data.Row
-
Return short value of the column located at the given ordinal.
- getShort(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getShort(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getSingularElement(CloseableIterator<T>) - Static method in class io.delta.kernel.internal.util.InternalUtils
-
- getSingularRow(CloseableIterator<ColumnarBatch>) - Static method in class io.delta.kernel.internal.util.InternalUtils
-
Utility method to read at most one row from the given data
ColumnarBatch
iterator.
- getSize() - Method in interface io.delta.kernel.data.ArrayValue
-
The number of elements in the array
- getSize() - Method in interface io.delta.kernel.data.ColumnarBatch
-
- getSize() - Method in interface io.delta.kernel.data.ColumnVector
-
- getSize() - Method in interface io.delta.kernel.data.MapValue
-
The number of elements in the map
- getSize() - Method in class io.delta.kernel.internal.data.SelectionColumnVector
-
- getSize() - Method in class io.delta.kernel.utils.FileStatus
-
Get the size of the file in bytes.
- getSizeInBytes() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getSizeInBytes() - Method in class io.delta.kernel.internal.checkpoints.SidecarFile
-
- getSnapshotAsOfTimestamp(Engine, long) - Method in class io.delta.kernel.internal.TableImpl
-
- getSnapshotAsOfTimestamp(Engine, long) - Method in interface io.delta.kernel.Table
-
Get the snapshot of the table at the given timestamp.
- getSnapshotAsOfVersion(Engine, long) - Method in class io.delta.kernel.internal.TableImpl
-
- getSnapshotAsOfVersion(Engine, long) - Method in interface io.delta.kernel.Table
-
Get the snapshot at the given versionId.
- getSnapshotAt(Engine, long) - Method in class io.delta.kernel.internal.snapshot.SnapshotManager
-
Construct the snapshot for the given table at the version provided.
- getSnapshotForTimestamp(Engine, long) - Method in class io.delta.kernel.internal.snapshot.SnapshotManager
-
Construct the snapshot for the given table at the provided timestamp.
- getStartOffset() - Method in interface io.delta.kernel.engine.FileReadRequest
-
Get the start offset in the file from where to start reading the data.
- getStatistics() - Method in class io.delta.kernel.utils.DataFileStatus
-
Get the statistics of the data file encapsulated in this object.
- getStatisticsColumns() - Method in interface io.delta.kernel.DataWriteContext
-
Returns the list of
Column that the connector can optionally collect statistics.
- getStatisticsColumns() - Method in class io.delta.kernel.internal.DataWriteContextImpl
-
Returns the list of
Column that the connector can optionally collect statistics.
- getStatisticsColumns(Engine, Row) - Static method in class io.delta.kernel.internal.TransactionImpl
-
Get the part of the schema of the table that needs the statistics to be collected per file.
- getStatsSchema(StructType) - Static method in class io.delta.kernel.internal.skipping.StatsSchemaHelper
-
Returns the expected statistics schema given a table schema.
- getStorageType() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getString(int) - Method in interface io.delta.kernel.data.ColumnVector
-
Returns the string type value for rowId.
- getString(int) - Method in interface io.delta.kernel.data.Row
-
Return string value of the column located at the given ordinal.
- getString(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getString(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getStruct(int) - Method in interface io.delta.kernel.data.Row
-
Return struct value of the column located at the given ordinal.
- getStruct(int) - Method in class io.delta.kernel.internal.data.ChildVectorBasedRow
-
- getStruct(int) - Method in class io.delta.kernel.internal.data.GenericRow
-
- getTablePath() - Method in exception io.delta.kernel.exceptions.TableNotFoundException
-
- getTablePath(Row) - Static method in class io.delta.kernel.internal.data.TransactionStateRow
-
- getTableRoot(Row) - Static method in class io.delta.kernel.internal.data.ScanStateRow
-
- getTargetDirectory() - Method in interface io.delta.kernel.DataWriteContext
-
Returns the target directory where the data should be written.
- getTargetDirectory() - Method in class io.delta.kernel.internal.DataWriteContextImpl
-
Returns the target directory where the data should be written.
- getTargetDirectory(String, List<String>, Map<String, Literal>) - Static method in class io.delta.kernel.internal.util.PartitionUtils
-
Get the target directory for writing data for given partition values.
- getTimestamp() - Method in class io.delta.kernel.internal.actions.CommitInfo
-
- getTransactionState(Engine) - Method in class io.delta.kernel.internal.TransactionImpl
-
- getTransactionState(Engine) - Method in interface io.delta.kernel.Transaction
-
Get the state of the transaction.
- getUnaryChild(Expression) - Static method in class io.delta.kernel.internal.util.ExpressionUtils
-
Utility method to return the single child of the unary input expression
- getUniqueFileAction(ColumnVector, ColumnVector, int) - Static method in class io.delta.kernel.internal.replay.LogReplayUtils
-
- getUniqueId() - Method in class io.delta.kernel.internal.actions.DeletionVectorDescriptor
-
- getValue() - Method in class io.delta.kernel.expressions.Literal
-
Get the literal value.
- getValues() - Method in interface io.delta.kernel.data.MapValue
-
- getValueType() - Method in class io.delta.kernel.types.MapType
-
- getVersion() - Method in class io.delta.kernel.internal.actions.SetTransaction
-
- getVersion() - Method in class io.delta.kernel.internal.replay.DeltaLogFile
-
- getVersion() - Method in class io.delta.kernel.internal.snapshot.SnapshotHint
-
- getVersion(Engine) - Method in class io.delta.kernel.internal.SnapshotImpl
-
- getVersion(Engine) - Method in interface io.delta.kernel.Snapshot
-
Get the version of this snapshot in the table.
- getVersion() - Method in class io.delta.kernel.TransactionCommitResult
-
Contains the version of the transaction committed as.
- getWriteContext(Engine, Row, Map<String, Literal>) - Static method in interface io.delta.kernel.Transaction
-
Get the context for writing data into a table.
- getWriterFeatures() - Method in class io.delta.kernel.internal.actions.Protocol
-