io.delta.kernel.internal.snapshot

Class SnapshotManager

java.lang.Object

io.delta.kernel.internal.snapshot.SnapshotManager

All Implemented Interfaces:

Logging

public class SnapshotManager
extends java.lang.Object
implements Logging

Constructor Summary

Constructors

Constructor and Description
SnapshotManager()

Method Summary

Modifier and Type	Method and Description
Snapshot	buildLatestSnapshot(TableClient tableClient, Path logPath, Path dataPath) Construct the latest snapshot for given table.
protected java.util.Optional<java.util.List<FileStatus>>	listDeltaAndCheckpointFiles(Path logPath, TableClient tableClient, long startVersion, java.util.Optional<java.lang.Long> versionToLoad) Returns the delta files and checkpoint files starting from the given `startVersion`.
static void	verifyDeltaVersions(java.util.List<java.lang.Long> versions, java.util.Optional<java.lang.Long> expectedStartVersion, java.util.Optional<java.lang.Long> expectedEndVersion) - Verify the versions are contiguous.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.delta.kernel.internal.util.Logging

logDebug, logDebug, logInfo, logInfo

Constructor Detail

SnapshotManager

public SnapshotManager()

Method Detail

buildLatestSnapshot

public Snapshot buildLatestSnapshot(TableClient tableClient,
                                    Path logPath,
                                    Path dataPath)
                             throws TableNotFoundException

Construct the latest snapshot for given table.

Parameters:

tableClient - Instance of TableClient to use.

logPath - Where the Delta log files are located.

dataPath - Where the Delta data files are located.

Returns:

Throws:

TableNotFoundException

listDeltaAndCheckpointFiles

protected final java.util.Optional<java.util.List<FileStatus>> listDeltaAndCheckpointFiles(Path logPath,
                                                                                           TableClient tableClient,
                                                                                           long startVersion,
                                                                                           java.util.Optional<java.lang.Long> versionToLoad)

Returns the delta files and checkpoint files starting from the given `startVersion`. `versionToLoad` is an optional parameter to set the max bound. It's usually used to load a table snapshot for a specific version.

Parameters:

startVersion - the version to start. Inclusive.

versionToLoad - the optional parameter to set the max version we should return. Inclusive.

Returns:

Some array of files found (possibly empty, if no usable commit files are present), or None if the listing returned no files at all.

verifyDeltaVersions

public static void verifyDeltaVersions(java.util.List<java.lang.Long> versions,
                                       java.util.Optional<java.lang.Long> expectedStartVersion,
                                       java.util.Optional<java.lang.Long> expectedEndVersion)

- Verify the versions are contiguous. - Verify the versions start with `expectedStartVersion` if it's specified. - Verify the versions end with `expectedEndVersion` if it's specified.