io.delta.kernel.internal

Class DeltaHistoryManager

Object

io.delta.kernel.internal.DeltaHistoryManager

public final class DeltaHistoryManager
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DeltaHistoryManager.Commit

Method Summary

Modifier and Type	Method and Description
static DeltaHistoryManager.Commit	getActiveCommitAtTimestamp(Engine engine, Path logPath, long timestamp, boolean mustBeRecreatable, boolean canReturnLastCommit, boolean canReturnEarliestCommit) Returns the latest commit that happened at or before timestamp.
static long	getEarliestDeltaFile(Engine engine, Path logPath) Get the earliest commit available for this table.
static long	getEarliestRecreatableCommit(Engine engine, Path logPath) Gets the earliest commit that we can recreate.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getActiveCommitAtTimestamp

public static DeltaHistoryManager.Commit getActiveCommitAtTimestamp(Engine engine,
                                                                    Path logPath,
                                                                    long timestamp,
                                                                    boolean mustBeRecreatable,
                                                                    boolean canReturnLastCommit,
                                                                    boolean canReturnEarliestCommit)
                                                             throws TableNotFoundException

Returns the latest commit that happened at or before timestamp.

If the timestamp is outside the range of [earliestCommit, latestCommit] then use parameters canReturnLastCommit and canReturnEarliestCommit to control whether an exception is thrown or the corresponding earliest/latest commit is returned.

Parameters:

engine - instance of Engine to use

logPath - the _delta_log path of the table

timestamp - the timestamp find the version for in milliseconds since the unix epoch

mustBeRecreatable - whether the state at the returned commit should be recreatable

canReturnLastCommit - whether we can return the latest version of the table if the provided timestamp is after the latest commit

canReturnEarliestCommit - whether we can return the earliest version of the table if the provided timestamp is before the earliest commit

Throws:

KernelException - if the provided timestamp is before the earliest commit and canReturnEarliestCommit is false

KernelException - if the provided timestamp is after the latest commit and canReturnLastCommit is false

TableNotFoundException - when there is no Delta table at the given path

getEarliestRecreatableCommit

public static long getEarliestRecreatableCommit(Engine engine,
                                                Path logPath)
                                         throws TableNotFoundException

Gets the earliest commit that we can recreate. Note that this version isn't guaranteed to exist when performing an action as a concurrent operation can delete the file during cleanup. This value must be used as a lower bound.

We search for the earliest checkpoint we have, or whether we have the 0th delta file. This method assumes that the commits are contiguous.

Throws:

TableNotFoundException

getEarliestDeltaFile

public static long getEarliestDeltaFile(Engine engine,
                                        Path logPath)
                                 throws TableNotFoundException

Get the earliest commit available for this table. Note that this version isn't guaranteed to exist when performing an action as a concurrent operation can delete the file during cleanup. This value must be used as a lower bound.

Throws:

TableNotFoundException