io.delta.kernel.internal.snapshot

Class LogSegment

Object

io.delta.kernel.internal.snapshot.LogSegment

public class LogSegment
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
java.util.List<FileStatus>	checkpoints
java.util.Optional<Long>	checkpointVersionOpt
java.util.List<FileStatus>	deltas
long	lastCommitTimestamp
Path	logPath
long	version

Constructor Summary

Constructors

Constructor and Description
LogSegment(Path logPath, long version, java.util.List<FileStatus> deltas, java.util.List<FileStatus> checkpoints, java.util.Optional<Long> checkpointVersionOpt, long lastCommitTimestamp) Provides information around which files in the transaction log need to be read to create the given version of the log.

Method Summary

Modifier and Type	Method and Description
java.util.List<FileStatus>	allLogFilesReversed()
java.util.List<FileStatus>	allLogFilesUnsorted()
static LogSegment	empty(Path logPath)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

logPath

public final Path logPath

version

public final long version

deltas

public final java.util.List<FileStatus> deltas

checkpoints

public final java.util.List<FileStatus> checkpoints

checkpointVersionOpt

public final java.util.Optional<Long> checkpointVersionOpt

lastCommitTimestamp

public final long lastCommitTimestamp

Constructor Detail

LogSegment

public LogSegment(Path logPath,
                  long version,
                  java.util.List<FileStatus> deltas,
                  java.util.List<FileStatus> checkpoints,
                  java.util.Optional<Long> checkpointVersionOpt,
                  long lastCommitTimestamp)

Provides information around which files in the transaction log need to be read to create the given version of the log.

Parameters:

logPath - The path to the _delta_log directory

version - The Snapshot version to generate

deltas - The delta commit files (.json) to read

checkpoints - The checkpoint file(s) to read

checkpointVersionOpt - The checkpoint version used to start replay

lastCommitTimestamp - The "unadjusted" timestamp of the last commit within this segment. By unadjusted, we mean that the commit timestamps may not necessarily be monotonically increasing for the commits within this segment.

Method Detail

empty

public static LogSegment empty(Path logPath)

allLogFilesUnsorted

public java.util.List<FileStatus> allLogFilesUnsorted()

Returns:

all deltas (.json) and checkpoint (.checkpoint.parquet) files in this LogSegment, with no ordering guarantees.

allLogFilesReversed

public java.util.List<FileStatus> allLogFilesReversed()

Returns:

all deltas (.json) and checkpoint (.checkpoint.parquet) files in this LogSegment, sorted in reverse (00012.json, 00011.json, 00010.checkpoint.parquet) order.