public class DeltaLogActionUtils
extends Object
| Modifier and Type | Class and Description |
|---|---|
static class |
DeltaLogActionUtils.DeltaAction
Represents a Delta action.
|
| Modifier and Type | Method and Description |
|---|---|
static java.util.List<FileStatus> |
getCommitFilesForVersionRange(Engine engine,
Path tablePath,
long startVersion,
long endVersion)
For a table get the list of commit log files for the provided version range.
|
static CloseableIterator<ColumnarBatch> |
readCommitFiles(Engine engine,
java.util.List<FileStatus> commitFiles,
StructType readSchema)
Read the given commitFiles and return the contents as an iterator of batches.
|
public static java.util.List<FileStatus> getCommitFilesForVersionRange(Engine engine, Path tablePath, long startVersion, long endVersion)
tablePath - path for the given tablestartVersion - start version of the range (inclusive)endVersion - end version of the range (inclusive)TableNotFoundException - if the table does not exist or if it is not a delta tableKernelException - if a commit file does not exist for any of the versions in the provided
rangeKernelException - if provided an invalid version rangepublic static CloseableIterator<ColumnarBatch> readCommitFiles(Engine engine, java.util.List<FileStatus> commitFiles, StructType readSchema)
LongTypecommitFiles - list of delta commit files to readreadSchema - JSON schema to read