All Classes and Interfaces
Class
Description
LogStore implementation for Azure.
:: DeveloperApi ::
An iterator that may contain resources which should be released after use.
Helper for misc functions relating to file names for delta commits.
The
LogStore implementation for GCS, which uses gcs-connector to
provide the necessary atomic and durability guarantees:
Atomic Visibility: Read/read-after-metadata-update/delete are strongly
consistent for GCS.
Consistent Listing: GCS guarantees strong consistency for both object and
bucket listing operations.Default implementation of
LogStore for Hadoop FileSystem implementations.The
LogStore implementation for HDFS, which uses Hadoop FileContext API's to
provide the necessary atomic and durability guarantees:
Atomic visibility of files: `FileContext.rename` is used write files which is atomic for
HDFS.
Consistent file listing: HDFS file listing is consistent.
Turn a
Reader to CloseableIterator which can be read on demand.Default
LogStore implementation (should be used for testing only!).:: DeveloperApi ::
A lock that provides per-file-path `acquire` and `release` semantics.
Static utility methods for the S3SingleDriverLogStore.
Single Spark-driver/JVM LogStore implementation for S3.