Package io.delta.storage
package io.delta.storage
-
ClassDescriptionLogStore implementation for Azure.:: DeveloperApi :: An iterator that may contain resources which should be released after use.The
LogStoreimplementation for GCS, which uses gcs-connector to provide the necessary atomic and durability guarantees: Atomic Visibility: Read/read-after-metadata-update/delete are strongly consistent for GCS. Consistent Listing: GCS guarantees strong consistency for both object and bucket listing operations.Default implementation ofLogStorefor HadoopFileSystemimplementations.TheLogStoreimplementation for HDFS, which uses HadoopFileContextAPI's to provide the necessary atomic and durability guarantees: Atomic visibility of files: `FileContext.rename` is used write files which is atomic for HDFS. Consistent file listing: HDFS file listing is consistent.Turn aReadertoCloseableIteratorwhich can be read on demand.DefaultLogStoreimplementation (should be used for testing only!).:: DeveloperApi ::Single Spark-driver/JVM LogStore implementation for S3.