Package io.delta.kernel.internal

Class TableConfig<T>

Object
io.delta.kernel.internal.TableConfig<T>
public class TableConfig<T> extends Object
Represents the table properties. Also provides methods to access the property values from the table metadata.

  • Field Details

    • TOMBSTONE_RETENTION

      public static final TableConfig<Long> TOMBSTONE_RETENTION
      The shortest duration we have to keep logically deleted data files around before deleting them physically. Note: this value should be large enough:
      • It should be larger than the longest possible duration of a job if you decide to run "VACUUM" when there are concurrent readers or writers accessing the table.
      • If you are running a streaming query reading from the table, you should make sure the query doesn't stop longer than this value. Otherwise, the query may not be able to restart as it still needs to read old files.

    • CHECKPOINT_INTERVAL

      public static final TableConfig<Integer> CHECKPOINT_INTERVAL
      How often to checkpoint the delta log? For every N (this config) commits to the log, we will suggest write out a checkpoint file that can speed up the Delta table state reconstruction.

  • Method Details

    • fromMetadata

      public T fromMetadata(Metadata metadata)
      Returns the value of the table property from the given metadata.
      Parameters:
      metadata - the table metadata
      Returns:
      the value of the table property