io.delta.kernel.internal

Class TableConfig<T>

Object

io.delta.kernel.internal.TableConfig<T>

public class TableConfig<T>
extends Object

Represents the table properties. Also provides methods to access the property values from the table metadata.

Field Summary

Fields

Modifier and Type	Field and Description
static TableConfig<Integer>	CHECKPOINT_INTERVAL How often to checkpoint the delta log? For every N (this config) commits to the log, we will suggest write out a checkpoint file that can speed up the Delta table state reconstruction.
static TableConfig<Long>	TOMBSTONE_RETENTION The shortest duration we have to keep logically deleted data files around before deleting them physically.

Method Summary

Modifier and Type	Method and Description
T	fromMetadata(Metadata metadata) Returns the value of the table property from the given metadata.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TOMBSTONE_RETENTION

public static final TableConfig<Long> TOMBSTONE_RETENTION

The shortest duration we have to keep logically deleted data files around before deleting them physically. Note: this value should be large enough:

• It should be larger than the longest possible duration of a job if you decide to run "VACUUM" when there are concurrent readers or writers accessing the table.
• If you are running a streaming query reading from the table, you should make sure the query doesn't stop longer than this value. Otherwise, the query may not be able to restart as it still needs to read old files.

CHECKPOINT_INTERVAL

public static final TableConfig<Integer> CHECKPOINT_INTERVAL

How often to checkpoint the delta log? For every N (this config) commits to the log, we will suggest write out a checkpoint file that can speed up the Delta table state reconstruction.

Method Detail

fromMetadata

public T fromMetadata(Metadata metadata)

Returns the value of the table property from the given metadata.

Parameters:

metadata - the table metadata

Returns:

the value of the table property