public class TableConfig<T>
extends Object
| Modifier and Type | Field and Description |
|---|---|
static TableConfig<Integer> |
CHECKPOINT_INTERVAL
How often to checkpoint the delta log? For every N (this config) commits to the log, we will
suggest write out a checkpoint file that can speed up the Delta table state reconstruction.
|
static TableConfig<Long> |
COLUMN_MAPPING_MAX_COLUMN_ID
This table property is used to control the maximum column mapping ID.
|
static TableConfig<ColumnMapping.ColumnMappingMode> |
COLUMN_MAPPING_MODE
This table property is used to control the column mapping mode.
|
static TableConfig<java.util.Map<String,String>> |
COORDINATED_COMMITS_COORDINATOR_CONF |
static TableConfig<java.util.Optional<String>> |
COORDINATED_COMMITS_COORDINATOR_NAME |
static TableConfig<java.util.Map<String,String>> |
COORDINATED_COMMITS_TABLE_CONF |
static TableConfig<Boolean> |
EXPIRED_LOG_CLEANUP_ENABLED
Whether to clean up expired checkpoints and delta logs.
|
static TableConfig<Boolean> |
ICEBERG_COMPAT_V2_ENABLED
Table property that enables modifying the table in accordance with the Delta-Iceberg
Compatibility V2 protocol.
|
static TableConfig<java.util.Optional<Long>> |
IN_COMMIT_TIMESTAMP_ENABLEMENT_TIMESTAMP
This table property is used to track the timestamp at which
inCommitTimestamps were
enabled. |
static TableConfig<java.util.Optional<Long>> |
IN_COMMIT_TIMESTAMP_ENABLEMENT_VERSION
This table property is used to track the version of the table at which
inCommitTimestamps were enabled. |
static TableConfig<Boolean> |
IN_COMMIT_TIMESTAMPS_ENABLED
This table property is used to track the enablement of the
inCommitTimestamps. |
static TableConfig<Long> |
LOG_RETENTION
The shortest duration we have to keep delta/checkpoint files around before deleting them.
|
static TableConfig<Long> |
TOMBSTONE_RETENTION
The shortest duration we have to keep logically deleted data files around before deleting them
physically.
|
| Modifier and Type | Method and Description |
|---|---|
T |
fromMetadata(java.util.Map<String,String> configuration)
Returns the value of the table property from the given configuration.
|
T |
fromMetadata(Metadata metadata)
Returns the value of the table property from the given metadata.
|
String |
getKey()
Returns the key of the table property.
|
static java.util.Map<String,String> |
validateProperties(java.util.Map<String,String> configurations)
Validates that the given properties have the delta prefix in the key name, and they are in the
set of valid properties.
|
public static final TableConfig<Long> TOMBSTONE_RETENTION
Note: this value should be large enough:
public static final TableConfig<Integer> CHECKPOINT_INTERVAL
public static final TableConfig<Long> LOG_RETENTION
public static final TableConfig<Boolean> EXPIRED_LOG_CLEANUP_ENABLED
public static final TableConfig<Boolean> IN_COMMIT_TIMESTAMPS_ENABLED
inCommitTimestamps.
When enabled, commit metadata includes a monotonically increasing timestamp that allows for reliable TIMESTAMP AS OF time travel even if filesystem operations change a commit file's modification timestamp.
public static final TableConfig<java.util.Optional<Long>> IN_COMMIT_TIMESTAMP_ENABLEMENT_VERSION
inCommitTimestamps were enabled.public static final TableConfig<java.util.Optional<Long>> IN_COMMIT_TIMESTAMP_ENABLEMENT_TIMESTAMP
inCommitTimestamps were
enabled. More specifically, it is the inCommitTimestamps of the commit with the version
specified in IN_COMMIT_TIMESTAMP_ENABLEMENT_VERSION.public static final TableConfig<java.util.Optional<String>> COORDINATED_COMMITS_COORDINATOR_NAME
public static final TableConfig<java.util.Map<String,String>> COORDINATED_COMMITS_COORDINATOR_CONF
public static final TableConfig<java.util.Map<String,String>> COORDINATED_COMMITS_TABLE_CONF
public static final TableConfig<ColumnMapping.ColumnMappingMode> COLUMN_MAPPING_MODE
public static final TableConfig<Long> COLUMN_MAPPING_MAX_COLUMN_ID
public static final TableConfig<Boolean> ICEBERG_COMPAT_V2_ENABLED
public static java.util.Map<String,String> validateProperties(java.util.Map<String,String> configurations)
configurations - the properties to validateInvalidConfigurationValueException - if any of the properties are invalidUnknownConfigurationException - if any of the properties are unknownpublic T fromMetadata(Metadata metadata)
metadata - the table metadatapublic T fromMetadata(java.util.Map<String,String> configuration)
configuration - the table configurationpublic String getKey()