DeltaConfig.Config (hudi-integ-test 0.12.3 API)

java.lang.Object
- org.apache.hudi.integ.testsuite.configuration.DeltaConfig.Config

Enclosing class:

DeltaConfig
```
public static class DeltaConfig.Config
extends Object
```
Represents any kind of workload operation for new data. Each workload also contains a set of Option sequence of actions that can be executed in parallel.

Nested Class Summary

Nested Classes
Modifier and Type Class and Description

static class DeltaConfig.Config.Builder

Nested Classes
Modifier and Type	Class and Description
`static class`	`DeltaConfig.Config.Builder`

Field Summary

Fields
Modifier and Type	Field and Description
`static String`	`CHILDREN`
`static String`	`CONFIG_NAME`
`static String`	`DEPENDENCIES`
`static String`	`HIVE_PROPERTIES`
`static String`	`HIVE_QUERIES`
`static String`	`NO_DEPENDENCY_VALUE`
`static String`	`NODE_NAME`
`static String`	`PRESTO_PROPERTIES`
`static String`	`PRESTO_QUERIES`
`static String`	`TRINO_PROPERTIES`
`static String`	`TRINO_QUERIES`
`static String`	`TYPE`

Constructor Summary

Constructors
Constructor and Description

Config(Map<String,Object> configsMap)

Constructors
Constructor and Description
`Config(Map<String,Object> configsMap)`

Method Summary

All Methods Static Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`boolean`	`enableRowWriting()`
`double`	`getFractionUpsertPerFile()`
`List<String>`	`getHiveProperties()`
`List<org.apache.hudi.common.util.collection.Pair<String,Integer>>`	`getHiveQueries()`
`int`	`getIterationCountToExecute()`
`String`	`getMatchedAction()`
`String`	`getMergeCondition()`
`String`	`getNotMatchedAction()`
`int`	`getNumDeletePartitions()`
`int`	`getNumInsertPartitions()`
`long`	`getNumRecordsDelete()`
`long`	`getNumRecordsInsert()`
`long`	`getNumRecordsUpsert()`
`int`	`getNumRollbacks()`
`int`	`getNumUpsertFiles()`
`int`	`getNumUpsertPartitions()`
`Map<String,Object>`	`getOtherConfigs()`
`org.apache.hudi.common.util.Option<String>`	`getPartitionField()`
`String`	`getPartitionsToDelete()`
`org.apache.hudi.common.util.Option<String>`	`getPreCombineField()`
`List<String>`	`getPrestoProperties()`
`List<org.apache.hudi.common.util.collection.Pair<String,Integer>>`	`getPrestoQueries()`
`org.apache.hudi.common.util.Option<String>`	`getPrimaryKey()`
`double`	`getRatioRecordsChange()`
`int`	`getRecordSize()`
`boolean`	`getReinitContext()`
`int`	`getRepeatCount()`
`int`	`getSchemaVersion()`
`int`	`getStartPartition()`
`org.apache.hudi.common.util.Option<String>`	`getTableType()`
`List<String>`	`getTrinoProperties()`
`List<org.apache.hudi.common.util.collection.Pair<String,Integer>>`	`getTrinoQueries()`
`String`	`getUpdateColumn()`
`String`	`getWhereConditionColumn()`
`String`	`inputPartitonsToSkipWithValidate()`
`boolean`	`isDeleteInputData()`
`boolean`	`isDeleteInputDataExceptLatest()`
`boolean`	`isDisableGenerate()`
`boolean`	`isDisableIngest()`
`boolean`	`isEnableMetadataValidate()`
`boolean`	`isHiveLocal()`
`boolean`	`isTableExternal()`
`boolean`	`isValidateFullData()`
`boolean`	`isValidateHive()`
`long`	`maxWaitTimeForDeltastreamerToCatchupMs()`
`static DeltaConfig.Config.Builder`	`newBuilder()`
`boolean`	`shouldUseCtas()`
`String`	`toString()`
`boolean`	`validateArchival()`
`boolean`	`validateClean()`
`int`	`validateOnceEveryIteration()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

CONFIG_NAME
```
public static final String CONFIG_NAME
```
See Also:

Constant Field Values

TYPE
```
public static final String TYPE
```
See Also:

Constant Field Values

NODE_NAME
```
public static final String NODE_NAME
```
See Also:

Constant Field Values

DEPENDENCIES

public static final String DEPENDENCIES

See Also:: Constant Field Values

NO_DEPENDENCY_VALUE

public static final String NO_DEPENDENCY_VALUE

See Also:: Constant Field Values

CHILDREN
```
public static final String CHILDREN
```
See Also:

Constant Field Values

HIVE_QUERIES

public static final String HIVE_QUERIES

See Also:: Constant Field Values

HIVE_PROPERTIES

public static final String HIVE_PROPERTIES

See Also:: Constant Field Values

PRESTO_QUERIES

public static final String PRESTO_QUERIES

See Also:: Constant Field Values

PRESTO_PROPERTIES

public static final String PRESTO_PROPERTIES

See Also:: Constant Field Values

TRINO_QUERIES

public static final String TRINO_QUERIES

See Also:: Constant Field Values

TRINO_PROPERTIES

public static final String TRINO_PROPERTIES

See Also:: Constant Field Values

Constructor Detail

Config

public Config(Map<String,Object> configsMap)

Method Detail

newBuilder

public static DeltaConfig.Config.Builder newBuilder()

getNumRecordsInsert
```
public long getNumRecordsInsert()
```

getNumRecordsUpsert
```
public long getNumRecordsUpsert()
```

getNumRecordsDelete
```
public long getNumRecordsDelete()
```

getRecordSize
```
public int getRecordSize()
```

isEnableMetadataValidate

public boolean isEnableMetadataValidate()

getNumInsertPartitions
```
public int getNumInsertPartitions()
```

getRepeatCount
```
public int getRepeatCount()
```

getNumUpsertPartitions
```
public int getNumUpsertPartitions()
```

getSchemaVersion
```
public int getSchemaVersion()
```

getNumRollbacks
```
public int getNumRollbacks()
```

getStartPartition
```
public int getStartPartition()
```

getNumDeletePartitions
```
public int getNumDeletePartitions()
```

getNumUpsertFiles
```
public int getNumUpsertFiles()
```

getFractionUpsertPerFile

public double getFractionUpsertPerFile()

isDisableGenerate
```
public boolean isDisableGenerate()
```

isDisableIngest
```
public boolean isDisableIngest()
```

getPartitionsToDelete
```
public String getPartitionsToDelete()
```

getReinitContext
```
public boolean getReinitContext()
```

isDeleteInputData
```
public boolean isDeleteInputData()
```

isDeleteInputDataExceptLatest

public boolean isDeleteInputDataExceptLatest()

isValidateHive
```
public boolean isValidateHive()
```

validateOnceEveryIteration

public int validateOnceEveryIteration()

inputPartitonsToSkipWithValidate

public String inputPartitonsToSkipWithValidate()

isValidateFullData
```
public boolean isValidateFullData()
```

getIterationCountToExecute

public int getIterationCountToExecute()

validateArchival
```
public boolean validateArchival()
```

validateClean
```
public boolean validateClean()
```

enableRowWriting
```
public boolean enableRowWriting()
```

maxWaitTimeForDeltastreamerToCatchupMs

public long maxWaitTimeForDeltastreamerToCatchupMs()

getTableType

public org.apache.hudi.common.util.Option<String> getTableType()

shouldUseCtas
```
public boolean shouldUseCtas()
```

isTableExternal
```
public boolean isTableExternal()
```

getPrimaryKey

public org.apache.hudi.common.util.Option<String> getPrimaryKey()

getPreCombineField

public org.apache.hudi.common.util.Option<String> getPreCombineField()

getPartitionField

public org.apache.hudi.common.util.Option<String> getPartitionField()

getMergeCondition
```
public String getMergeCondition()
```

getMatchedAction
```
public String getMatchedAction()
```

getNotMatchedAction
```
public String getNotMatchedAction()
```

getUpdateColumn
```
public String getUpdateColumn()
```

getWhereConditionColumn

public String getWhereConditionColumn()

getRatioRecordsChange
```
public double getRatioRecordsChange()
```

getOtherConfigs

public Map<String,Object> getOtherConfigs()

getHiveQueries

public List<org.apache.hudi.common.util.collection.Pair<String,Integer>> getHiveQueries()

isHiveLocal
```
public boolean isHiveLocal()
```

getHiveProperties

public List<String> getHiveProperties()

getPrestoProperties

public List<String> getPrestoProperties()

getTrinoProperties

public List<String> getTrinoProperties()

getPrestoQueries

public List<org.apache.hudi.common.util.collection.Pair<String,Integer>> getPrestoQueries()

getTrinoQueries

public List<org.apache.hudi.common.util.collection.Pair<String,Integer>> getTrinoQueries()

toString
```
public String toString()
```
Overrides:

toString in class Object

Class DeltaConfig.Config

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

CONFIG_NAME

TYPE

NODE_NAME

DEPENDENCIES

NO_DEPENDENCY_VALUE

CHILDREN

HIVE_QUERIES

HIVE_PROPERTIES

PRESTO_QUERIES

PRESTO_PROPERTIES

TRINO_QUERIES

TRINO_PROPERTIES

Constructor Detail

Config

Method Detail

newBuilder

getNumRecordsInsert

getNumRecordsUpsert

getNumRecordsDelete

getRecordSize

isEnableMetadataValidate

getNumInsertPartitions

getRepeatCount

getNumUpsertPartitions

getSchemaVersion

getNumRollbacks

getStartPartition

getNumDeletePartitions

getNumUpsertFiles

getFractionUpsertPerFile

isDisableGenerate

isDisableIngest

getPartitionsToDelete

getReinitContext

isDeleteInputData

isDeleteInputDataExceptLatest

isValidateHive

validateOnceEveryIteration

inputPartitonsToSkipWithValidate

isValidateFullData

getIterationCountToExecute

validateArchival

validateClean

enableRowWriting

maxWaitTimeForDeltastreamerToCatchupMs

getTableType

shouldUseCtas

isTableExternal

getPrimaryKey

getPreCombineField

getPartitionField

getMergeCondition

getMatchedAction

getNotMatchedAction

getUpdateColumn

getWhereConditionColumn

getRatioRecordsChange

getOtherConfigs

getHiveQueries

isHiveLocal

getHiveProperties

getPrestoProperties

getTrinoProperties

getPrestoQueries

getTrinoQueries

toString