- DAG_CONTENT - Static variable in class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DAG_INTERMITTENT_DELAY_MINS - Static variable in class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DAG_NAME - Static variable in class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DAG_ROUNDS - Static variable in class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DagNode<O> - Class in org.apache.hudi.integ.testsuite.dag.nodes
-
Base abstraction of an compute node in the DAG of operations for a workflow.
- DagNode() - Constructor for class org.apache.hudi.integ.testsuite.dag.nodes.DagNode
-
- DagScheduler - Class in org.apache.hudi.integ.testsuite.dag.scheduler
-
The Dag scheduler schedules the workflow DAGs.
- DagScheduler(WorkflowDag, WriterContext, JavaSparkContext) - Constructor for class org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler
-
- DagUtils - Class in org.apache.hudi.integ.testsuite.dag
-
Utility class to SerDe workflow dag.
- DagUtils() - Constructor for class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DEFAULT_DAG_NAME - Static variable in class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DEFAULT_DAG_ROUNDS - Static variable in class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DEFAULT_HOODIE_IS_DELETED_COL - Static variable in class org.apache.hudi.integ.testsuite.generator.GenericRecordFullPayloadGenerator
-
- DEFAULT_INTERMITTENT_DELAY_MINS - Static variable in class org.apache.hudi.integ.testsuite.dag.DagUtils
-
- DEFAULT_NUM_DATE_PARTITIONS - Static variable in class org.apache.hudi.integ.testsuite.generator.GenericRecordFullPayloadGenerator
-
- DEFAULT_PAYLOAD_SIZE - Static variable in class org.apache.hudi.integ.testsuite.generator.GenericRecordFullPayloadGenerator
-
- DEFAULT_START_PARTITION - Static variable in class org.apache.hudi.integ.testsuite.generator.GenericRecordFullPayloadGenerator
-
- DelayNode - Class in org.apache.hudi.integ.testsuite.dag.nodes
-
Delay Node to add delays between each group of test runs.
- DelayNode(int) - Constructor for class org.apache.hudi.integ.testsuite.dag.nodes.DelayNode
-
- DeleteConverter - Class in org.apache.hudi.integ.testsuite.converter
-
- DeleteConverter(String, int) - Constructor for class org.apache.hudi.integ.testsuite.converter.DeleteConverter
-
- DeleteGeneratorIterator - Class in org.apache.hudi.integ.testsuite.generator
-
Lazy delete record generator.
- DeleteGeneratorIterator(Iterator<GenericRecord>, String, int) - Constructor for class org.apache.hudi.integ.testsuite.generator.DeleteGeneratorIterator
-
- DeleteInputDatasetNode - Class in org.apache.hudi.integ.testsuite.dag.nodes
-
Deletes all input except latest batch.
- DeleteInputDatasetNode(DeltaConfig.Config) - Constructor for class org.apache.hudi.integ.testsuite.dag.nodes.DeleteInputDatasetNode
-
- DeleteNode - Class in org.apache.hudi.integ.testsuite.dag.nodes
-
Delete node to assist in issuing deletes.
- DeleteNode(DeltaConfig.Config) - Constructor for class org.apache.hudi.integ.testsuite.dag.nodes.DeleteNode
-
- deleteOldInput - Variable in class org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.HoodieTestSuiteConfig
-
- DeltaConfig - Class in org.apache.hudi.integ.testsuite.configuration
-
Configuration to hold the delta output type and delta input format.
- DeltaConfig(DeltaOutputMode, DeltaInputType, SerializableConfiguration) - Constructor for class org.apache.hudi.integ.testsuite.configuration.DeltaConfig
-
- DeltaConfig.Config - Class in org.apache.hudi.integ.testsuite.configuration
-
Represents any kind of workload operation for new data.
- DeltaConfig.Config.Builder - Class in org.apache.hudi.integ.testsuite.configuration
-
- DeltaGenerator - Class in org.apache.hudi.integ.testsuite.generator
-
The delta generator generates all types of workloads (insert, update) for the given configs.
- DeltaGenerator(DFSDeltaConfig, JavaSparkContext, SparkSession, String, BuiltinKeyGenerator) - Constructor for class org.apache.hudi.integ.testsuite.generator.DeltaGenerator
-
- DeltaInputReader<O> - Interface in org.apache.hudi.integ.testsuite.reader
-
Implementations of
DeltaInputReader will read the configured input type and provide an RDD of records to the
client.
- DeltaInputType - Enum in org.apache.hudi.integ.testsuite.reader
-
Supported delta input data types.
- DeltaInputWriter<I> - Interface in org.apache.hudi.integ.testsuite.writer
-
- DeltaOutputMode - Enum in org.apache.hudi.integ.testsuite.writer
-
Supported output destination types for the generated delta workload.
- deltaStreamerWrapper - Variable in class org.apache.hudi.integ.testsuite.HoodieTestSuiteWriter
-
- DeltaWriterAdapter<I> - Interface in org.apache.hudi.integ.testsuite.writer
-
Adapter use Delta Writer.
- DeltaWriterAdapter.SparkBasedDeltaWriter<J> - Interface in org.apache.hudi.integ.testsuite.writer
-
- DeltaWriterFactory - Class in org.apache.hudi.integ.testsuite.writer
-
- DeltaWriteStats - Class in org.apache.hudi.integ.testsuite.writer
-
- DeltaWriteStats() - Constructor for class org.apache.hudi.integ.testsuite.writer.DeltaWriteStats
-
- deltaWriteStatsRDD - Variable in class org.apache.hudi.integ.testsuite.dag.nodes.InsertNode
-
- DEPENDENCIES - Static variable in class org.apache.hudi.integ.testsuite.configuration.DeltaConfig.Config
-
- DFSAvroDeltaInputReader - Class in org.apache.hudi.integ.testsuite.reader
-
- DFSAvroDeltaInputReader(SparkSession, String, String, Option<String>, Option<String>) - Constructor for class org.apache.hudi.integ.testsuite.reader.DFSAvroDeltaInputReader
-
- DFSDeltaConfig - Class in org.apache.hudi.integ.testsuite.configuration
-
Configuration to hold details about a DFS based output type, implements
DeltaConfig.
- DFSDeltaConfig(DeltaOutputMode, DeltaInputType, SerializableConfiguration, String, String, String, Long, int, boolean, boolean) - Constructor for class org.apache.hudi.integ.testsuite.configuration.DFSDeltaConfig
-
- DFSDeltaInputReader - Class in org.apache.hudi.integ.testsuite.reader
-
This class helps to estimate the number of files to read a given number of total records.
- DFSDeltaInputReader() - Constructor for class org.apache.hudi.integ.testsuite.reader.DFSDeltaInputReader
-
- DFSDeltaWriterAdapter - Class in org.apache.hudi.integ.testsuite.writer
-
DistributedFileSystem (or LocalFileSystem) based delta generator.
- DFSDeltaWriterAdapter(DeltaInputWriter<GenericRecord>, int) - Constructor for class org.apache.hudi.integ.testsuite.writer.DFSDeltaWriterAdapter
-
- DFSDeltaWriterAdapter(DeltaInputWriter<GenericRecord>) - Constructor for class org.apache.hudi.integ.testsuite.writer.DFSDeltaWriterAdapter
-
- DFSHoodieDatasetInputReader - Class in org.apache.hudi.integ.testsuite.reader
-
This class helps to generate updates from an already existing hoodie dataset.
- DFSHoodieDatasetInputReader(JavaSparkContext, String, String) - Constructor for class org.apache.hudi.integ.testsuite.reader.DFSHoodieDatasetInputReader
-
- DFSSparkAvroDeltaWriter - Class in org.apache.hudi.integ.testsuite.writer
-
NEED TO IMPLEMENT A CUSTOM SPARK PARTITIONER TO ENSURE WE WRITE LARGE ENOUGH AVRO FILES.
- DFSSparkAvroDeltaWriter(DeltaInputWriter<JavaRDD<GenericRecord>>) - Constructor for class org.apache.hudi.integ.testsuite.writer.DFSSparkAvroDeltaWriter
-
- DFSTestSuitePathSelector - Class in org.apache.hudi.integ.testsuite.helpers
-
A custom dfs path selector used only for the hudi test suite.
- DFSTestSuitePathSelector(TypedProperties, Configuration) - Constructor for class org.apache.hudi.integ.testsuite.helpers.DFSTestSuitePathSelector
-
- disableGenerate(boolean) - Method in class org.apache.hudi.integ.testsuite.configuration.DeltaConfig.Config.Builder
-
- disableIngest(boolean) - Method in class org.apache.hudi.integ.testsuite.configuration.DeltaConfig.Config.Builder
-