org.apache.hudi.integ.testsuite.dag.nodes

类 ValidateDatasetNode

java.lang.Object

org.apache.hudi.integ.testsuite.dag.nodes.DagNode<Boolean>

org.apache.hudi.integ.testsuite.dag.nodes.BaseValidateDatasetNode

org.apache.hudi.integ.testsuite.dag.nodes.ValidateDatasetNode

所有已实现的接口:

Comparable<DagNode<Boolean>>

public class ValidateDatasetNode
extends BaseValidateDatasetNode

This validation node uses spark datasource for comparison purposes.

字段概要

从类继承的字段 org.apache.hudi.integ.testsuite.dag.nodes.DagNode

childNodes, config, parentNodes, result

构造器概要

构造器

构造器和说明
ValidateDatasetNode(DeltaConfig.Config config)

方法概要

限定符和类型	方法和说明
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	getDatasetToValidate(org.apache.spark.sql.SparkSession session, ExecutionContext context, org.apache.spark.sql.types.StructType inputSchema)
org.slf4j.Logger	getLogger()

从类继承的方法 org.apache.hudi.integ.testsuite.dag.nodes.BaseValidateDatasetNode

execute

从类继承的方法 org.apache.hudi.integ.testsuite.dag.nodes.DagNode

addChildNode, addParentNode, clone, compareTo, equals, getChildNodes, getConfig, getName, getParentNodes, getResult, hashCode, isCompleted, setCompleted, setParentNodes

从类继承的方法 java.lang.Object

finalize, getClass, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

ValidateDatasetNode

public ValidateDatasetNode(DeltaConfig.Config config)

方法详细资料

getLogger

public org.slf4j.Logger getLogger()

指定者:

getLogger 在类中 BaseValidateDatasetNode

返回:

Logger instance to use.

getDatasetToValidate

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> getDatasetToValidate(org.apache.spark.sql.SparkSession session,
                                                                                   ExecutionContext context,
                                                                                   org.apache.spark.sql.types.StructType inputSchema)

指定者:

getDatasetToValidate 在类中 BaseValidateDatasetNode

参数:

session - SparkSession instance to use.

context - ExecutionContext instance to use.

inputSchema - input schema in StructType

返回:

data in Dataset to validate.