程序包 com.baidubce.services.bmr.model

类 SparkStepConfig

java.lang.Object

com.baidubce.services.bmr.model.StepConfig

com.baidubce.services.bmr.model.SparkStepConfig

public class SparkStepConfig
extends StepConfig

Represent configuration for a spark step.

A spark step can be configured with name, actionOnFailure, jar, submitOptions and arguments. The essential options are mapper, input, output and actionOnFailure, and the optional ones are name and arguments.

构造器概要

构造器

构造器	说明
SparkStepConfig()

方法概要

修饰符和类型	方法	说明
SparkStepConfig	withActionOnFailure(String actionOnFailure)	Configure the action on failure for the java step.
SparkStepConfig	withAdditionalFile(String remote, String local)	Configure the additional file for the step.
SparkStepConfig	withArguments(String arguments)	Configure the arguments for the step.
SparkStepConfig	withJar(String jar)	Configure the BOS path for step's .jar file.
SparkStepConfig	withName(String name)	Configure the name of the step.
SparkStepConfig	withSubmitOptions(String submitOptions)	Configure the submit options for the step.

从类继承的方法 com.baidubce.services.bmr.model.StepConfig

addAdditionalFile, addProperty, getActionOnFailure, getAdditionalFiles, getName, getProperties, getType, setActionOnFailure, setAdditionalFiles, setName, setProperties, setType, withAdditionalFiles, withProperties, withType

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SparkStepConfig

public SparkStepConfig()

方法详细资料

withJar

public SparkStepConfig withJar(String jar)

Configure the BOS path for step's .jar file.

参数:

jar - The BOS path for the step's .jar file.

返回:

SparkStepConfig

withSubmitOptions

public SparkStepConfig withSubmitOptions(String submitOptions)

Configure the submit options for the step.

参数:

submitOptions - The main class for the step.

返回:

SparkStepConfig

withArguments

public SparkStepConfig withArguments(String arguments)

Configure the arguments for the step.

参数:

arguments - The arguments for the step.

返回:

SparkStepConfig

withActionOnFailure

public SparkStepConfig withActionOnFailure(String actionOnFailure)

Configure the action on failure for the java step. This property is set to enum value: "Continue": continue to execute other steps. "TerminateCluster": terminate the cluster when this step fails. "CancelAndWait": cancel the other pending steps and set the cluster's status to WAITING.

覆盖:

withActionOnFailure 在类中 StepConfig

参数:

actionOnFailure - The action on step's failure.

返回:

SparkStepConfig

withName

public SparkStepConfig withName(String name)

Configure the name of the step.

覆盖:

withName 在类中 StepConfig

参数:

name - The name of the step.

返回:

SparkStepConfig

withAdditionalFile

public SparkStepConfig withAdditionalFile(String remote,
                                          String local)

Configure the additional file for the step.

参数:

remote - The remote file of the additional file.

local - The local file of the additional file.

返回:

SparkStepConfig