类 StreamingStepConfig


  • public class StreamingStepConfig
    extends StepConfig
    Represent configuration for a streaming step.

    A streaming step can be configured with name, actionOnFailure, mapper, reducer, input, output and arguments. The essential options are mapper, input, output and actionOnFailure, and the optional ones are name, reducer and arguments.

    • 构造器详细资料

      • StreamingStepConfig

        public StreamingStepConfig()
    • 方法详细资料

      • withInput

        public StreamingStepConfig withInput​(String input)
        Configure the input for the step.
        参数:
        input - The input path for the step.
        返回:
        StreamingStepConfig
      • withMapper

        public StreamingStepConfig withMapper​(String mapper)
        Configure the mapper program for the step.
        参数:
        mapper - The mapper program for the step.
        返回:
        StreamingStepConfig
      • withOutput

        public StreamingStepConfig withOutput​(String output)
        Configure the output for the step.
        参数:
        output - The output path for the step.
        返回:
        StreamingStepConfig
      • withArguments

        public StreamingStepConfig withArguments​(String arguments)
        Configure the arguments for the step.
        参数:
        arguments - The arguments for the step.
        返回:
        StreamingStepConfig
      • withReducer

        public StreamingStepConfig withReducer​(String reducer)
        Configure the reducer program for the step.
        参数:
        reducer - The reducer program for the step.
        返回:
        StreamingStepConfig
      • withActionOnFailure

        public StreamingStepConfig withActionOnFailure​(String actionOnFailure)
        Configure the action on failure for the streaming step. This property is set to enum value: "Continue": continue to execute other steps. "TerminateCluster": terminate the cluster when this step fails. "CancelAndWait": cancel the other pending steps and set the cluster's status to WAITING.
        覆盖:
        withActionOnFailure 在类中 StepConfig
        参数:
        actionOnFailure - The action on step's failure.
        返回:
        StreamingStepConfig