org.apache.beam.runners.samza.util

Class PipelineJsonRenderer

java.lang.Object

org.apache.beam.runners.samza.util.PipelineJsonRenderer

All Implemented Interfaces:

org.apache.beam.sdk.Pipeline.PipelineVisitor

public class PipelineJsonRenderer
extends java.lang.Object
implements org.apache.beam.sdk.Pipeline.PipelineVisitor

A JSON renderer for BEAM Pipeline DAG. This can help us with visualization of the Beam DAG.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	PipelineJsonRenderer.SamzaIOInfo Interface to get I/O information for a Beam job.
static interface	PipelineJsonRenderer.SamzaIORegistrar A registrar for PipelineJsonRenderer.SamzaIOInfo.

Nested classes/interfaces inherited from interface org.apache.beam.sdk.Pipeline.PipelineVisitor

org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior, org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior	enterCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
void	enterPipeline(org.apache.beam.sdk.Pipeline p)
static java.util.Map<java.lang.String,java.util.Map.Entry<java.util.List<java.lang.String>,java.util.List<java.lang.String>>>	getTransformIOMap(org.apache.samza.config.Config config)
void	leaveCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
void	leavePipeline(org.apache.beam.sdk.Pipeline pipeline)
static java.lang.String	toJsonString(org.apache.beam.sdk.Pipeline pipeline, ConfigContext ctx) This method creates a JSON representation of the Beam pipeline.
static java.lang.String	toJsonString(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline) This method creates a JSON representation for Beam Portable Pipeline.
void	visitPrimitiveTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
void	visitValue(org.apache.beam.sdk.values.PValue value, org.apache.beam.sdk.runners.TransformHierarchy.Node producer)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

toJsonString

public static java.lang.String toJsonString(org.apache.beam.sdk.Pipeline pipeline,
                                            ConfigContext ctx)

This method creates a JSON representation of the Beam pipeline.

Parameters:

pipeline - The beam pipeline

ctx - Config context of the pipeline

Returns:

JSON string representation of the pipeline

toJsonString

public static java.lang.String toJsonString(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline)

This method creates a JSON representation for Beam Portable Pipeline.

Parameters:

pipeline - The beam portable pipeline

Returns:

JSON string representation of the pipeline

enterPipeline

public void enterPipeline(org.apache.beam.sdk.Pipeline p)

Specified by:

enterPipeline in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

enterCompositeTransform

public org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior enterCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Specified by:

enterCompositeTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

leaveCompositeTransform

public void leaveCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Specified by:

leaveCompositeTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

visitPrimitiveTransform

public void visitPrimitiveTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Specified by:

visitPrimitiveTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

visitValue

public void visitValue(org.apache.beam.sdk.values.PValue value,
                       org.apache.beam.sdk.runners.TransformHierarchy.Node producer)

Specified by:

visitValue in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

leavePipeline

public void leavePipeline(org.apache.beam.sdk.Pipeline pipeline)

Specified by:

leavePipeline in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

getTransformIOMap

public static java.util.Map<java.lang.String,java.util.Map.Entry<java.util.List<java.lang.String>,java.util.List<java.lang.String>>> getTransformIOMap(org.apache.samza.config.Config config)