io.cdap.plugin.hubspot.source.batch

Class HubspotBatchSource

java.lang.Object

io.cdap.cdap.etl.api.batch.BatchConfigurable<io.cdap.cdap.etl.api.batch.BatchSourceContext>

io.cdap.cdap.etl.api.batch.BatchSource<org.apache.hadoop.io.NullWritable,com.google.gson.JsonElement,io.cdap.cdap.api.data.format.StructuredRecord>

io.cdap.plugin.hubspot.source.batch.HubspotBatchSource

All Implemented Interfaces:

io.cdap.cdap.etl.api.Destroyable, io.cdap.cdap.etl.api.PipelineConfigurable, io.cdap.cdap.etl.api.StageLifecycle<io.cdap.cdap.etl.api.batch.BatchRuntimeContext>, io.cdap.cdap.etl.api.SubmitterLifecycle<io.cdap.cdap.etl.api.batch.BatchSourceContext>, io.cdap.cdap.etl.api.Transformation<io.cdap.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.NullWritable,com.google.gson.JsonElement>,io.cdap.cdap.api.data.format.StructuredRecord>

public class HubspotBatchSource
extends io.cdap.cdap.etl.api.batch.BatchSource<org.apache.hadoop.io.NullWritable,com.google.gson.JsonElement,io.cdap.cdap.api.data.format.StructuredRecord>

Plugin reads Hubspot objects in batch.

Field Summary

Fields

Modifier and Type	Field and Description
static String	NAME

Fields inherited from class io.cdap.cdap.etl.api.batch.BatchSource

FORMAT_PLUGIN_TYPE, PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
HubspotBatchSource(SourceHubspotConfig config)

Method Summary

Modifier and Type	Method and Description
void	configurePipeline(io.cdap.cdap.etl.api.PipelineConfigurer pipelineConfigurer)
void	prepareRun(io.cdap.cdap.etl.api.batch.BatchSourceContext context) Prepare Hubspot objects.
void	transform(io.cdap.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.NullWritable,com.google.gson.JsonElement> input, io.cdap.cdap.etl.api.Emitter<io.cdap.cdap.api.data.format.StructuredRecord> emitter)

Methods inherited from class io.cdap.cdap.etl.api.batch.BatchSource

destroy, initialize

Methods inherited from class io.cdap.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NAME

public static final String NAME

See Also:

Constant Field Values

Constructor Detail

HubspotBatchSource

public HubspotBatchSource(SourceHubspotConfig config)

Method Detail

configurePipeline

public void configurePipeline(io.cdap.cdap.etl.api.PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface io.cdap.cdap.etl.api.PipelineConfigurable

Overrides:

configurePipeline in class io.cdap.cdap.etl.api.batch.BatchConfigurable<io.cdap.cdap.etl.api.batch.BatchSourceContext>

prepareRun

public void prepareRun(io.cdap.cdap.etl.api.batch.BatchSourceContext context)
                throws Exception

Prepare Hubspot objects.

Specified by:

prepareRun in interface io.cdap.cdap.etl.api.SubmitterLifecycle<io.cdap.cdap.etl.api.batch.BatchSourceContext>

Specified by:

prepareRun in class io.cdap.cdap.etl.api.batch.BatchConfigurable<io.cdap.cdap.etl.api.batch.BatchSourceContext>

Parameters:

context - the batch source context

Throws:

Exception - on issues with reading the hubspot objects

transform

public void transform(io.cdap.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.NullWritable,com.google.gson.JsonElement> input,
                      io.cdap.cdap.etl.api.Emitter<io.cdap.cdap.api.data.format.StructuredRecord> emitter)

Specified by:

transform in interface io.cdap.cdap.etl.api.Transformation<io.cdap.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.NullWritable,com.google.gson.JsonElement>,io.cdap.cdap.api.data.format.StructuredRecord>

Overrides:

transform in class io.cdap.cdap.etl.api.batch.BatchSource<org.apache.hadoop.io.NullWritable,com.google.gson.JsonElement,io.cdap.cdap.api.data.format.StructuredRecord>