org.apache.camel.builder.endpoint.dsl

Interface HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder

All Superinterfaces:

org.apache.camel.builder.EndpointProducerBuilder, org.apache.camel.EndpointProducerResolver

All Known Subinterfaces:

HdfsEndpointBuilderFactory.AdvancedHdfsEndpointBuilder

Enclosing interface:

HdfsEndpointBuilderFactory

public static interface HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder
extends org.apache.camel.builder.EndpointProducerBuilder

Advanced builder for endpoint producers for the HDFS component.

Method Summary

Modifier and Type	Method and Description
default HdfsEndpointBuilderFactory.HdfsEndpointProducerBuilder	basic()
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	basicPropertyBinding(boolean basicPropertyBinding) Whether the endpoint should use basic property binding (Camel 2.x) or the newer property binding with additional capabilities.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	basicPropertyBinding(String basicPropertyBinding) Whether the endpoint should use basic property binding (Camel 2.x) or the newer property binding with additional capabilities.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	blockSize(long blockSize) The size of the HDFS blocks.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	blockSize(String blockSize) The size of the HDFS blocks.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	bufferSize(int bufferSize) The buffer size used by HDFS.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	bufferSize(String bufferSize) The buffer size used by HDFS.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	checkIdleInterval(int checkIdleInterval) How often (time in millis) in to run the idle checker background task.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	checkIdleInterval(String checkIdleInterval) How often (time in millis) in to run the idle checker background task.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	chunkSize(int chunkSize) When reading a normal file, this is split into chunks producing a message per chunk.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	chunkSize(String chunkSize) When reading a normal file, this is split into chunks producing a message per chunk.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	compressionCodec(HdfsEndpointBuilderFactory.HdfsCompressionCodec compressionCodec) The compression codec to use.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	compressionCodec(String compressionCodec) The compression codec to use.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	compressionType(HdfsEndpointBuilderFactory.CompressionType compressionType) The compression type to use (is default not in use).
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	compressionType(String compressionType) The compression type to use (is default not in use).
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	openedSuffix(String openedSuffix) When a file is opened for reading/writing the file is renamed with this suffix to avoid to read it during the writing phase.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	readSuffix(String readSuffix) Once the file has been read is renamed with this suffix to avoid to read it again.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	replication(short replication) The HDFS replication factor.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	replication(String replication) The HDFS replication factor.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	splitStrategy(String splitStrategy) In the current version of Hadoop opening a file in append mode is disabled since it's not very reliable.
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	synchronous(boolean synchronous) Sets whether synchronous processing should be strictly used, or Camel is allowed to use asynchronous processing (if supported).
default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder	synchronous(String synchronous) Sets whether synchronous processing should be strictly used, or Camel is allowed to use asynchronous processing (if supported).

Methods inherited from interface org.apache.camel.builder.EndpointProducerBuilder

doSetMultiValueProperties, doSetMultiValueProperty, doSetProperty, expr, expr, getUri

Methods inherited from interface org.apache.camel.EndpointProducerResolver

resolve, resolve

Method Detail

basic

default HdfsEndpointBuilderFactory.HdfsEndpointProducerBuilder basic()

basicPropertyBinding

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder basicPropertyBinding(boolean basicPropertyBinding)

Whether the endpoint should use basic property binding (Camel 2.x) or the newer property binding with additional capabilities. The option is a: boolean type. Default: false Group: advanced

basicPropertyBinding

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder basicPropertyBinding(String basicPropertyBinding)

Whether the endpoint should use basic property binding (Camel 2.x) or the newer property binding with additional capabilities. The option will be converted to a boolean type. Default: false Group: advanced

blockSize

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder blockSize(long blockSize)

The size of the HDFS blocks. The option is a: long type. Default: 67108864 Group: advanced

blockSize

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder blockSize(String blockSize)

The size of the HDFS blocks. The option will be converted to a long type. Default: 67108864 Group: advanced

bufferSize

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder bufferSize(int bufferSize)

The buffer size used by HDFS. The option is a: int type. Default: 4096 Group: advanced

bufferSize

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder bufferSize(String bufferSize)

The buffer size used by HDFS. The option will be converted to a int type. Default: 4096 Group: advanced

checkIdleInterval

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder checkIdleInterval(int checkIdleInterval)

How often (time in millis) in to run the idle checker background task. This option is only in use if the splitter strategy is IDLE. The option is a: int type. Default: 500 Group: advanced

checkIdleInterval

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder checkIdleInterval(String checkIdleInterval)

How often (time in millis) in to run the idle checker background task. This option is only in use if the splitter strategy is IDLE. The option will be converted to a int type. Default: 500 Group: advanced

chunkSize

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder chunkSize(int chunkSize)

When reading a normal file, this is split into chunks producing a message per chunk. The option is a: int type. Default: 4096 Group: advanced

chunkSize

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder chunkSize(String chunkSize)

When reading a normal file, this is split into chunks producing a message per chunk. The option will be converted to a int type. Default: 4096 Group: advanced

compressionCodec

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder compressionCodec(HdfsEndpointBuilderFactory.HdfsCompressionCodec compressionCodec)

The compression codec to use. The option is a: org.apache.camel.component.hdfs.HdfsCompressionCodec type. Default: DEFAULT Group: advanced

compressionCodec

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder compressionCodec(String compressionCodec)

The compression codec to use. The option will be converted to a org.apache.camel.component.hdfs.HdfsCompressionCodec type. Default: DEFAULT Group: advanced

compressionType

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder compressionType(HdfsEndpointBuilderFactory.CompressionType compressionType)

The compression type to use (is default not in use). The option is a: org.apache.hadoop.io.SequenceFile$CompressionType type. Default: NONE Group: advanced

compressionType

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder compressionType(String compressionType)

The compression type to use (is default not in use). The option will be converted to a org.apache.hadoop.io.SequenceFile$CompressionType type. Default: NONE Group: advanced

openedSuffix

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder openedSuffix(String openedSuffix)

When a file is opened for reading/writing the file is renamed with this suffix to avoid to read it during the writing phase. The option is a: java.lang.String type. Default: opened Group: advanced

readSuffix

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder readSuffix(String readSuffix)

Once the file has been read is renamed with this suffix to avoid to read it again. The option is a: java.lang.String type. Default: read Group: advanced

replication

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder replication(short replication)

The HDFS replication factor. The option is a: short type. Default: 3 Group: advanced

replication

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder replication(String replication)

The HDFS replication factor. The option will be converted to a short type. Default: 3 Group: advanced

splitStrategy

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder splitStrategy(String splitStrategy)

In the current version of Hadoop opening a file in append mode is disabled since it's not very reliable. So, for the moment, it's only possible to create new files. The Camel HDFS endpoint tries to solve this problem in this way: If the split strategy option has been defined, the hdfs path will be used as a directory and files will be created using the configured UuidGenerator. Every time a splitting condition is met, a new file is created. The splitStrategy option is defined as a string with the following syntax: splitStrategy=ST:value,ST:value,... where ST can be: BYTES a new file is created, and the old is closed when the number of written bytes is more than value MESSAGES a new file is created, and the old is closed when the number of written messages is more than value IDLE a new file is created, and the old is closed when no writing happened in the last value milliseconds. The option is a: java.lang.String type. Group: advanced

synchronous

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder synchronous(boolean synchronous)

Sets whether synchronous processing should be strictly used, or Camel is allowed to use asynchronous processing (if supported). The option is a: boolean type. Default: false Group: advanced

synchronous

default HdfsEndpointBuilderFactory.AdvancedHdfsEndpointProducerBuilder synchronous(String synchronous)

Sets whether synchronous processing should be strictly used, or Camel is allowed to use asynchronous processing (if supported). The option will be converted to a boolean type. Default: false Group: advanced