Package org.apache.druid.data.input.impl

Class DelimitedInputFormat

java.lang.Object

org.apache.druid.data.input.impl.FlatTextInputFormat

org.apache.druid.data.input.impl.DelimitedInputFormat

All Implemented Interfaces:

InputFormat

public class DelimitedInputFormat
extends FlatTextInputFormat

InputFormat for customized Delimiter Separate Value format of input data (default is TSV).

Field Summary

Fields

Modifier and Type	Field	Description
static String	TYPE_KEY

Fields inherited from interface org.apache.druid.data.input.InputFormat

TYPE_PROPERTY

Constructor Summary

Constructors

Constructor	Description
DelimitedInputFormat(List<String> columns, String listDelimiter, String delimiter, Boolean hasHeaderRow, Boolean findColumnsFromHeader, int skipHeaderRows)

Method Summary

Modifier and Type	Method	Description
InputEntityReader	createReader(InputRowSchema inputRowSchema, InputEntity source, File temporaryDirectory)
boolean	isSplittable()	Trait to indicate that a file can be split into multiple InputSplits.
static List<String>	splitToList(com.google.common.base.Splitter splitter, String input)	Copied from Guava's Splitter.splitToList(CharSequence).
String	toString()

Methods inherited from class org.apache.druid.data.input.impl.FlatTextInputFormat

createRowAdapter, equals, fieldsToString, getColumns, getDelimiter, getListDelimiter, getSkipHeaderRows, getWeightedSize, hashCode, isFindColumnsFromHeader, useListBasedInputRows

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

TYPE_KEY

public static final String TYPE_KEY

See Also:

Constant Field Values

Constructor Detail

DelimitedInputFormat

public DelimitedInputFormat(@Nullable
                            List<String> columns,
                            @Nullable
                            String listDelimiter,
                            @Nullable
                            String delimiter,
                            @Deprecated @Nullable
                            Boolean hasHeaderRow,
                            @Nullable
                            Boolean findColumnsFromHeader,
                            int skipHeaderRows)

Method Detail

isSplittable

public boolean isSplittable()

Description copied from interface: InputFormat

Trait to indicate that a file can be split into multiple InputSplits.

This method is not being used anywhere for now, but should be considered in SplittableInputSource.createSplits(org.apache.druid.data.input.InputFormat, org.apache.druid.data.input.SplitHintSpec) in the future.

createReader

public InputEntityReader createReader(InputRowSchema inputRowSchema,
                                      InputEntity source,
                                      File temporaryDirectory)

splitToList

public static List<String> splitToList(com.google.common.base.Splitter splitter,
                                       String input)

Copied from Guava's Splitter.splitToList(CharSequence). This is to avoid the error of the missing method signature when using an old Guava library. For example, it may happen when running Druid Hadoop indexing jobs, since we may inherit the version provided by the Hadoop cluster. See https://github.com/apache/druid/issues/6801.

toString

public String toString()

Overrides:

toString in class Object