default S3CsvSource.Builder |
S3CsvSource.Builder.additionalOptions(Consumer<S3DirectSourceAdditionalOptions.Builder> additionalOptions) |
Specifies additional connection options.
|
S3CsvSource.Builder |
S3CsvSource.Builder.additionalOptions(S3DirectSourceAdditionalOptions additionalOptions) |
Specifies additional connection options.
|
static S3CsvSource.Builder |
S3CsvSource.builder() |
|
S3CsvSource.Builder |
S3CsvSource.Builder.compressionType(String compressionType) |
Specifies how the data is compressed.
|
S3CsvSource.Builder |
S3CsvSource.Builder.compressionType(CompressionType compressionType) |
Specifies how the data is compressed.
|
S3CsvSource.Builder |
S3CsvSource.Builder.escaper(String escaper) |
Specifies a character to use for escaping.
|
S3CsvSource.Builder |
S3CsvSource.Builder.exclusions(String... exclusions) |
A string containing a JSON list of Unix-style glob patterns to exclude.
|
S3CsvSource.Builder |
S3CsvSource.Builder.exclusions(Collection<String> exclusions) |
A string containing a JSON list of Unix-style glob patterns to exclude.
|
S3CsvSource.Builder |
S3CsvSource.Builder.groupFiles(String groupFiles) |
Grouping files is turned on by default when the input contains more than 50,000 files.
|
S3CsvSource.Builder |
S3CsvSource.Builder.groupSize(String groupSize) |
The target group size in bytes.
|
S3CsvSource.Builder |
S3CsvSource.Builder.maxBand(Integer maxBand) |
This option controls the duration in milliseconds after which the s3 listing is likely to be consistent.
|
S3CsvSource.Builder |
S3CsvSource.Builder.maxFilesInBand(Integer maxFilesInBand) |
This option specifies the maximum number of files to save from the last maxBand seconds.
|
S3CsvSource.Builder |
S3CsvSource.Builder.multiline(Boolean multiline) |
A Boolean value that specifies whether a single record can span multiple lines.
|
S3CsvSource.Builder |
S3CsvSource.Builder.name(String name) |
The name of the data store.
|
S3CsvSource.Builder |
S3CsvSource.Builder.optimizePerformance(Boolean optimizePerformance) |
A Boolean value that specifies whether to use the advanced SIMD CSV reader along with Apache Arrow based
columnar memory formats.
|
S3CsvSource.Builder |
S3CsvSource.Builder.outputSchemas(Collection<GlueSchema> outputSchemas) |
Specifies the data schema for the S3 CSV source.
|
S3CsvSource.Builder |
S3CsvSource.Builder.outputSchemas(Consumer<GlueSchema.Builder>... outputSchemas) |
Specifies the data schema for the S3 CSV source.
|
S3CsvSource.Builder |
S3CsvSource.Builder.outputSchemas(GlueSchema... outputSchemas) |
Specifies the data schema for the S3 CSV source.
|
S3CsvSource.Builder |
S3CsvSource.Builder.paths(String... paths) |
A list of the Amazon S3 paths to read from.
|
S3CsvSource.Builder |
S3CsvSource.Builder.paths(Collection<String> paths) |
A list of the Amazon S3 paths to read from.
|
S3CsvSource.Builder |
S3CsvSource.Builder.quoteChar(String quoteChar) |
Specifies the character to use for quoting.
|
S3CsvSource.Builder |
S3CsvSource.Builder.quoteChar(QuoteChar quoteChar) |
Specifies the character to use for quoting.
|
S3CsvSource.Builder |
S3CsvSource.Builder.recurse(Boolean recurse) |
If set to true, recursively reads files in all subdirectories under the specified paths.
|
S3CsvSource.Builder |
S3CsvSource.Builder.separator(String separator) |
Specifies the delimiter character.
|
S3CsvSource.Builder |
S3CsvSource.Builder.separator(Separator separator) |
Specifies the delimiter character.
|
S3CsvSource.Builder |
S3CsvSource.Builder.skipFirst(Boolean skipFirst) |
A Boolean value that specifies whether to skip the first data line.
|
S3CsvSource.Builder |
S3CsvSource.toBuilder() |
|
S3CsvSource.Builder |
S3CsvSource.Builder.withHeader(Boolean withHeader) |
A Boolean value that specifies whether to treat the first line as a header.
|
S3CsvSource.Builder |
S3CsvSource.Builder.writeHeader(Boolean writeHeader) |
A Boolean value that specifies whether to write the header to output.
|