A C F G I L M O P R S U W

A

appendBatchData(CarbonIterator<Object[]>, TaskAttemptContext, CarbonLoadModel) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

invoke CarbonStreamOutputFormat to append batch data to existing carbondata file

C

CARBON_ENCODER_ROW_BUFFER_SIZE - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_ENCODER_ROW_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_BLOCKLET_ROW_NUMS - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_BLOCKLET_ROW_NUMS_DEFAULT - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_CACHE_SIZE - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_CACHE_SIZE_DEFAULT - Static variable in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CARBON_STREAM_PARSER - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CARBON_STREAM_PARSER_CSV - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CARBON_STREAM_PARSER_DEFAULT - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CARBON_STREAM_PARSER_ROW_PARSER - Static variable in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

CarbonStreamException - Exception in org.apache.carbondata.streaming

Stream exception

CarbonStreamException(String) - Constructor for exception org.apache.carbondata.streaming.CarbonStreamException

CarbonStreamException(String, Throwable) - Constructor for exception org.apache.carbondata.streaming.CarbonStreamException

CarbonStreamOutputFormat - Class in org.apache.carbondata.streaming

Stream output format

CarbonStreamOutputFormat() - Constructor for class org.apache.carbondata.streaming.CarbonStreamOutputFormat

CarbonStreamParser - Interface in org.apache.carbondata.streaming.parser

Stream parser interface

CarbonStreamRecordWriter - Class in org.apache.carbondata.streaming

Stream record writer

CarbonStreamRecordWriter(TaskAttemptContext, CarbonLoadModel) - Constructor for class org.apache.carbondata.streaming.CarbonStreamRecordWriter

close(TaskAttemptContext) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

close() - Method in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

close() - Method in class org.apache.carbondata.streaming.parser.CSVStreamParserImp

close(CarbonTable, String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

marker old stream segment to finished status and create new stream segment

collectMinMaxIndex(SimpleStatsResult[], SimpleStatsResult[]) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

CSVStreamParserImp - Class in org.apache.carbondata.streaming.parser

CSV Stream Parser, it is also the default parser.

CSVStreamParserImp() - Constructor for class org.apache.carbondata.streaming.parser.CSVStreamParserImp

F

finishStreaming(CarbonTable) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

change the status of the segment from "streaming" to "streaming finish"

G

getBatchMinMaxIndex() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

getCarbonLoadModel(Configuration) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

getFileName() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

getFileName() - Method in class org.apache.carbondata.streaming.index.StreamFileIndex

getMeasureDataTypes() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

getMinMaxIndex() - Method in class org.apache.carbondata.streaming.index.StreamFileIndex

getRecordWriter(TaskAttemptContext) - Method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

getRowCount() - Method in class org.apache.carbondata.streaming.index.StreamFileIndex

getSegmentDir() - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

getSegmentId(Configuration) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

I

initialize(Configuration, StructType, boolean[]) - Method in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

initialize(Configuration, StructType, boolean[]) - Method in class org.apache.carbondata.streaming.parser.CSVStreamParserImp

L

listDataFiles(String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

list all carbondata files of a segment

M

mergeBlockletMinMax(BlockletMinMaxIndex, BlockletMinMaxIndex, DataType[]) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

merge blocklet min/max to generate batch min/max

O

open(CarbonTable) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

get stream segment or create new stream segment if not exists

org.apache.carbondata.streaming - package org.apache.carbondata.streaming

org.apache.carbondata.streaming.index - package org.apache.carbondata.streaming.index

org.apache.carbondata.streaming.parser - package org.apache.carbondata.streaming.parser

org.apache.carbondata.streaming.segment - package org.apache.carbondata.streaming.segment

P

parserRow(InternalRow) - Method in interface org.apache.carbondata.streaming.parser.CarbonStreamParser

parserRow(InternalRow) - Method in class org.apache.carbondata.streaming.parser.CSVStreamParserImp

R

readIndexFile(String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

read index file to list BlockIndex

recoverFileIfRequired(String, String, String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

check the health of stream data file and try to recover data file from task fault this method will be invoked in following scenarios.

recoverSegmentIfRequired(String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

check the health of stream segment and try to recover segment from job fault this method will be invoked in following scenarios.

S

setCarbonLoadModel(Configuration, CarbonLoadModel) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

setFileName(String) - Method in class org.apache.carbondata.streaming.index.StreamFileIndex

setHasException(boolean) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

setMinMaxIndex(BlockletMinMaxIndex) - Method in class org.apache.carbondata.streaming.index.StreamFileIndex

setRowCount(long) - Method in class org.apache.carbondata.streaming.index.StreamFileIndex

setSegmentId(Configuration, String) - Static method in class org.apache.carbondata.streaming.CarbonStreamOutputFormat

size(String) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

calculate the size of the segment by the accumulation of data sizes in index file

StreamBlockletWriter - Class in org.apache.carbondata.streaming

stream blocklet writer

StreamFileIndex - Class in org.apache.carbondata.streaming.index

StreamFileIndex(String, BlockletMinMaxIndex, long) - Constructor for class org.apache.carbondata.streaming.index.StreamFileIndex

StreamSegment - Class in org.apache.carbondata.streaming.segment

streaming segment manager

StreamSegment() - Constructor for class org.apache.carbondata.streaming.segment.StreamSegment

U

updateIndexFile(String, StreamFileIndex[], DataType[]) - Static method in class org.apache.carbondata.streaming.segment.StreamSegment

update carbon index file after a stream batch.

W

write(Void, Object) - Method in class org.apache.carbondata.streaming.CarbonStreamRecordWriter

A C F G I L M O P R S U W