- CacheAccessClient<K,V> - Class in org.apache.carbondata.hadoop
-
CacheClient : Class used to request the segments cache
- CacheAccessClient(Cache<K, V>) - Constructor for class org.apache.carbondata.hadoop.CacheAccessClient
-
- calculateLength() - Method in class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- carbonColumns - Variable in class org.apache.carbondata.hadoop.readsupport.impl.DictionaryDecodeReadSupport
-
carbon columns
- CarbonFileInputFormat<T> - Class in org.apache.carbondata.hadoop.api
-
InputFormat for reading carbondata files without table level metadata support,
schema is inferred as following steps:
1.
- CarbonFileInputFormat() - Constructor for class org.apache.carbondata.hadoop.api.CarbonFileInputFormat
-
- CarbonInputFormat<T> - Class in org.apache.carbondata.hadoop.api
-
Base class for carbondata input format, there are two input format implementations:
1.
- CarbonInputFormat() - Constructor for class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- CarbonInputFormatUtil - Class in org.apache.carbondata.hadoop.util
-
Utility class
- CarbonInputFormatUtil() - Constructor for class org.apache.carbondata.hadoop.util.CarbonInputFormatUtil
-
- CarbonInputSplit - Class in org.apache.carbondata.hadoop
-
Carbon input split to allow distributed read of CarbonTableInputFormat.
- CarbonInputSplit() - Constructor for class org.apache.carbondata.hadoop.CarbonInputSplit
-
- CarbonInputSplit(String, String, Path, long, long, String[], int, ColumnarFormatVersion, String[]) - Constructor for class org.apache.carbondata.hadoop.CarbonInputSplit
-
- CarbonInputSplit(String, Path, long, long, String[], FileFormat) - Constructor for class org.apache.carbondata.hadoop.CarbonInputSplit
-
- CarbonInputSplit(String, Path, long, long, String[], String[], FileFormat) - Constructor for class org.apache.carbondata.hadoop.CarbonInputSplit
-
- CarbonInputSplit(String, String, Path, long, long, String[], int, ColumnarFormatVersion, Map<String, String>, String[]) - Constructor for class org.apache.carbondata.hadoop.CarbonInputSplit
-
Constructor to initialize the CarbonInputSplit with blockStorageIdMap
- CarbonInputSplitTaskInfo - Class in org.apache.carbondata.hadoop.util
-
- CarbonInputSplitTaskInfo(String, List<CarbonInputSplit>) - Constructor for class org.apache.carbondata.hadoop.util.CarbonInputSplitTaskInfo
-
- carbonIterator - Variable in class org.apache.carbondata.hadoop.CarbonRecordReader
-
- CarbonMultiBlockSplit - Class in org.apache.carbondata.hadoop
-
This class wraps multiple blocks belong to a same node to one split.
- CarbonMultiBlockSplit() - Constructor for class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- CarbonMultiBlockSplit(List<Distributable>, String) - Constructor for class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- CarbonMultiBlockSplit(List<CarbonInputSplit>, String[]) - Constructor for class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- CarbonMultiBlockSplit(List<CarbonInputSplit>, String[], FileFormat) - Constructor for class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- CarbonOutputCommitter - Class in org.apache.carbondata.hadoop.api
-
Outputcommitter which manages the segments during loading.It commits segment information to the
tablestatus file upon success or fail.
- CarbonOutputCommitter(Path, TaskAttemptContext) - Constructor for class org.apache.carbondata.hadoop.api.CarbonOutputCommitter
-
- CarbonProjection - Class in org.apache.carbondata.hadoop
-
User can add required columns
- CarbonProjection() - Constructor for class org.apache.carbondata.hadoop.CarbonProjection
-
- CarbonProjection(String[]) - Constructor for class org.apache.carbondata.hadoop.CarbonProjection
-
- CarbonReadSupport<T> - Interface in org.apache.carbondata.hadoop.readsupport
-
This is the interface to convert data reading from RecordReader to row representation.
- CarbonRecordReader<T> - Class in org.apache.carbondata.hadoop
-
Reads the data from Carbon store.
- CarbonRecordReader(QueryModel, CarbonReadSupport<T>, InputMetricsStats, Configuration) - Constructor for class org.apache.carbondata.hadoop.CarbonRecordReader
-
- CarbonRecordReader(QueryModel, CarbonReadSupport<T>, Configuration) - Constructor for class org.apache.carbondata.hadoop.CarbonRecordReader
-
- CarbonRecordWriter(CarbonOutputIteratorWrapper, DataLoadExecutor, CarbonLoadModel, Future, ExecutorService) - Constructor for class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat.CarbonRecordWriter
-
- CarbonRowReadSupport - Class in org.apache.carbondata.hadoop.readsupport.impl
-
A read support implementation to return CarbonRow after handling
global dictionary and direct dictionary (date/timestamp) conversion
- CarbonRowReadSupport() - Constructor for class org.apache.carbondata.hadoop.readsupport.impl.CarbonRowReadSupport
-
- CarbonTableInputFormat<T> - Class in org.apache.carbondata.hadoop.api
-
InputFormat for reading carbondata files with table level metadata support,
such as segment and explicit schema metadata.
- CarbonTableInputFormat() - Constructor for class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
- CarbonTableOutputFormat - Class in org.apache.carbondata.hadoop.api
-
This is table level output format which writes the data to store in new segment.
- CarbonTableOutputFormat() - Constructor for class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- CarbonTableOutputFormat.CarbonMultiRecordWriter - Class in org.apache.carbondata.hadoop.api
-
- CarbonTableOutputFormat.CarbonRecordWriter - Class in org.apache.carbondata.hadoop.api
-
- clearAccessCount(List<K>) - Method in class org.apache.carbondata.hadoop.CacheAccessClient
-
This method will clear the access count for a given list of segments
- clearDataMaps() - Method in class org.apache.carbondata.hadoop.testutil.StoreCreator
-
Method to clear the data maps
- close(TaskAttemptContext) - Method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat.CarbonMultiRecordWriter
-
- close(TaskAttemptContext) - Method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat.CarbonRecordWriter
-
- close() - Method in class org.apache.carbondata.hadoop.CacheAccessClient
-
the method is used to clear access count of the unused segments cacheable object
- close() - Method in class org.apache.carbondata.hadoop.CarbonRecordReader
-
- close() - Method in interface org.apache.carbondata.hadoop.readsupport.CarbonReadSupport
-
cleanup step if necessary
- close() - Method in class org.apache.carbondata.hadoop.readsupport.impl.DictionaryDecodeReadSupport
-
to book keep the dictionary cache or update access count for each
column involved during decode, to facilitate LRU cache policy if memory
threshold is reached
- commitJob(JobContext) - Method in class org.apache.carbondata.hadoop.api.CarbonOutputCommitter
-
Update the tablestatus as success after job is success
- compareTo(Distributable) - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- compareTo(Distributable) - Method in class org.apache.carbondata.hadoop.util.CarbonInputSplitTaskInfo
-
- COMPLEX_DELIMITERS - Static variable in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- createBlocks(List<CarbonInputSplit>) - Static method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- createCarbonInputFormat(AbsoluteTableIdentifier, Job) - Static method in class org.apache.carbondata.hadoop.util.CarbonInputFormatUtil
-
- createCarbonStore() - Method in class org.apache.carbondata.hadoop.testutil.StoreCreator
-
Create store without any restructure
- createCarbonStore(CarbonLoadModel) - Method in class org.apache.carbondata.hadoop.testutil.StoreCreator
-
Create store without any restructure
- createCarbonTableInputFormat(AbsoluteTableIdentifier, List<String>, Job) - Static method in class org.apache.carbondata.hadoop.util.CarbonInputFormatUtil
-
- createCarbonTableInputFormat(Job, CarbonTable, String[], Expression, List<PartitionSpec>, DataMapJob) - Static method in class org.apache.carbondata.hadoop.util.CarbonInputFormatUtil
-
- createJobTrackerID(Date) - Static method in class org.apache.carbondata.hadoop.util.CarbonInputFormatUtil
-
- createQueryModel(InputSplit, TaskAttemptContext) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- createTable(AbsoluteTableIdentifier) - Method in class org.apache.carbondata.hadoop.testutil.StoreCreator
-
- createTableAndLoadModel(boolean) - Method in class org.apache.carbondata.hadoop.testutil.StoreCreator
-
- createTableAndLoadModel() - Method in class org.apache.carbondata.hadoop.testutil.StoreCreator
-
- get(K) - Method in class org.apache.carbondata.hadoop.CacheAccessClient
-
This method will get the value for the given key.
- get() - Method in class org.apache.carbondata.hadoop.internal.ObjectArrayWritable
-
- getAbsoluteTableIdentifier(Configuration) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getAbsoluteTableIdentifier() - Method in class org.apache.carbondata.hadoop.testutil.StoreCreator
-
- getAccessStreamingSegments(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getAllColumns() - Method in class org.apache.carbondata.hadoop.CarbonProjection
-
- getAllSplits() - Method in class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
Return all splits for scan
- getBlockletId() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getBlockPath() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getBlockPath() - Method in interface org.apache.carbondata.hadoop.internal.index.Block
-
- getBlockRowCount(Job, CarbonTable, List<PartitionSpec>) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
Get the row count of the Block and mapping of segment and Block count.
- getBlockStorageIdMap() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
returns map of blocklocation and storage id
- getBucketId() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getCarbonInputSplitList() - Method in class org.apache.carbondata.hadoop.util.CarbonInputSplitTaskInfo
-
- getCarbonTable(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- getColumnProjection(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getCurrentKey() - Method in class org.apache.carbondata.hadoop.CarbonRecordReader
-
- getCurrentValue() - Method in class org.apache.carbondata.hadoop.CarbonRecordReader
-
- getDatabaseName(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getDatabaseName(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- getDataBlocksOfSegment(JobContext, CarbonTable, Expression, BitSet, List<Segment>, PartitionInfo, List<Integer>) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
get data blocks of given segment
- getDataTypeConverter(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getDeleteDeltaFiles() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getDetailInfo() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getFileFormat() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getFileFormat() - Method in class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- getFilterPredicates(Configuration) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getHitedStreamFiles() - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getIfPresent(K) - Method in class org.apache.carbondata.hadoop.CacheAccessClient
-
This method will return the value for the given key.
- getInvalidSegments() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getInvalidTimestampRange() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getJobId(Date, int) - Static method in class org.apache.carbondata.hadoop.util.CarbonInputFormatUtil
-
- getLength() - Method in class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- getLoadModel() - Method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat.CarbonRecordWriter
-
- getLoadModel(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- getLocations() - Method in class org.apache.carbondata.hadoop.CarbonMultiBlockSplit
-
- getLocations() - Method in class org.apache.carbondata.hadoop.util.CarbonInputSplitTaskInfo
-
- getMatchedBlocklets() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getMatchedBlocklets() - Method in interface org.apache.carbondata.hadoop.internal.index.Block
-
return all matched blocklets for scanning
- getNumberOfBlocklets() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
returns the number of blocklets
- getNumBlocks() - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getNumSegments() - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getNumStreamFiles() - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getNumStreamSegments() - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getOrCreateCarbonTable(Configuration) - Method in class org.apache.carbondata.hadoop.api.CarbonFileInputFormat
-
- getOrCreateCarbonTable(Configuration) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
Get the cached CarbonTable or create it by TableInfo in `configuration`
- getOrCreateCarbonTable(Configuration) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
Get the cached CarbonTable or create it by TableInfo in `configuration`
- getOutputCommitter(TaskAttemptContext) - Method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- getPartitionsToPrune(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
get list of partitions to prune
- getProgress() - Method in class org.apache.carbondata.hadoop.CarbonRecordReader
-
- getReadCommitted(JobContext, AbsoluteTableIdentifier) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
- getReadCommittedScope(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getReadSupportClass(Configuration) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getRecordWriter(TaskAttemptContext) - Method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- getSegment() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getSegmentId() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getSegmentsToAccess(JobContext, ReadCommittedScope) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
return valid segment to access
- getSplits(JobContext) - Method in class org.apache.carbondata.hadoop.api.CarbonFileInputFormat
-
Configurations FileInputFormat.INPUT_DIR
are used to get table path to read.
- getSplits(JobContext) - Method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
Configurations FileInputFormat.INPUT_DIR
are used to get table path to read.
- getSplits(JobContext) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
Configurations FileInputFormat.INPUT_DIR
are used to get table path to read.
- getSplitsOfOneSegment(JobContext, String, List<Integer>, PartitionInfo) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
Read data in one segment.
- getSplitsOfStreaming(JobContext, List<Segment>, CarbonTable) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
- getSplitsOfStreaming(JobContext, List<Segment>, CarbonTable, FilterResolverIntf) - Method in class org.apache.carbondata.hadoop.api.CarbonTableInputFormat
-
use file list in .carbonindex file to get the split of streaming.
- getTableBlockInfo(CarbonInputSplit) - Static method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- getTableInfo(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
Get TableInfo object from `configuration`
- getTableName(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
- getTableName(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- getTablePath(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-
- getTaskId() - Method in class org.apache.carbondata.hadoop.util.CarbonInputSplitTaskInfo
-
- getValidateSegmentsToAccess(Configuration) - Static method in class org.apache.carbondata.hadoop.api.CarbonInputFormat
-
get list of segment to access
- getVersion() - Method in class org.apache.carbondata.hadoop.CarbonInputSplit
-
- GLOBAL_SORT_PARTITIONS - Static variable in class org.apache.carbondata.hadoop.api.CarbonTableOutputFormat
-