Package org.apache.pinot.segment.local.upsert

Class BaseTableUpsertMetadataManager

java.lang.Object

org.apache.pinot.segment.local.upsert.BaseTableUpsertMetadataManager

All Implemented Interfaces:

Closeable, AutoCloseable, TableUpsertMetadataManager

Direct Known Subclasses:

ConcurrentMapTableUpsertMetadataManager

@ThreadSafe
public abstract class BaseTableUpsertMetadataManager
extends Object
implements TableUpsertMetadataManager

Field Summary

Fields

Modifier and Type	Field	Description
protected List<String>	_comparisonColumns
protected String	_deleteRecordColumn
protected boolean	_enableSnapshot
protected HashFunction	_hashFunction
protected org.apache.helix.HelixManager	_helixManager
protected double	_metadataTTL
protected PartialUpsertHandler	_partialUpsertHandler
protected List<String>	_primaryKeyColumns
protected Schema	_schema
protected ExecutorService	_segmentPreloadExecutor
protected ServerMetrics	_serverMetrics
protected TableConfig	_tableConfig
protected TableDataManager	_tableDataManager
protected File	_tableIndexDir
protected String	_tableNameWithType

Constructor Summary

Constructors

Constructor	Description
BaseTableUpsertMetadataManager()

Method Summary

Modifier and Type	Method	Description
protected IndexLoadingConfig	createIndexLoadingConfig()
UpsertConfig.Mode	getUpsertMode()
void	init(TableConfig tableConfig, Schema schema, TableDataManager tableDataManager, ServerMetrics serverMetrics, org.apache.helix.HelixManager helixManager, ExecutorService segmentPreloadExecutor)
protected void	initCustomVariables()	Can be overridden to initialize custom variables after other variables are set but before preload starts.
boolean	isPreloading()
protected void	onPreloadFinish()	Can be overridden to perform operations after preload is done.
protected void	onPreloadStart()	Can be overridden to perform operations before preload starts.
protected void	preloadSegmentWithSnapshot(String segmentName, IndexLoadingConfig indexLoadingConfig, SegmentZKMetadata zkMetadata)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.io.Closeable

close

Methods inherited from interface org.apache.pinot.segment.local.upsert.TableUpsertMetadataManager

getOrCreatePartitionManager, stop

Field Detail

_tableConfig

protected TableConfig _tableConfig

_schema

protected Schema _schema

_tableDataManager

protected TableDataManager _tableDataManager

_tableNameWithType

protected String _tableNameWithType

_primaryKeyColumns

protected List<String> _primaryKeyColumns

_comparisonColumns

protected List<String> _comparisonColumns

_deleteRecordColumn

protected String _deleteRecordColumn

_hashFunction

protected HashFunction _hashFunction

_partialUpsertHandler

protected PartialUpsertHandler _partialUpsertHandler

_enableSnapshot

protected boolean _enableSnapshot

_metadataTTL

protected double _metadataTTL

_tableIndexDir

protected File _tableIndexDir

_serverMetrics

protected ServerMetrics _serverMetrics

_helixManager

protected org.apache.helix.HelixManager _helixManager

_segmentPreloadExecutor

protected ExecutorService _segmentPreloadExecutor

Constructor Detail

BaseTableUpsertMetadataManager

public BaseTableUpsertMetadataManager()

Method Detail

init

public void init(TableConfig tableConfig,
                 Schema schema,
                 TableDataManager tableDataManager,
                 ServerMetrics serverMetrics,
                 org.apache.helix.HelixManager helixManager,
                 @Nullable
                 ExecutorService segmentPreloadExecutor)

Specified by:

init in interface TableUpsertMetadataManager

initCustomVariables

protected void initCustomVariables()

Can be overridden to initialize custom variables after other variables are set but before preload starts. This is needed because preload will load segments which might require these custom variables.

onPreloadStart

protected void onPreloadStart()

Can be overridden to perform operations before preload starts.

onPreloadFinish

protected void onPreloadFinish()

Can be overridden to perform operations after preload is done.

createIndexLoadingConfig

protected IndexLoadingConfig createIndexLoadingConfig()

preloadSegmentWithSnapshot

protected void preloadSegmentWithSnapshot(String segmentName,
                                          IndexLoadingConfig indexLoadingConfig,
                                          SegmentZKMetadata zkMetadata)

isPreloading

public boolean isPreloading()

Specified by:

isPreloading in interface TableUpsertMetadataManager

getUpsertMode

public UpsertConfig.Mode getUpsertMode()

Specified by:

getUpsertMode in interface TableUpsertMetadataManager