org.apache.druid.server.coordinator

Class DruidCoordinator

java.lang.Object

org.apache.druid.server.coordinator.DruidCoordinator

public class DruidCoordinator
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	DruidCoordinator.DutiesRunnable

Constructor Summary

Constructors

Constructor and Description

DruidCoordinator(DruidCoordinatorConfig config, ZkPathsConfig zkPaths, JacksonConfigManager configManager, SegmentsMetadataManager segmentsMetadataManager, ServerInventoryView serverInventoryView, MetadataRuleManager metadataRuleManager, com.google.inject.Provider<org.apache.curator.framework.CuratorFramework> curatorProvider, ServiceEmitter emitter, ScheduledExecutorFactory scheduledExecutorFactory, IndexingServiceClient indexingServiceClient, LoadQueueTaskMaster taskMaster, ServiceAnnouncer serviceAnnouncer, DruidNode self, Set<CoordinatorDuty> metadataStoreManagementDuties, Set<CoordinatorDuty> indexingServiceDuties, CoordinatorCustomDutyGroups customDutyGroups, BalancerStrategyFactory factory, LookupCoordinatorManager lookupCoordinatorManager, DruidLeaderSelector coordLeaderSelector, CompactSegments compactSegments, ZkEnablementConfig zkEnablementConfig)

Method Summary

Modifier and Type	Method and Description
it.unimi.dsi.fastutil.objects.Object2IntMap<String>	computeNumsUnavailableUsedSegmentsPerDataSource()
Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>>	computeUnderReplicationCountsPerDataSourcePerTier()
Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>>	computeUnderReplicationCountsPerDataSourcePerTierForSegments(Iterable<DataSegment> dataSegments) segmentReplicantLookup use in this method could potentially be stale since it is only updated on coordinator runs.
Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>>	computeUnderReplicationCountsPerDataSourcePerTierForSegmentsUsingClusterView(Iterable<DataSegment> dataSegments) segmentReplicantLookup or cluster use in this method could potentially be stale since it is only updated on coordinator runs.
Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>>	computeUnderReplicationCountsPerDataSourcePerTierUsingClusterView()
Map<String,AutoCompactionSnapshot>	getAutoCompactionSnapshot()
AutoCompactionSnapshot	getAutoCompactionSnapshotForDataSource(String dataSource)
com.google.common.util.concurrent.ListeningExecutorService	getBalancerExec()
int	getCachedBalancerThreadNumber()
CoordinatorCompactionConfig	getCompactionConfig()
String	getCurrentLeader()
CoordinatorDynamicConfig	getDynamicConfigs()
Map<String,LoadQueuePeon>	getLoadManagementPeons()
Map<String,Double>	getLoadStatus()
Long	getTotalSizeOfSegmentsAwaitingCompaction(String dataSource)
boolean	isLeader()
void	markSegmentAsUnused(DataSegment segment)
void	moveSegment(DruidCoordinatorRuntimeParams params, ImmutableDruidServer fromServer, ImmutableDruidServer toServer, DataSegment segment, LoadPeonCallback callback)
void	runCompactSegmentsDuty()
void	start()
void	stop()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DruidCoordinator

@Inject
public DruidCoordinator(DruidCoordinatorConfig config,
                                ZkPathsConfig zkPaths,
                                JacksonConfigManager configManager,
                                SegmentsMetadataManager segmentsMetadataManager,
                                ServerInventoryView serverInventoryView,
                                MetadataRuleManager metadataRuleManager,
                                com.google.inject.Provider<org.apache.curator.framework.CuratorFramework> curatorProvider,
                                ServiceEmitter emitter,
                                ScheduledExecutorFactory scheduledExecutorFactory,
                                IndexingServiceClient indexingServiceClient,
                                LoadQueueTaskMaster taskMaster,
                                ServiceAnnouncer serviceAnnouncer,
                                DruidNode self,
                                Set<CoordinatorDuty> metadataStoreManagementDuties,
                                Set<CoordinatorDuty> indexingServiceDuties,
                                CoordinatorCustomDutyGroups customDutyGroups,
                                BalancerStrategyFactory factory,
                                LookupCoordinatorManager lookupCoordinatorManager,
                                DruidLeaderSelector coordLeaderSelector,
                                CompactSegments compactSegments,
                                ZkEnablementConfig zkEnablementConfig)

Method Detail

isLeader

public boolean isLeader()

getLoadManagementPeons

public Map<String,LoadQueuePeon> getLoadManagementPeons()

computeUnderReplicationCountsPerDataSourcePerTier

public Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>> computeUnderReplicationCountsPerDataSourcePerTier()

Returns:

tier -> { dataSource -> underReplicationCount } map

computeUnderReplicationCountsPerDataSourcePerTierUsingClusterView

public Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>> computeUnderReplicationCountsPerDataSourcePerTierUsingClusterView()

Returns:

tier -> { dataSource -> underReplicationCount } map

computeUnderReplicationCountsPerDataSourcePerTierForSegments

public Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>> computeUnderReplicationCountsPerDataSourcePerTierForSegments(Iterable<DataSegment> dataSegments)

segmentReplicantLookup use in this method could potentially be stale since it is only updated on coordinator runs. However, this is ok as long as the is refreshed/latest as this would at least still ensure that the stale data in segmentReplicantLookup would be under counting replication levels, rather than potentially falsely reporting that everything is available.

Returns:

tier -> { dataSource -> underReplicationCount } map

computeUnderReplicationCountsPerDataSourcePerTierForSegmentsUsingClusterView

public Map<String,it.unimi.dsi.fastutil.objects.Object2LongMap<String>> computeUnderReplicationCountsPerDataSourcePerTierForSegmentsUsingClusterView(Iterable<DataSegment> dataSegments)

segmentReplicantLookup or cluster use in this method could potentially be stale since it is only updated on coordinator runs. However, this is ok as long as the is refreshed/latest as this would at least still ensure that the stale data in segmentReplicantLookup and cluster would be under counting replication levels, rather than potentially falsely reporting that everything is available.

Returns:

tier -> { dataSource -> underReplicationCount } map

computeNumsUnavailableUsedSegmentsPerDataSource

public it.unimi.dsi.fastutil.objects.Object2IntMap<String> computeNumsUnavailableUsedSegmentsPerDataSource()

getLoadStatus

public Map<String,Double> getLoadStatus()

getTotalSizeOfSegmentsAwaitingCompaction

@Nullable
public Long getTotalSizeOfSegmentsAwaitingCompaction(String dataSource)

getAutoCompactionSnapshotForDataSource

@Nullable
public AutoCompactionSnapshot getAutoCompactionSnapshotForDataSource(String dataSource)

getAutoCompactionSnapshot

public Map<String,AutoCompactionSnapshot> getAutoCompactionSnapshot()

getDynamicConfigs

public CoordinatorDynamicConfig getDynamicConfigs()

getCompactionConfig

public CoordinatorCompactionConfig getCompactionConfig()

markSegmentAsUnused

public void markSegmentAsUnused(DataSegment segment)

getCurrentLeader

public String getCurrentLeader()

moveSegment

public void moveSegment(DruidCoordinatorRuntimeParams params,
                        ImmutableDruidServer fromServer,
                        ImmutableDruidServer toServer,
                        DataSegment segment,
                        LoadPeonCallback callback)

getCachedBalancerThreadNumber

public int getCachedBalancerThreadNumber()

getBalancerExec

public com.google.common.util.concurrent.ListeningExecutorService getBalancerExec()

start

public void start()

stop

public void stop()

runCompactSegmentsDuty

public void runCompactSegmentsDuty()