Package io.trino.execution

Class SqlTaskManager

java.lang.Object

io.trino.execution.SqlTaskManager

All Implemented Interfaces:

TaskManager, Closeable, AutoCloseable

public class SqlTaskManager
extends Object
implements TaskManager, Closeable

Constructor Summary

Constructors

Constructor

Description

SqlTaskManager(VersionEmbedder versionEmbedder, LocalExecutionPlanner planner, LocationFactory locationFactory, TaskExecutor taskExecutor, SplitMonitor splitMonitor, io.airlift.node.NodeInfo nodeInfo, LocalMemoryManager localMemoryManager, TaskManagementExecutor taskManagementExecutor, TaskManagerConfig config, NodeMemoryConfig nodeMemoryConfig, LocalSpillManager localSpillManager, NodeSpillConfig nodeSpillConfig, io.airlift.stats.GcMonitor gcMonitor)

Method Summary

Modifier and Type	Method	Description
TaskInfo	abortTask(TaskId taskId)	Aborts a task.
TaskInfo	abortTaskResults(TaskId taskId, OutputBuffers.OutputBufferId bufferId)	Aborts a result buffer for a task.
DynamicFiltersCollector.VersionedDynamicFilterDomains	acknowledgeAndGetNewDynamicFilterDomains(TaskId taskId, long currentDynamicFiltersVersion)
void	acknowledgeTaskResults(TaskId taskId, OutputBuffers.OutputBufferId bufferId, long sequenceId)	Acknowledges previously received results.
void	addStateChangeListener(TaskId taskId, StateMachine.StateChangeListener<TaskState> stateChangeListener)	Adds a state change listener to the specified task.
TaskInfo	cancelTask(TaskId taskId)	Cancels a task.
void	close()
void	failAbandonedTasks()
List<TaskInfo>	getAllTaskInfo()	Gets all of the currently tracked tasks.
List<SqlTask>	getAllTasks()
io.airlift.stats.CounterStat	getFailedTasks()
SqlTaskIoStats	getIoStats()
QueryContext	getQueryContext(QueryId queryId)
TaskInfo	getTaskInfo(TaskId taskId)	Gets the info for the specified task.
com.google.common.util.concurrent.ListenableFuture<TaskInfo>	getTaskInfo(TaskId taskId, long currentVersion)	Gets future info for the task after the state changes from current state.
String	getTaskInstanceId(TaskId taskId)	Gets the unique instance id of a task.
io.airlift.concurrent.ThreadPoolExecutorMBean	getTaskNotificationExecutor()
com.google.common.util.concurrent.ListenableFuture<BufferResult>	getTaskResults(TaskId taskId, OutputBuffers.OutputBufferId bufferId, long startingSequenceId, io.airlift.units.DataSize maxSize)	Gets results from a task either immediately or in the future.
TaskStatus	getTaskStatus(TaskId taskId)	Gets the status for the specified task.
com.google.common.util.concurrent.ListenableFuture<TaskStatus>	getTaskStatus(TaskId taskId, long currentVersion)	Gets future status for the task after the state changes from current state.
void	removeOldTasks()
void	start()
void	updateMemoryPoolAssignments(MemoryPoolAssignmentsRequest assignments)
TaskInfo	updateTask(Session session, TaskId taskId, Optional<PlanFragment> fragment, List<TaskSource> sources, OutputBuffers outputBuffers, OptionalInt totalPartitions)	Updates the task plan, sources and output buffers.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SqlTaskManager

@Inject
public SqlTaskManager(VersionEmbedder versionEmbedder,
                      LocalExecutionPlanner planner,
                      LocationFactory locationFactory,
                      TaskExecutor taskExecutor,
                      SplitMonitor splitMonitor,
                      io.airlift.node.NodeInfo nodeInfo,
                      LocalMemoryManager localMemoryManager,
                      TaskManagementExecutor taskManagementExecutor,
                      TaskManagerConfig config,
                      NodeMemoryConfig nodeMemoryConfig,
                      LocalSpillManager localSpillManager,
                      NodeSpillConfig nodeSpillConfig,
                      io.airlift.stats.GcMonitor gcMonitor)

Method Detail

updateMemoryPoolAssignments

public void updateMemoryPoolAssignments(MemoryPoolAssignmentsRequest assignments)

Specified by:

updateMemoryPoolAssignments in interface TaskManager

start

@PostConstruct
public void start()

close

@PreDestroy
public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

getIoStats

public SqlTaskIoStats getIoStats()

getTaskNotificationExecutor

public io.airlift.concurrent.ThreadPoolExecutorMBean getTaskNotificationExecutor()

getFailedTasks

public io.airlift.stats.CounterStat getFailedTasks()

getAllTasks

public List<SqlTask> getAllTasks()

getAllTaskInfo

public List<TaskInfo> getAllTaskInfo()

Description copied from interface: TaskManager

Gets all of the currently tracked tasks. This will included uninitialized, running, and completed tasks.

Specified by:

getAllTaskInfo in interface TaskManager

getTaskInfo

public TaskInfo getTaskInfo(TaskId taskId)

Description copied from interface: TaskManager

Gets the info for the specified task. If the task has not been created yet, an uninitialized task is created and the info is returned.

NOTE: this design assumes that only tasks that will eventually exist are queried.

Specified by:

getTaskInfo in interface TaskManager

getTaskStatus

public TaskStatus getTaskStatus(TaskId taskId)

Description copied from interface: TaskManager

Gets the status for the specified task.

Specified by:

getTaskStatus in interface TaskManager

getTaskInfo

public com.google.common.util.concurrent.ListenableFuture<TaskInfo> getTaskInfo(TaskId taskId,
                                                                                long currentVersion)

Description copied from interface: TaskManager

Gets future info for the task after the state changes from current state. If the task has not been created yet, an uninitialized task is created and the future is returned. If the task is already in a final state, the info is returned immediately.

NOTE: this design assumes that only tasks that will eventually exist are queried.

Specified by:

getTaskInfo in interface TaskManager

getTaskInstanceId

public String getTaskInstanceId(TaskId taskId)

Description copied from interface: TaskManager

Gets the unique instance id of a task. This can be used to detect a task that was destroyed and recreated.

Specified by:

getTaskInstanceId in interface TaskManager

getTaskStatus

public com.google.common.util.concurrent.ListenableFuture<TaskStatus> getTaskStatus(TaskId taskId,
                                                                                    long currentVersion)

Description copied from interface: TaskManager

Gets future status for the task after the state changes from current state. If the task has not been created yet, an uninitialized task is created and the future is returned. If the task is already in a final state, the status is returned immediately.

NOTE: this design assumes that only tasks that will eventually exist are queried.

Specified by:

getTaskStatus in interface TaskManager

acknowledgeAndGetNewDynamicFilterDomains

public DynamicFiltersCollector.VersionedDynamicFilterDomains acknowledgeAndGetNewDynamicFilterDomains(TaskId taskId,
                                                                                                      long currentDynamicFiltersVersion)

Specified by:

acknowledgeAndGetNewDynamicFilterDomains in interface TaskManager

updateTask

public TaskInfo updateTask(Session session,
                           TaskId taskId,
                           Optional<PlanFragment> fragment,
                           List<TaskSource> sources,
                           OutputBuffers outputBuffers,
                           OptionalInt totalPartitions)

Description copied from interface: TaskManager

Updates the task plan, sources and output buffers. If the task does not already exist, it is created and then updated.

Specified by:

updateTask in interface TaskManager

getTaskResults

public com.google.common.util.concurrent.ListenableFuture<BufferResult> getTaskResults(TaskId taskId,
                                                                                       OutputBuffers.OutputBufferId bufferId,
                                                                                       long startingSequenceId,
                                                                                       io.airlift.units.DataSize maxSize)

Description copied from interface: TaskManager

Gets results from a task either immediately or in the future. If the task or buffer has not been created yet, an uninitialized task is created and a future is returned.

NOTE: this design assumes that only tasks and buffers that will eventually exist are queried.

Specified by:

getTaskResults in interface TaskManager

acknowledgeTaskResults

public void acknowledgeTaskResults(TaskId taskId,
                                   OutputBuffers.OutputBufferId bufferId,
                                   long sequenceId)

Description copied from interface: TaskManager

Acknowledges previously received results.

Specified by:

acknowledgeTaskResults in interface TaskManager

abortTaskResults

public TaskInfo abortTaskResults(TaskId taskId,
                                 OutputBuffers.OutputBufferId bufferId)

Description copied from interface: TaskManager

Aborts a result buffer for a task. If the task or buffer has not been created yet, an uninitialized task is created and a the buffer is aborted.

NOTE: this design assumes that only tasks and buffers that will eventually exist are queried.

Specified by:

abortTaskResults in interface TaskManager

cancelTask

public TaskInfo cancelTask(TaskId taskId)

Description copied from interface: TaskManager

Cancels a task. If the task does not already exist, it is created and then canceled.

Specified by:

cancelTask in interface TaskManager

abortTask

public TaskInfo abortTask(TaskId taskId)

Description copied from interface: TaskManager

Aborts a task. If the task does not already exist, it is created and then aborted.

Specified by:

abortTask in interface TaskManager

removeOldTasks

public void removeOldTasks()

failAbandonedTasks

public void failAbandonedTasks()

addStateChangeListener

public void addStateChangeListener(TaskId taskId,
                                   StateMachine.StateChangeListener<TaskState> stateChangeListener)

Description copied from interface: TaskManager

Adds a state change listener to the specified task. Listener is always notified asynchronously using a dedicated notification thread pool so, care should be taken to avoid leaking this when adding a listener in a constructor. Additionally, it is possible notifications are observed out of order due to the asynchronous execution.

Specified by:

addStateChangeListener in interface TaskManager

getQueryContext

public QueryContext getQueryContext(QueryId queryId)