Package io.trino.server.remotetask

Class HttpRemoteTask

java.lang.Object

io.trino.server.remotetask.HttpRemoteTask

All Implemented Interfaces:

RemoteTask

public final class HttpRemoteTask
extends Object
implements RemoteTask

Constructor Summary

Constructors

Constructor

Description

HttpRemoteTask(Session session, io.opentelemetry.api.trace.Span stageSpan, TaskId taskId, InternalNode node, boolean speculative, URI location, PlanFragment planFragment, com.google.common.collect.Multimap<PlanNodeId,Split> initialSplits, OutputBuffers outputBuffers, io.airlift.http.client.HttpClient httpClient, Executor executor, ScheduledExecutorService updateScheduledExecutor, ScheduledExecutorService errorScheduledExecutor, io.airlift.units.Duration maxErrorDuration, io.airlift.units.Duration taskStatusRefreshMaxWait, io.airlift.units.Duration taskInfoUpdateInterval, io.airlift.units.Duration taskTerminationTimeout, boolean summarizeTaskInfo, io.airlift.json.JsonCodec<TaskStatus> taskStatusCodec, io.airlift.json.JsonCodec<DynamicFiltersCollector.VersionedDynamicFilterDomains> dynamicFilterDomainsCodec, io.airlift.json.JsonCodec<TaskInfo> taskInfoCodec, io.airlift.json.JsonCodec<TaskUpdateRequest> taskUpdateRequestCodec, io.airlift.json.JsonCodec<FailTaskRequest> failTaskRequestCodec, NodeTaskMap.PartitionedSplitCountTracker partitionedSplitCountTracker, io.opentelemetry.api.trace.Tracer tracer, RemoteTaskStats stats, DynamicFilterService dynamicFilterService, Set<DynamicFilterId> outboundDynamicFilterIds, Optional<io.airlift.units.DataSize> estimatedMemory)

Method Summary

Modifier and Type	Method	Description
void	abort()
void	addFinalTaskInfoListener(StateMachine.StateChangeListener<TaskInfo> stateChangeListener)	Add a listener for the final task info.
void	addSplits(com.google.common.collect.Multimap<PlanNodeId,Split> splitsBySource)
void	addStateChangeListener(StateMachine.StateChangeListener<TaskStatus> stateChangeListener)	Listener is always notified asynchronously using a dedicated notification thread pool so, care should be taken to avoid leaking this when adding a listener in a constructor.
void	cancel()
void	failLocallyImmediately(Throwable cause)	Fails task from the coordinator perspective immediately, without waiting for acknowledgement from the remote task
void	failRemotely(Throwable cause)	Trigger remote task failure.
String	getNodeId()
PartitionedSplitsInfo	getPartitionedSplitsInfo()
PartitionedSplitsInfo	getQueuedPartitionedSplitsInfo()
TaskId	getTaskId()
TaskInfo	getTaskInfo()
TaskStatus	getTaskStatus()
int	getUnacknowledgedPartitionedSplitCount()
PartitionedSplitsInfo	getUnacknowledgedPartitionedSplitsInfo()
void	noMoreSplits(PlanNodeId sourceId)
SpoolingOutputStats.Snapshot	retrieveAndDropSpoolingOutputStats()	Retrieves spooling output stats.
void	setOutputBuffers(OutputBuffers newOutputBuffers)
void	setSpeculative(boolean speculative)
void	start()
String	toString()
com.google.common.util.concurrent.ListenableFuture<Void>	whenSplitQueueHasSpace(long weightThreshold)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Details

HttpRemoteTask

public HttpRemoteTask(Session session,
 io.opentelemetry.api.trace.Span stageSpan,
 TaskId taskId,
 InternalNode node,
 boolean speculative,
 URI location,
 PlanFragment planFragment,
 com.google.common.collect.Multimap<PlanNodeId,Split> initialSplits,
 OutputBuffers outputBuffers,
 io.airlift.http.client.HttpClient httpClient,
 Executor executor,
 ScheduledExecutorService updateScheduledExecutor,
 ScheduledExecutorService errorScheduledExecutor,
 io.airlift.units.Duration maxErrorDuration,
 io.airlift.units.Duration taskStatusRefreshMaxWait,
 io.airlift.units.Duration taskInfoUpdateInterval,
 io.airlift.units.Duration taskTerminationTimeout,
 boolean summarizeTaskInfo,
 io.airlift.json.JsonCodec<TaskStatus> taskStatusCodec,
 io.airlift.json.JsonCodec<DynamicFiltersCollector.VersionedDynamicFilterDomains> dynamicFilterDomainsCodec,
 io.airlift.json.JsonCodec<TaskInfo> taskInfoCodec,
 io.airlift.json.JsonCodec<TaskUpdateRequest> taskUpdateRequestCodec,
 io.airlift.json.JsonCodec<FailTaskRequest> failTaskRequestCodec,
 NodeTaskMap.PartitionedSplitCountTracker partitionedSplitCountTracker,
 io.opentelemetry.api.trace.Tracer tracer,
 RemoteTaskStats stats,
 DynamicFilterService dynamicFilterService,
 Set<DynamicFilterId> outboundDynamicFilterIds,
 Optional<io.airlift.units.DataSize> estimatedMemory)

Method Details

getTaskId

public TaskId getTaskId()

Specified by:

getTaskId in interface RemoteTask

getNodeId

public String getNodeId()

Specified by:

getNodeId in interface RemoteTask

getTaskInfo

public TaskInfo getTaskInfo()

Specified by:

getTaskInfo in interface RemoteTask

getTaskStatus

public TaskStatus getTaskStatus()

Specified by:

getTaskStatus in interface RemoteTask

start

public void start()

Specified by:

start in interface RemoteTask

addSplits

public void addSplits(com.google.common.collect.Multimap<PlanNodeId,Split> splitsBySource)

Specified by:

addSplits in interface RemoteTask

noMoreSplits

public void noMoreSplits(PlanNodeId sourceId)

Specified by:

noMoreSplits in interface RemoteTask

setOutputBuffers

public void setOutputBuffers(OutputBuffers newOutputBuffers)

Specified by:

setOutputBuffers in interface RemoteTask

setSpeculative

public void setSpeculative(boolean speculative)

Specified by:

setSpeculative in interface RemoteTask

getPartitionedSplitsInfo

public PartitionedSplitsInfo getPartitionedSplitsInfo()

Specified by:

getPartitionedSplitsInfo in interface RemoteTask

getUnacknowledgedPartitionedSplitsInfo

public PartitionedSplitsInfo getUnacknowledgedPartitionedSplitsInfo()

getQueuedPartitionedSplitsInfo

public PartitionedSplitsInfo getQueuedPartitionedSplitsInfo()

Specified by:

getQueuedPartitionedSplitsInfo in interface RemoteTask

getUnacknowledgedPartitionedSplitCount

public int getUnacknowledgedPartitionedSplitCount()

Specified by:

getUnacknowledgedPartitionedSplitCount in interface RemoteTask

retrieveAndDropSpoolingOutputStats

public SpoolingOutputStats.Snapshot retrieveAndDropSpoolingOutputStats()

Description copied from interface: RemoteTask

Retrieves spooling output stats. Stats are available only for tasks that are in the TaskState.FINISHED state and have received the final task info (see RemoteTask.addFinalTaskInfoListener(StateChangeListener). Stats can be retrieved only once and are discarded upon retrieval. Subsequent calls to the method after initial retrieval will fail.

The retrieve-and-drop semantics is necessary to avoid unnecessary memory overhead of keeping the SpoolingOutputStats.Snapshot for every task as usually only the total output of the entire stage is of interest.

Specified by:

retrieveAndDropSpoolingOutputStats in interface RemoteTask

Returns:

spooling output statistics

addStateChangeListener

public void addStateChangeListener(StateMachine.StateChangeListener<TaskStatus> stateChangeListener)

Description copied from interface: RemoteTask

Listener is always notified asynchronously using a dedicated notification thread pool so, care should be taken to avoid leaking this when adding a listener in a constructor. Additionally, it is possible notifications are observed out of order due to the asynchronous execution.

Specified by:

addStateChangeListener in interface RemoteTask

addFinalTaskInfoListener

public void addFinalTaskInfoListener(StateMachine.StateChangeListener<TaskInfo> stateChangeListener)

Description copied from interface: RemoteTask

Add a listener for the final task info. This notification is guaranteed to be fired only once. Listener is always notified asynchronously using a dedicated notification thread pool so, care should be taken to avoid leaking this when adding a listener in a constructor. Additionally, it is possible notifications are observed out of order due to the asynchronous execution.

Specified by:

addFinalTaskInfoListener in interface RemoteTask

whenSplitQueueHasSpace

public com.google.common.util.concurrent.ListenableFuture<Void> whenSplitQueueHasSpace(long weightThreshold)

Specified by:

whenSplitQueueHasSpace in interface RemoteTask

abort

public void abort()

Specified by:

abort in interface RemoteTask

cancel

public void cancel()

Specified by:

cancel in interface RemoteTask

failRemotely

public void failRemotely(Throwable cause)

Trigger remote task failure. Task status will be updated only when request sent to remote node returns.

Specified by:

failRemotely in interface RemoteTask

failLocallyImmediately

public void failLocallyImmediately(Throwable cause)

Description copied from interface: RemoteTask

Fails task from the coordinator perspective immediately, without waiting for acknowledgement from the remote task

Specified by:

failLocallyImmediately in interface RemoteTask

toString

public String toString()

Overrides:

toString in class Object