org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair

Class FSSchedulerApp

java.lang.Object

org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt

org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerApp

@InterfaceAudience.Private
@InterfaceStability.Unstable
public class FSSchedulerApp
extends SchedulerApplicationAttempt

Represents an application attempt from the viewpoint of the Fair Scheduler.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt

SchedulerApplicationAttempt.ContainersAndNMTokensAllocation

Field Summary

Fields inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt

appSchedulingInfo, currentConsumption, currentReservation, isStopped, lastScheduledContainer, liveContainers, newlyAllocatedContainers, queue, reservedContainers, rmContext

Constructor Summary

Constructors

Constructor and Description
FSSchedulerApp(org.apache.hadoop.yarn.api.records.ApplicationAttemptId applicationAttemptId, String user, FSLeafQueue queue, ActiveUsersManager activeUsersManager, RMContext rmContext)

Method Summary

Methods

Modifier and Type	Method and Description
void	addPreemption(RMContainer container, long time)
RMContainer	allocate(NodeType type, FSSchedulerNode node, org.apache.hadoop.yarn.api.records.Priority priority, org.apache.hadoop.yarn.api.records.ResourceRequest request, org.apache.hadoop.yarn.api.records.Container container)
void	clearPreemptedResources()
void	containerCompleted(RMContainer rmContainer, org.apache.hadoop.yarn.api.records.ContainerStatus containerStatus, RMContainerEventType event)
NodeType	getAllowedLocalityLevel(org.apache.hadoop.yarn.api.records.Priority priority, int numNodes, double nodeLocalityThreshold, double rackLocalityThreshold) Return the level at which we are allowed to schedule containers, given the current size of the cluster and thresholds indicating how many nodes to fail at (as a fraction of cluster size) before relaxing scheduling constraints.
NodeType	getAllowedLocalityLevelByTime(org.apache.hadoop.yarn.api.records.Priority priority, long nodeLocalityDelayMs, long rackLocalityDelayMs, long currentTimeMs) Return the level at which we are allowed to schedule containers.
AppSchedulable	getAppSchedulable()
Long	getContainerPreemptionTime(RMContainer container)
float	getLocalityWaitFactor(org.apache.hadoop.yarn.api.records.Priority priority, int clusterNodes)
org.apache.hadoop.yarn.api.records.Resource	getPreemptedResources()
Set<RMContainer>	getPreemptionContainers()
FSLeafQueue	getQueue()
void	resetAllowedLocalityLevel(org.apache.hadoop.yarn.api.records.Priority priority, NodeType level) Should be called when the scheduler assigns a container at a higher degree of locality than the current threshold.
void	resetPreemptedResources()
void	setAppSchedulable(AppSchedulable appSchedulable)
void	unreserve(FSSchedulerNode node, org.apache.hadoop.yarn.api.records.Priority priority)

Methods inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt

addReReservation, addSchedulingOpportunity, containerLaunchedOnNode, getAMResource, getApplicationAttemptId, getApplicationId, getCurrentConsumption, getCurrentReservation, getHeadroom, getLastScheduledContainer, getLiveContainers, getLiveContainersMap, getNewContainerId, getNumReservedContainers, getPriorities, getQueueName, getReReservations, getReservedContainers, getResource, getResourceLimit, getResourceRequest, getResourceRequests, getResourceUsageReport, getRMContainer, getSchedulingOpportunities, getTotalRequiredResources, getUnmanagedAM, getUser, isAmRunning, isBlacklisted, isPending, isReserved, isStopped, move, pullNewlyAllocatedContainersAndNMTokens, recoverContainer, recoverResourceRequests, reserve, resetReReservations, resetSchedulingOpportunities, resetSchedulingOpportunities, setAMResource, setAmRunning, setHeadroom, showRequests, stop, subtractSchedulingOpportunity, transferStateFromPreviousAttempt, updateBlacklist, updateResourceRequests

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FSSchedulerApp

public FSSchedulerApp(org.apache.hadoop.yarn.api.records.ApplicationAttemptId applicationAttemptId,
              String user,
              FSLeafQueue queue,
              ActiveUsersManager activeUsersManager,
              RMContext rmContext)

Method Detail

setAppSchedulable

public void setAppSchedulable(AppSchedulable appSchedulable)

getAppSchedulable

public AppSchedulable getAppSchedulable()

containerCompleted

public void containerCompleted(RMContainer rmContainer,
                      org.apache.hadoop.yarn.api.records.ContainerStatus containerStatus,
                      RMContainerEventType event)

unreserve

public void unreserve(FSSchedulerNode node,
             org.apache.hadoop.yarn.api.records.Priority priority)

getLocalityWaitFactor

public float getLocalityWaitFactor(org.apache.hadoop.yarn.api.records.Priority priority,
                          int clusterNodes)

getAllowedLocalityLevel

public NodeType getAllowedLocalityLevel(org.apache.hadoop.yarn.api.records.Priority priority,
                               int numNodes,
                               double nodeLocalityThreshold,
                               double rackLocalityThreshold)

Return the level at which we are allowed to schedule containers, given the current size of the cluster and thresholds indicating how many nodes to fail at (as a fraction of cluster size) before relaxing scheduling constraints.

getAllowedLocalityLevelByTime

public NodeType getAllowedLocalityLevelByTime(org.apache.hadoop.yarn.api.records.Priority priority,
                                     long nodeLocalityDelayMs,
                                     long rackLocalityDelayMs,
                                     long currentTimeMs)

Return the level at which we are allowed to schedule containers. Given the thresholds indicating how much time passed before relaxing scheduling constraints.

allocate

public RMContainer allocate(NodeType type,
                   FSSchedulerNode node,
                   org.apache.hadoop.yarn.api.records.Priority priority,
                   org.apache.hadoop.yarn.api.records.ResourceRequest request,
                   org.apache.hadoop.yarn.api.records.Container container)

resetAllowedLocalityLevel

public void resetAllowedLocalityLevel(org.apache.hadoop.yarn.api.records.Priority priority,
                             NodeType level)

Should be called when the scheduler assigns a container at a higher degree of locality than the current threshold. Reset the allowed locality level to a higher degree of locality.

addPreemption

public void addPreemption(RMContainer container,
                 long time)

getContainerPreemptionTime

public Long getContainerPreemptionTime(RMContainer container)

getPreemptionContainers

public Set<RMContainer> getPreemptionContainers()

getQueue

public FSLeafQueue getQueue()

Overrides:

getQueue in class SchedulerApplicationAttempt

getPreemptedResources

public org.apache.hadoop.yarn.api.records.Resource getPreemptedResources()

resetPreemptedResources

public void resetPreemptedResources()

clearPreemptedResources

public void clearPreemptedResources()