ai.djl.serving.wlm

Class RoundRobinGpuAssignmentStrategy

java.lang.Object

ai.djl.serving.wlm.RoundRobinGpuAssignmentStrategy

All Implemented Interfaces:

GpuAssignmentStrategy

public class RoundRobinGpuAssignmentStrategy
extends java.lang.Object
implements GpuAssignmentStrategy

Assign next gpu using round robin to get the next gpuID.

Constructor Summary

Constructors

Constructor and Description
RoundRobinGpuAssignmentStrategy(ConfigManager configManager) Construct a round robin gpu assignment strategy.

Method Summary

Modifier and Type	Method and Description
int	nextGpuId() Returns next gpuId.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RoundRobinGpuAssignmentStrategy

public RoundRobinGpuAssignmentStrategy(ConfigManager configManager)

Construct a round robin gpu assignment strategy.

Parameters:

configManager - use this configuration manager.

Method Detail

nextGpuId

public int nextGpuId()

Returns next gpuId.

Specified by:

nextGpuId in interface GpuAssignmentStrategy

Returns:

gpuId or -1 if no gpu is avaiable