ai.djl.serving.wlm

Interface GpuAssignmentStrategy

All Known Implementing Classes:

RoundRobinGpuAssignmentStrategy

public interface GpuAssignmentStrategy

Strategies to find next available GpuID.

Method Summary

Modifier and Type	Method and Description
int	nextGpuId() Returns next gpuId.

Method Detail

nextGpuId

int nextGpuId()

Returns next gpuId.

Returns:

gpuId or -1 if no gpu is avaiable