ai.djl.serving.http

Class DescribeModelResponse

java.lang.Object

ai.djl.serving.http.DescribeModelResponse

public class DescribeModelResponse
extends java.lang.Object

A class that holds information about model status.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DescribeModelResponse.Worker A class that holds workers information.

Constructor Summary

Constructors

Constructor and Description
DescribeModelResponse() Constructs a DescribeModelResponse instance.

Method Summary

Modifier and Type	Method and Description
void	addWorker(int id, long startTime, boolean isRunning, int gpuId) Adds worker to the worker list.
int	getBatchSize() Returns the batch size.
int	getMaxBatchDelay() Returns the maximum delay in milliseconds to aggregate a batch.
int	getMaxIdleTime() Returns the maximum idle time for worker threads.
int	getMaxWorkers() Returns the desired maximum number of workers.
int	getMinWorkers() Returns the desired minimum number of workers.
java.lang.String	getModelName() Returns the model name.
java.lang.String	getModelUrl() Returns the model URL.
java.lang.String	getStatus() Returns the model's status.
java.util.List<DescribeModelResponse.Worker>	getWorkers() Returns all workers information of the model.
boolean	isLoadedAtStartup() Returns if the models was loaded at startup.
void	setBatchSize(int batchSize) Sets the batch size.
void	setLoadedAtStartup(boolean loadedAtStartup) Sets the load at startup status.
void	setMaxBatchDelay(int maxBatchDelay) Sets the maximum delay in milliseconds to aggregate a batch.
void	setMaxIdleTime(int maxIdleTime) Sets the max idle time for worker threads.
void	setMaxWorkers(int maxWorkers) Sets the desired maximum number of workers.
void	setMinWorkers(int minWorkers) Sets the desired minimum number of workers.
void	setModelName(java.lang.String modelName) Sets the model name.
void	setModelUrl(java.lang.String modelUrl) Sets the model URL.
void	setStatus(java.lang.String status) Sets the model's status.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DescribeModelResponse

public DescribeModelResponse()

Constructs a DescribeModelResponse instance.

Method Detail

getModelName

public java.lang.String getModelName()

Returns the model name.

Returns:

the model name

setModelName

public void setModelName(java.lang.String modelName)

Sets the model name.

Parameters:

modelName - the model name

isLoadedAtStartup

public boolean isLoadedAtStartup()

Returns if the models was loaded at startup.

Returns:

true if the models was loaded at startup

setLoadedAtStartup

public void setLoadedAtStartup(boolean loadedAtStartup)

Sets the load at startup status.

Parameters:

loadedAtStartup - true if the models was loaded at startup

getModelUrl

public java.lang.String getModelUrl()

Returns the model URL.

Returns:

the model URL

setModelUrl

public void setModelUrl(java.lang.String modelUrl)

Sets the model URL.

Parameters:

modelUrl - the model URL

getMinWorkers

public int getMinWorkers()

Returns the desired minimum number of workers.

Returns:

the desired minimum number of workers

setMinWorkers

public void setMinWorkers(int minWorkers)

Sets the desired minimum number of workers.

Parameters:

minWorkers - the desired minimum number of workers

getMaxWorkers

public int getMaxWorkers()

Returns the desired maximum number of workers.

Returns:

the desired maximum number of workers

setMaxWorkers

public void setMaxWorkers(int maxWorkers)

Sets the desired maximum number of workers.

Parameters:

maxWorkers - the desired maximum number of workers

getBatchSize

public int getBatchSize()

Returns the batch size.

Returns:

the batch size

setBatchSize

public void setBatchSize(int batchSize)

Sets the batch size.

Parameters:

batchSize - the batch size

getMaxBatchDelay

public int getMaxBatchDelay()

Returns the maximum delay in milliseconds to aggregate a batch.

Returns:

the maximum delay in milliseconds to aggregate a batch

setMaxBatchDelay

public void setMaxBatchDelay(int maxBatchDelay)

Sets the maximum delay in milliseconds to aggregate a batch.

Parameters:

maxBatchDelay - the maximum delay in milliseconds to aggregate a batch

getStatus

public java.lang.String getStatus()

Returns the model's status.

Returns:

the model's status

setStatus

public void setStatus(java.lang.String status)

Sets the model's status.

Parameters:

status - the model's status

setMaxIdleTime

public void setMaxIdleTime(int maxIdleTime)

Sets the max idle time for worker threads.

Parameters:

maxIdleTime - the time a worker thread can be idle before scaling down.

getMaxIdleTime

public int getMaxIdleTime()

Returns the maximum idle time for worker threads.

Returns:

the maxIdleTime

getWorkers

public java.util.List<DescribeModelResponse.Worker> getWorkers()

Returns all workers information of the model.

Returns:

all workers information of the model

addWorker

public void addWorker(int id,
                      long startTime,
                      boolean isRunning,
                      int gpuId)

Adds worker to the worker list.

Parameters:

id - the worker's ID

startTime - the worker's start time

isRunning - true if worker is running

gpuId - the GPU id assigned to the worker, -1 for CPU