ai.djl.serving.wlm

Class Endpoint

java.lang.Object

ai.djl.serving.wlm.Endpoint

public class Endpoint
extends java.lang.Object

A class that represents a webservice endpoint.

Constructor Summary

Constructors

Constructor and Description
Endpoint() Constructs an Endpoint instance.

Method Summary

Modifier and Type	Method and Description
boolean	add(ModelInfo modelInfo) Adds a model to the entpoint.
ModelInfo	get(java.lang.String version) Returns the ModelInfo for the specified version.
java.util.List<ModelInfo>	getModels() Returns the models associated with the endpoint.
ModelInfo	next() Returns the next version of model to serve the inference request.
ModelInfo	remove(java.lang.String version) Removes a model version from the Endpoint.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Endpoint

public Endpoint()

Constructs an Endpoint instance.

Method Detail

add

public boolean add(ModelInfo modelInfo)

Adds a model to the entpoint.

Parameters:

modelInfo - the model to be added

Returns:

true if add success

getModels

public java.util.List<ModelInfo> getModels()

Returns the models associated with the endpoint.

Returns:

the models associated with the endpoint

remove

public ModelInfo remove(java.lang.String version)

Removes a model version from the Endpoint.

Parameters:

version - the model version

Returns:

null if the specified version doesn't exist

get

public ModelInfo get(java.lang.String version)

Returns the ModelInfo for the specified version.

Parameters:

version - the version of the model to retrieve

Returns:

the ModelInfo for the specified version

next

public ModelInfo next()

Returns the next version of model to serve the inference request.

Returns:

the next version of model to serve the inference request