ai.djl.serving

Class ModelServer

java.lang.Object

ai.djl.serving.ModelServer

public class ModelServer
extends java.lang.Object

The main entry point for model server.

Constructor Summary

Constructors

Constructor and Description
ModelServer(ConfigManager configManager) Creates a new ModelServer instance.

Method Summary

Modifier and Type	Method and Description
boolean	isRunning() Return if the server is running.
static void	main(java.lang.String[] args) The entry point for the model server.
java.util.List<io.netty.channel.ChannelFuture>	start() Main Method that prepares the future for the channel and sets up the ServerBootstrap.
void	startAndWait() Starts the model server and block until server stops.
void	stop() Stops the model server.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ModelServer

public ModelServer(ConfigManager configManager)

Creates a new ModelServer instance.

Parameters:

configManager - the model server configuration

Method Detail

main

public static void main(java.lang.String[] args)

The entry point for the model server.

Parameters:

args - the command line arguments

startAndWait

public void startAndWait()
                  throws java.lang.InterruptedException,
                         java.io.IOException,
                         java.security.GeneralSecurityException

Starts the model server and block until server stops.

Throws:

java.lang.InterruptedException - if interrupted

java.io.IOException - if failed to start socket listener

java.security.GeneralSecurityException - if failed to read SSL certificate

start

public java.util.List<io.netty.channel.ChannelFuture> start()
                                                     throws java.lang.InterruptedException,
                                                            java.io.IOException,
                                                            java.security.GeneralSecurityException

Main Method that prepares the future for the channel and sets up the ServerBootstrap.

Returns:

a list of ChannelFuture object

Throws:

java.lang.InterruptedException - if interrupted

java.io.IOException - if failed to start socket listener

java.security.GeneralSecurityException - if failed to read SSL certificate

isRunning

public boolean isRunning()

Return if the server is running.

Returns:

true if the server is running

stop

public void stop()

Stops the model server.