ai.djl.serving.http

Class InferenceRequestHandler

java.lang.Object

io.netty.channel.ChannelHandlerAdapter

io.netty.channel.ChannelInboundHandlerAdapter

io.netty.channel.SimpleChannelInboundHandler<io.netty.handler.codec.http.FullHttpRequest>

ai.djl.serving.http.HttpRequestHandler

ai.djl.serving.http.InferenceRequestHandler

All Implemented Interfaces:

io.netty.channel.ChannelHandler, io.netty.channel.ChannelInboundHandler

public class InferenceRequestHandler
extends HttpRequestHandler

A class handling inbound HTTP requests for the management API.

Nested Class Summary

Nested classes/interfaces inherited from interface io.netty.channel.ChannelHandler

io.netty.channel.ChannelHandler.Sharable

Constructor Summary

Constructors

Constructor and Description
InferenceRequestHandler() default constructor.

Method Summary

Modifier and Type	Method and Description
boolean	acceptInboundMessage(java.lang.Object msg)
protected void	handleRequest(io.netty.channel.ChannelHandlerContext ctx, io.netty.handler.codec.http.FullHttpRequest req, io.netty.handler.codec.http.QueryStringDecoder decoder, java.lang.String[] segments)

Methods inherited from class ai.djl.serving.http.HttpRequestHandler

channelRead0, exceptionCaught

Methods inherited from class io.netty.channel.SimpleChannelInboundHandler

channelRead

Methods inherited from class io.netty.channel.ChannelInboundHandlerAdapter

channelActive, channelInactive, channelReadComplete, channelRegistered, channelUnregistered, channelWritabilityChanged, userEventTriggered

Methods inherited from class io.netty.channel.ChannelHandlerAdapter

ensureNotSharable, handlerAdded, handlerRemoved, isSharable

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.netty.channel.ChannelHandler

handlerAdded, handlerRemoved

Constructor Detail

InferenceRequestHandler

public InferenceRequestHandler()

default constructor.

Method Detail

acceptInboundMessage

public boolean acceptInboundMessage(java.lang.Object msg)
                             throws java.lang.Exception

Overrides:

acceptInboundMessage in class io.netty.channel.SimpleChannelInboundHandler<io.netty.handler.codec.http.FullHttpRequest>

Throws:

java.lang.Exception

handleRequest

protected void handleRequest(io.netty.channel.ChannelHandlerContext ctx,
                             io.netty.handler.codec.http.FullHttpRequest req,
                             io.netty.handler.codec.http.QueryStringDecoder decoder,
                             java.lang.String[] segments)
                      throws ai.djl.ModelException

Specified by:

handleRequest in class HttpRequestHandler

Throws:

ai.djl.ModelException