ai.djl.inference.streaming (Deep Java Library 0.24.0 API specification)

Contains classes to implement streaming inference tasks.

See Also:: Predictor

Interface Summary
Interface	Description
StreamingBlock	A `Block` possessing the additional streaming forward capabilities used by `Predictor.streamingPredict(Object)`.
StreamingTranslator<I,O>	An expansion of the `Translator` with postProcessing for the `StreamingBlock` (used by `Predictor.streamingPredict(Object)`.

Class Summary
Class	Description
ChunkedBytesSupplier	A {link BytesSupplier} that supports chunked reading.
IteratorBytesSupplier	An `IteratorBytesSupplier` is a streaming `BytesSupplier` suitable for synchronous usage.
PublisherBytesSupplier	An `PublisherBytesSupplier` is a streaming `BytesSupplier` suitable for reactive asynchronous usage.
StreamingTranslator.StreamOutput<O>	A `StreamingTranslator.StreamOutput` represents a streamable output type (either iterative or asynchronous).

Enum Summary
Enum Description

StreamingTranslator.Support
What types of StreamingTranslator.StreamOutputs are supported by a StreamingTranslator.