Packages

c

com.intel.analytics.bigdl.serving

ClusterServingInference

class ClusterServingInference extends AnyRef

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ClusterServingInference
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ClusterServingInference(modelKey: String = null)

    modelKey

    Whether multiple Cluster Serving jobs share a same process (JVM) If not sharing, modelKey should be null

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def batchInput(seq: Seq[(String, Activity)], batchSize: Int, useMultiThreading: Boolean, resizeFlag: Boolean = true): Activity
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. val helper: ClusterServingHelper
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. val logger: Logger
  15. def multiThreadInference(in: List[(String, Activity)]): List[(String, String)]
  16. def multiThreadPipeline(in: List[(String, String, String)]): List[(String, String)]
  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. def preProcess(in: List[(String, String, String)], multiThread: Boolean = false): List[(String, Activity)]
  21. val preProcessing: PreProcessing
  22. def singleThreadBatchInference(in: List[(String, Activity)]): List[(String, String)]

    Deprecated Current used for OpenVINO model, use multiple thread to inference, and single thread to do other operations, normally only one model is used, and every thread in pipeline try to get this model if it goes to inference stage Do not need to set resize label, because only OpenVINO use it, and OpenVINO only support fixed size of input, thus mutable batch size is not supported

  23. def singleThreadInference(in: List[(String, Activity)]): List[(String, String)]
  24. def singleThreadPipeline(in: List[(String, String, String)]): List[(String, String)]
  25. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  26. def toString(): String
    Definition Classes
    AnyRef → Any
  27. def typeCheck(input: Activity): Activity

    Use for single thread inference, to construct a batchSize = 1 input Also return a Tensor if input Table has only one element

    Use for single thread inference, to construct a batchSize = 1 input Also return a Tensor if input Table has only one element

    input

    Input table or tensor

    returns

    input with single element batch constructed

  28. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Deprecated Value Members

  1. def dimCheck(input: Activity, op: String, modelType: String): Activity

    Add or remove the singleton dimension for some specific model types

    Add or remove the singleton dimension for some specific model types

    input

    the input to change dimension

    op

    String, "add" or "remove"

    modelType

    model type

    returns

    input with dimension changed

    Annotations
    @deprecated
    Deprecated

Inherited from AnyRef

Inherited from Any

Ungrouped