object PredictionService
- Alphabetic
- By Inheritance
- PredictionService
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
apply[T](model: Module[T], numThreads: Int)(implicit arg0: ClassTag[T], ev: TensorNumeric[T]): PredictionService[T]
In this service, concurrency is kept not greater than
numThreadsby aBlockingQueue, which contains available model instances.Thread-safe Prediction Service for Concurrent Calls
In this service, concurrency is kept not greater than
numThreadsby aBlockingQueue, which contains available model instances.
If exceptions caught during predict, a scalar Tensor[String] will be returned with thrown message.- model
BigDL model used to do predictions
- numThreads
max concurrency
- returns
a PredictionService instance
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )
-
def
deSerializeActivity(bytes: Array[Byte]): Activity
For now,
TensorandTable[primitive|Tensor, Tensor]are supported.Deserialize Array[Byte] to activities according to
Bigdl.proto.For now,
TensorandTable[primitive|Tensor, Tensor]are supported. It will convertAttrValue(Array(BigdlTensor))to aTable. It will convertAttrValue(BigdlTensor)to aTensor.- bytes
bytes data for Activity to be deserialized
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
serializeActivity(activity: Activity): Array[Byte]
For now,
TensorandTable[primitive|Tensor, Tensor]are supported.Serialize activities to Array[Byte] according to
Bigdl.proto.For now,
TensorandTable[primitive|Tensor, Tensor]are supported.- activity
activity to be serialized
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )