class Predictor[T] extends Serializable
Predictor for distributed data
NOTE: The predictClass, predict and predictImage will call the relevant methods of
object Predictor. Why we do this? Because every these methods uses the ClassTag T. If we do
these jobs in the methods of classPredictor, when we do mapPartition, Spark will find all
used values and do serialization. The T is the argument of constructor, the serialization will
package the whole Predictor class, which contains themodel. It will send a duplicate model
to the workers. So we should move these methods to object Predictor.
- Alphabetic
- By Inheritance
- Predictor
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def predict(dataSet: RDD[Sample[T]], batchSize: Int = -1, shareBuffer: Boolean = false): RDD[Activity]
- def predictClass(dataSet: RDD[Sample[T]], batchSize: Int = -1): RDD[Int]
-
def
predictImage(imageFrame: DistributedImageFrame, outputLayer: String = null, shareBuffer: Boolean = false, predictKey: String = ImageFeature.predict): DistributedImageFrame
model predict DistributedImageFrame, return imageFrame with predicted tensor
model predict DistributedImageFrame, return imageFrame with predicted tensor
- imageFrame
imageFrame that contains images
- outputLayer
if outputLayer is not null, the output of layer that matches outputLayer will be used as predicted output
- shareBuffer
whether to share same memory for each batch predict results
- predictKey
key to store predicted result
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )