package parameters
Ordering
- Alphabetic
Visibility
- Public
- All
Type Members
-
class
AllReduceParameter[T] extends Serializable
Represent parameters stored on the block manager.
Represent parameters stored on the block manager. In distributed optimization, we put parameters on block manager of spark. Each worker syncs parameters through the block manager. Block manager here serves as a parameter server.
A Tensor is sliced into
partitionNumchunks and each chunk is assigned to a particular node (Spark executor). Likewise, gradients for each chunk are also assigned and stored on separate nodes. In this way, gradient aggregation and parameter updates can be performed independently for each chunk on separate nodes.- T
Tensor element type
-
trait
CompressedTensor[T] extends Serializable
This trait represents the compressed tensor.
This trait represents the compressed tensor.
- T
data type (Double or Float)
- class FP16SplitsCompressedTensor[T] extends CompressedTensor[T]
Value Members
- object AllReduceParameter extends Serializable
- object FP16CompressedTensor extends Serializable
- object SerializerInstance
- object UncompressedTensor extends Serializable