com.twitter.finagle.thrift.exp.partitioning
ClientCustomStrategy
Companion class ClientCustomStrategy
object ClientCustomStrategy
- Alphabetic
- By Inheritance
- ClientCustomStrategy
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Type Members
- type ToPartitionedMap = PartialFunction[ThriftStructIface, Future[Map[Int, ThriftStructIface]]]
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
clusterResharding(getPartitionIdAndRequestFn: (Set[Address]) ⇒ ToPartitionedMap, getLogicalPartitionIdFn: (Set[Address]) ⇒ (Int) ⇒ Seq[Int]): CustomPartitioningStrategy
Constructs a ClientCustomStrategy that reshards based on the remote cluster state.
Constructs a ClientCustomStrategy that reshards based on the remote cluster state.
This is appropriate for simple custom strategies where you only need to know information about the remote cluster in order to reshard. For example, if you want to be able to add or remove capacity safely.
Java users should see ClientCustomStrategies$ for an easier to use API.
- getPartitionIdAndRequestFn
A function that given the current state of the remote cluster, returns a PartialFunction implemented by client that provides the partitioning logic on a request. It takes a Thrift object request, and returns Future Map of partition ids to sub-requests. If we don't need to fan-out, it should return one element: partition id to the original request. This PartialFunction can take multiple Thrift request types of one Thrift service (different method endpoints of one service). Note that this function must be pure (ie referentially transparent). It cannot change based on anything other than the state of the remote cluster it is provided with, or else it will malfunction.
- getLogicalPartitionIdFn
A function that given the current state of the remote cluster, returns a function that gets the logical partition identifiers from a host identifier, host identifiers are derived from ZkMetadata shardId. Indicates which logical partitions a physical host belongs to, multiple hosts can belong to the same partition, and one host can belong to multiple partitions, for example:
{ case a if Range(0, 10).contains(a) => Seq(0, 1) case b if Range(10, 20).contains(b) => Seq(1) case c if Range(20, 30).contains(c) => Seq(2) case _ => throw ... }Note that this function must be pure (ie referentially transparent). It cannot change based on anything other than the state of the remote cluster it is provided with, or else it will malfunction.
-
def
clusterResharding(getPartitionIdAndRequestFn: (Set[Address]) ⇒ ToPartitionedMap): CustomPartitioningStrategy
Constructs a ClientCustomStrategy that reshards based on the remote cluster state.
Constructs a ClientCustomStrategy that reshards based on the remote cluster state.
This is appropriate for simple custom strategies where you only need to know information about the remote cluster in order to reshard. For example, if you want to be able to add or remove capacity safely.
Java users should see ClientCustomStrategies$ for an easier to use API.
- getPartitionIdAndRequestFn
A function that given the current state of the remote cluster, returns a function that gets the logical partition identifier from a host identifier, host identifiers are derived from ZkMetadata shardId. Indicates which logical partition a physical host belongs to, multiple hosts can belong to the same partition, and one host can belong to multiple partitions, for example:
{ case a if Range(0, 10).contains(a) => Seq(0, 1) case b if Range(10, 20).contains(b) => Seq(1) case c if Range(20, 30).contains(c) => Seq(2) case _ => throw ... }Note that this function must be pure (ie referentially transparent). It cannot change based on anything other than the state of the remote cluster it is provided with, or else it will malfunction.
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
noResharding(getPartitionIdAndRequest: ToPartitionedMap, getLogicalPartitionId: (Int) ⇒ Seq[Int]): CustomPartitioningStrategy
Constructs a ClientCustomStrategy that does not reshard.
Constructs a ClientCustomStrategy that does not reshard.
This is appropriate for static partitioning backend topologies.
Java users should see ClientCustomStrategies$ for an easier to use API.
- getPartitionIdAndRequest
A PartialFunction implemented by client that provides the partitioning logic on a request. It takes a Thrift object request, and returns Future Map of partition ids to sub-requests. If we don't need to fan-out, it should return one element: partition id to the original request. This PartialFunction can take multiple Thrift request types of one Thrift service (different method endpoints of one service).
- getLogicalPartitionId
Gets the logical partition identifiers from a host identifier, host identifiers are derived from ZkMetadata shardId. Indicates which logical partitions a physical host belongs to, multiple hosts can belong to the same partition, and one host can belong to multiple partitions, for example:
{ case a if Range(0, 10).contains(a) => Seq(0, 1) case b if Range(10, 20).contains(b) => Seq(1) case c if Range(20, 30).contains(c) => Seq(2) case _ => throw ... }
-
def
noResharding(getPartitionIdAndRequest: ToPartitionedMap): CustomPartitioningStrategy
Constructs a ClientCustomStrategy that does not reshard.
Constructs a ClientCustomStrategy that does not reshard.
This is appropriate for static partitioning backend topologies.
Java users should see ClientCustomStrategies$ for an easier to use API.
- getPartitionIdAndRequest
A PartialFunction implemented by client that provides the partitioning logic on a request. It takes a Thrift object request, and returns Future Map of partition ids to sub-requests. If we don't need to fan-out, it should return one element: partition id to the original request. This PartialFunction can take multiple Thrift request types of one Thrift service (different method endpoints of one service). In this context, the returned partition id is also the shard id. Each instance is its own partition.
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
resharding[A](getPartitionIdAndRequestFn: (A) ⇒ ToPartitionedMap, getLogicalPartitionIdFn: (A) ⇒ (Int) ⇒ Seq[Int], observable: Activity[A]): CustomPartitioningStrategy
Constructs a ClientCustomStrategy that reshards based on the user provided state.
Constructs a ClientCustomStrategy that reshards based on the user provided state.
This lets the client be aware of the backend dynamic resharding by providing the fully described state of resharding. The partitioning schema needs to be configured to react to each state, and it needs to be a pure function (see param below). When the state got successfully updated, the partitioning strategy will move to the new schema. See clusterResharding if only the backend cluster information needs to be observed in order to reshard.
Java users should see ClientCustomStrategies$ for an easier to use API.
- getPartitionIdAndRequestFn
A function that given the current state of
observable, returns a PartialFunction implemented by client that provides the partitioning logic on a request. It takes a Thrift object request, and returns Future Map of partition ids to sub-requests. If we don't need to fan-out, it should return one element: partition id to the original request. This PartialFunction can take multiple Thrift request types of one Thrift service (different method endpoints of one service). Note that this function must be pure (ie referentially transparent). It cannot change based on anything other than the state ofobservable, or else it will malfunction.- getLogicalPartitionIdFn
A function that given the current state
observable, returns a function that gets the logical partition identifiers from a host identifier, host identifiers are derived from ZkMetadata shardId. Indicates which logical partitions a physical host belongs to, multiple hosts can belong to the same partition, and one host can belong to multiple partitions, for example:{ case a if Range(0, 10).contains(a) => Seq(0, 1) case b if Range(10, 20).contains(b) => Seq(1) case c if Range(20, 30).contains(c) => Seq(2) case _ => throw ... }Note that this function must be pure (ie referentially transparent). It cannot change based on anything other than the state of
observable, or else it will malfunction.- observable
The state that is used for deciding how to reshard the cluster.
-
def
resharding[A](getPartitionIdAndRequestFn: (A) ⇒ ToPartitionedMap, observable: Activity[A]): CustomPartitioningStrategy
Constructs a ClientCustomStrategy that reshards based on the user provided state.
Constructs a ClientCustomStrategy that reshards based on the user provided state.
This lets the client be aware of the backend dynamic resharding by providing the fully described state of resharding. The partitioning schema needs to be configured to react to each state, and it needs to be a pure function (see param below). When the state got successfully updated, the partitioning strategy will move to the new schema. See clusterResharding if only the backend cluster information needs to be observed in order to reshard.
Java users should see ClientCustomStrategies$ for an easier to use API.
- getPartitionIdAndRequestFn
A function that given the current state of
observable, returns a PartialFunction implemented by client that provides the partitioning logic on a request. It takes a Thrift object request, and returns Future Map of partition ids to sub-requests. If we don't need to fan-out, it should return one element: partition id to the original request. This PartialFunction can take multiple Thrift request types of one Thrift service (different method endpoints of one service). Note that this function must be pure (ie referentially transparent). It cannot change based on anything other than the state ofobservable, or else it will malfunction.- observable
The state that is used for deciding how to reshard the cluster.
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()