object SpillPriorities
Utility methods for managing spillable buffer priorities. The spill priority numerical space is divided into potentially overlapping ranges based on the type of buffer.
- Alphabetic
- By Inheritance
- SpillPriorities
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
val
ACTIVE_BATCHING_PRIORITY: Long
Priority for multiple buffers being buffered within a call to next.
-
val
ACTIVE_ON_DECK_PRIORITY: Long
Priority for buffers that are waiting for next to be called.
Priority for buffers that are waiting for next to be called. i.e. data held between calls to
hasNextandnextor between different calls tonext. -
val
HOST_MEMORY_BUFFER_SPILL_OFFSET: Long
Priority offset for host memory buffers for spilling.
-
val
INPUT_FROM_SHUFFLE_PRIORITY: Long
Priorities for buffers received from shuffle.
Priorities for buffers received from shuffle. Shuffle input buffers are about to be read by a task, so spill them if there's no other choice, but leave some space at the end of the priority range so there can be some things after it.
-
val
OUTPUT_FOR_SHUFFLE_INITIAL_PRIORITY: Long
Priorities for task output buffers intended for shuffle.
-
def
applyPriorityOffset(originalPriority: Long, offset: Long): Long
Calculate a new priority based on an offset, clamping it to avoid wraparound.
Calculate a new priority based on an offset, clamping it to avoid wraparound.
- originalPriority
the original priority
- offset
the desired offset
- returns
the resulting priority, with clamping if needed
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def getShuffleOutputBufferReadPriority: Long
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()