class LazySpillableColumnarBatchImpl extends LazySpillableColumnarBatch
Holds a columnar batch that is cached until it is marked that it can be spilled.
- Alphabetic
- By Inheritance
- LazySpillableColumnarBatchImpl
- LazySpillableColumnarBatch
- LazySpillable
- Retryable
- AutoCloseable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new LazySpillableColumnarBatchImpl(cb: ColumnarBatch, name: String)
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
allowSpilling(): Unit
Indicate that we are done using the data for now and it can be spilled.
Indicate that we are done using the data for now and it can be spilled.
This method should not have issues with being called multiple times without the data being accessed.
- Definition Classes
- LazySpillableColumnarBatchImpl → LazySpillable
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
checkpoint(): Unit
- Definition Classes
- LazySpillableColumnarBatchImpl → Retryable
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
close(): Unit
- Definition Classes
- LazySpillableColumnarBatchImpl → AutoCloseable
-
val
dataTypes: Array[DataType]
The data types of the underlying batches columns.
The data types of the underlying batches columns. Should not unspill the batch to get this info.
- Definition Classes
- LazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
val
deviceMemorySize: Long
The amount of device memory in bytes that the underlying batch uses.
The amount of device memory in bytes that the underlying batch uses. Should not unspill the batch to get this info.
- Definition Classes
- LazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
getBatch: ColumnarBatch
Get the batch that this wraps and unspill it if needed.
Get the batch that this wraps and unspill it if needed.
- Definition Classes
- LazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
val
numCols: Int
How many columns are in the underlying batch.
How many columns are in the underlying batch. Should not unspill the batch to get this info.
- Definition Classes
- LazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
val
numRows: Int
How many rows are in the underlying batch.
How many rows are in the underlying batch. Should not unspill the batch to get this into.
- Definition Classes
- LazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
def
releaseBatch(): ColumnarBatch
Release the underlying batch to the caller who is responsible for closing it.
Release the underlying batch to the caller who is responsible for closing it. The resulting batch will NOT be closed when this instance is closed.
- Definition Classes
- LazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
def
restore(): Unit
- Definition Classes
- LazySpillableColumnarBatchImpl → Retryable
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- LazySpillableColumnarBatchImpl → AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()