class JoinGathererImpl extends JoinGatherer
JoinGatherer for a single map/table
- Alphabetic
- By Inheritance
- JoinGathererImpl
- JoinGatherer
- LazySpillable
- Retryable
- AutoCloseable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new JoinGathererImpl(gatherMap: LazySpillableGatherMap, data: LazySpillableColumnarBatch, boundsCheckPolicy: OutOfBoundsPolicy)
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
allowSpilling(): Unit
Indicate that we are done using the data for now and it can be spilled.
Indicate that we are done using the data for now and it can be spilled.
This method should not have issues with being called multiple times without the data being accessed.
- Definition Classes
- JoinGathererImpl → LazySpillable
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
checkpoint(): Unit
- Definition Classes
- JoinGathererImpl → Retryable
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
close(): Unit
- Definition Classes
- JoinGathererImpl → AutoCloseable
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
gatherNext(n: Int): ColumnarBatch
Gather the next n rows from the join gather maps.
Gather the next n rows from the join gather maps.
- n
how many rows to gather
- returns
the gathered data as a ColumnarBatch
- Definition Classes
- JoinGathererImpl → JoinGatherer
-
def
gatherRowEstimate(targetSize: Long): Int
Do a complete/expensive job to get the number of rows that can be gathered to get close to the targetSize for the final output.
Do a complete/expensive job to get the number of rows that can be gathered to get close to the targetSize for the final output.
- targetSize
The target size in bytes for the final output batch.
- Definition Classes
- JoinGatherer
-
def
getBitSizeMap(n: Int): ColumnView
Get the bit count size map for the next n rows to be gathered.
Get the bit count size map for the next n rows to be gathered. It returns a column of INT64 values. One for each of the next n rows requested. This is a bit count to deal with validity bits, etc. This is an INT64 to allow a prefix sum (running total) to be done on it without overflowing so we can compute an accurate cuttoff point for a batch size limit.
- Definition Classes
- JoinGathererImpl → JoinGatherer
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
getFixedWidthBitSize: Option[Int]
If the data is all fixed width return the size of each row, otherwise return None.
If the data is all fixed width return the size of each row, otherwise return None.
- Definition Classes
- JoinGathererImpl → JoinGatherer
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
isDone: Boolean
Is all of the data gathered so far.
Is all of the data gathered so far.
- Definition Classes
- JoinGathererImpl → JoinGatherer
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
numRowsLeft: Long
Number of rows left to gather
Number of rows left to gather
- Definition Classes
- JoinGathererImpl → JoinGatherer
-
def
realCheapPerRowSizeEstimate: Double
A really fast and dirty way to estimate the size of each row in the join output measured as in bytes.
A really fast and dirty way to estimate the size of each row in the join output measured as in bytes.
- Definition Classes
- JoinGathererImpl → JoinGatherer
-
def
restore(): Unit
- Definition Classes
- JoinGathererImpl → Retryable
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- JoinGathererImpl → AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()