org.apache.iceberg.spark.source

Class SerializableTableWithSize

java.lang.Object

org.apache.iceberg.SerializableTable

org.apache.iceberg.spark.source.SerializableTableWithSize

All Implemented Interfaces:

java.io.Serializable, org.apache.iceberg.Table, org.apache.spark.util.KnownSizeEstimation

public class SerializableTableWithSize
extends org.apache.iceberg.SerializableTable
implements org.apache.spark.util.KnownSizeEstimation

This class provides a serializable table with a known size estimate. Spark calls its SizeEstimator class when broadcasting variables and this can be an expensive operation, so providing a known size estimate allows that operation to be skipped.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SerializableTableWithSize.SerializableMetadataTableWithSize

Nested classes/interfaces inherited from class org.apache.iceberg.SerializableTable

org.apache.iceberg.SerializableTable.SerializableMetadataTable

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	SerializableTableWithSize(org.apache.iceberg.Table table)

Method Summary

Modifier and Type	Method and Description
static org.apache.iceberg.Table	copyOf(org.apache.iceberg.Table table)
long	estimatedSize()

Methods inherited from class org.apache.iceberg.SerializableTable

currentSnapshot, encryption, expireSnapshots, history, io, location, locationProvider, manageSnapshots, name, newAppend, newBatchScan, newDelete, newOverwrite, newReplacePartitions, newRewrite, newRowDelta, newScan, newTable, newTransaction, properties, refresh, refs, replaceSortOrder, rewriteManifests, schema, schemas, snapshot, snapshots, sortOrder, sortOrders, spec, specs, statisticsFiles, updateLocation, updateProperties, updateSchema, updateSpec, updateStatistics

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.Table

newFastAppend, newIncrementalAppendScan, newIncrementalChangelogScan, snapshot

Constructor Detail

SerializableTableWithSize

protected SerializableTableWithSize(org.apache.iceberg.Table table)

Method Detail

estimatedSize

public long estimatedSize()

Specified by:

estimatedSize in interface org.apache.spark.util.KnownSizeEstimation

copyOf

public static org.apache.iceberg.Table copyOf(org.apache.iceberg.Table table)