public class TableBatchWriteSessionImpl extends TableBatchWriteSessionBase
Session.Provider| Constructor and Description |
|---|
TableBatchWriteSessionImpl(TableIdentifier identifier,
PartitionSpec partitionSpec,
boolean overwrite,
DynamicPartitionOptions dynamicPartitionOptions,
ArrowOptions arrowOptions,
TableWriteCapabilities capabilities,
EnvironmentSettings settings,
long maxFieldSize) |
TableBatchWriteSessionImpl(TableIdentifier identifier,
String sessionId,
EnvironmentSettings settings) |
| Modifier and Type | Method and Description |
|---|---|
void |
cleanup()
Clean up this writing job because some data writers are failed and keep failing when retry,
|
void |
commit(WriterCommitMessage[] messages)
Commits this writing job with a list of commit messages.
|
BatchWriter<org.apache.arrow.vector.VectorSchemaRoot> |
createArrowWriter(long blockNumber,
WriterAttemptId attemptId,
WriterOptions options)
Returns a arrow data writer to do the actual writing work.
|
boolean |
supportsDataFormat(DataFormat dataFormat)
Returns whether the data format is supported by this table write session.
|
getId, getStatus, getTableIdentifier, maxBlockNumber, requiredDistribution, requiredOrdering, requiredSchemaequals, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitcreateRecordWriter, getTypedescriptionpublic TableBatchWriteSessionImpl(TableIdentifier identifier, PartitionSpec partitionSpec, boolean overwrite, DynamicPartitionOptions dynamicPartitionOptions, ArrowOptions arrowOptions, TableWriteCapabilities capabilities, EnvironmentSettings settings, long maxFieldSize) throws IOException
IOExceptionpublic TableBatchWriteSessionImpl(TableIdentifier identifier, String sessionId, EnvironmentSettings settings) throws IOException
IOExceptionpublic BatchWriter<org.apache.arrow.vector.VectorSchemaRoot> createArrowWriter(long blockNumber, WriterAttemptId attemptId, WriterOptions options) throws IOException
TableBatchWriteSessionIOExceptionpublic boolean supportsDataFormat(DataFormat dataFormat)
TableWriteSessionpublic void commit(WriterCommitMessage[] messages) throws IOException
TableBatchWriteSessionBatchWriter.commit().
TODO: commit with settingsIOExceptionpublic void cleanup()
TableBatchWriteSessionCopyright © 2024 Alibaba Cloud Computing. All rights reserved.