com.aliyun.odps.table.write.impl.batch

Class TableBatchWriteSessionImpl

java.lang.Object

com.aliyun.odps.table.write.impl.batch.TableBatchWriteSessionBase

com.aliyun.odps.table.write.impl.batch.TableBatchWriteSessionImpl

All Implemented Interfaces:

Session, TableBatchWriteSession, TableWriteSession, Serializable

public class TableBatchWriteSessionImpl
extends TableBatchWriteSessionBase

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface com.aliyun.odps.table.Session

Session.Provider

Constructor Summary

Constructors

Constructor and Description
TableBatchWriteSessionImpl(TableIdentifier identifier, PartitionSpec partitionSpec, boolean overwrite, DynamicPartitionOptions dynamicPartitionOptions, ArrowOptions arrowOptions, TableWriteCapabilities capabilities, EnvironmentSettings settings, long maxFieldSize)
TableBatchWriteSessionImpl(TableIdentifier identifier, String sessionId, EnvironmentSettings settings)

Method Summary

Modifier and Type	Method and Description
void	cleanup() Clean up this writing job because some data writers are failed and keep failing when retry,
void	commit(WriterCommitMessage[] messages) Commits this writing job with a list of commit messages.
BatchWriter<org.apache.arrow.vector.VectorSchemaRoot>	createArrowWriter(long blockNumber, WriterAttemptId attemptId, WriterOptions options) Returns a arrow data writer to do the actual writing work.
boolean	supportsDataFormat(DataFormat dataFormat) Returns whether the data format is supported by this table write session.

Methods inherited from class com.aliyun.odps.table.write.impl.batch.TableBatchWriteSessionBase

getId, getStatus, getTableIdentifier, maxBlockNumber, requiredDistribution, requiredOrdering, requiredSchema

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.aliyun.odps.table.write.TableBatchWriteSession

createRecordWriter, getType

Methods inherited from interface com.aliyun.odps.table.Session

description

Constructor Detail

TableBatchWriteSessionImpl

public TableBatchWriteSessionImpl(TableIdentifier identifier,
                                  PartitionSpec partitionSpec,
                                  boolean overwrite,
                                  DynamicPartitionOptions dynamicPartitionOptions,
                                  ArrowOptions arrowOptions,
                                  TableWriteCapabilities capabilities,
                                  EnvironmentSettings settings,
                                  long maxFieldSize)
                           throws IOException

Throws:

IOException

TableBatchWriteSessionImpl

public TableBatchWriteSessionImpl(TableIdentifier identifier,
                                  String sessionId,
                                  EnvironmentSettings settings)
                           throws IOException

Throws:

IOException

Method Detail

createArrowWriter

public BatchWriter<org.apache.arrow.vector.VectorSchemaRoot> createArrowWriter(long blockNumber,
                                                                               WriterAttemptId attemptId,
                                                                               WriterOptions options)
                                                                        throws IOException

Description copied from interface: TableBatchWriteSession

Returns a arrow data writer to do the actual writing work. Within the same table sink, no two writer will share the same writer id).

Throws:

IOException

supportsDataFormat

public boolean supportsDataFormat(DataFormat dataFormat)

Description copied from interface: TableWriteSession

Returns whether the data format is supported by this table write session.

commit

public void commit(WriterCommitMessage[] messages)
            throws IOException

Description copied from interface: TableBatchWriteSession

Commits this writing job with a list of commit messages. The commit messages are collected from successful data writers and are produced by BatchWriter.commit(). TODO: commit with settings

Throws:

IOException

cleanup

public void cleanup()

Description copied from interface: TableBatchWriteSession

Clean up this writing job because some data writers are failed and keep failing when retry,