net.snowflake.ingest.streaming.internal

Class ArrowFlusher

java.lang.Object

net.snowflake.ingest.streaming.internal.ArrowFlusher

All Implemented Interfaces:

Flusher<org.apache.arrow.vector.VectorSchemaRoot>

public class ArrowFlusher
extends Object
implements Flusher<org.apache.arrow.vector.VectorSchemaRoot>

Converts ChannelData buffered in RowBuffer to the Arrow format for faster processing.

Nested Class Summary

Nested classes/interfaces inherited from interface net.snowflake.ingest.streaming.internal.Flusher

Flusher.SerializationResult

Constructor Summary

Constructors

Constructor and Description
ArrowFlusher()

Method Summary

Modifier and Type	Method and Description
Flusher.SerializationResult	serialize(List<net.snowflake.ingest.streaming.internal.ChannelData<org.apache.arrow.vector.VectorSchemaRoot>> channelsDataPerTable, ByteArrayOutputStream chunkData, String filePath) Serialize buffered rows into the underlying format.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ArrowFlusher

public ArrowFlusher()

Method Detail

serialize

public Flusher.SerializationResult serialize(List<net.snowflake.ingest.streaming.internal.ChannelData<org.apache.arrow.vector.VectorSchemaRoot>> channelsDataPerTable,
                                             ByteArrayOutputStream chunkData,
                                             String filePath)
                                      throws IOException

Description copied from interface: Flusher

Serialize buffered rows into the underlying format.

Specified by:

serialize in interface Flusher<org.apache.arrow.vector.VectorSchemaRoot>

Parameters:

channelsDataPerTable - buffered rows

chunkData - output

filePath - file path

Returns:

Flusher.SerializationResult

Throws:

IOException