org.apache.hadoop.fs.cosn

Class CosNOutputStream

java.lang.Object

java.io.OutputStream

org.apache.hadoop.fs.cosn.CosNOutputStream

All Implemented Interfaces:

Closeable, Flushable, AutoCloseable

public class CosNOutputStream
extends OutputStream

The output stream for the COS blob store. Implement streaming upload to COS based on the multipart upload function. ( the maximum size of each part is 5GB) Support up to 40TB single file by multipart upload (each part is 5GB). Improve the upload performance of writing large files by using byte buffers and a fixed thread pool.

Constructor Summary

Constructors

Constructor and Description
CosNOutputStream(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.cosn.NativeFileSystemStore store, String key, long blockSize, ExecutorService executorService)

Method Summary

Modifier and Type	Method and Description
void	close()
void	flush()
void	write(byte[] b)
void	write(byte[] b, int off, int len)
void	write(int b)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CosNOutputStream

public CosNOutputStream(org.apache.hadoop.conf.Configuration conf,
                        org.apache.hadoop.fs.cosn.NativeFileSystemStore store,
                        String key,
                        long blockSize,
                        ExecutorService executorService)
                 throws IOException

Throws:

IOException

Method Detail

flush

public void flush()
           throws IOException

Specified by:

flush in interface Flushable

Overrides:

flush in class OutputStream

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class OutputStream

Throws:

IOException

write

public void write(byte[] b,
                  int off,
                  int len)
           throws IOException

Overrides:

write in class OutputStream

Throws:

IOException

write

public void write(byte[] b)
           throws IOException

Overrides:

write in class OutputStream

Throws:

IOException

write

public void write(int b)
           throws IOException

Specified by:

write in class OutputStream

Throws:

IOException