org.apache.hadoop.fs.aliyun.oss

Class AliyunOSSBlockOutputStream

java.lang.Object

java.io.OutputStream

org.apache.hadoop.fs.aliyun.oss.AliyunOSSBlockOutputStream

All Implemented Interfaces:

Closeable, Flushable, AutoCloseable

public class AliyunOSSBlockOutputStream
extends OutputStream

Asynchronous multi-part based uploading mechanism to support huge file which is larger than 5GB. Data will be buffered on local disk, then uploaded to OSS in close() method.

Constructor Summary

Constructors

Constructor and Description
AliyunOSSBlockOutputStream(org.apache.hadoop.conf.Configuration conf, AliyunOSSFileSystemStore store, String key, int blockSize, org.apache.hadoop.fs.aliyun.oss.OSSDataBlocks.BlockFactory blockFactory, BlockOutputStreamStatistics statistics, ExecutorService executorService)

Method Summary

Modifier and Type	Method and Description
void	close()
void	flush() The flush operation does not trigger an upload; that awaits the next block being full.
void	write(byte[] b, int off, int len)
void	write(int b)

Methods inherited from class java.io.OutputStream

write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AliyunOSSBlockOutputStream

public AliyunOSSBlockOutputStream(org.apache.hadoop.conf.Configuration conf,
                                  AliyunOSSFileSystemStore store,
                                  String key,
                                  int blockSize,
                                  org.apache.hadoop.fs.aliyun.oss.OSSDataBlocks.BlockFactory blockFactory,
                                  BlockOutputStreamStatistics statistics,
                                  ExecutorService executorService)
                           throws IOException

Throws:

IOException

Method Detail

flush

public void flush()
           throws IOException

The flush operation does not trigger an upload; that awaits the next block being full. What it does do is call flush() on the current block, leaving it to choose how to react.

Specified by:

flush in interface Flushable

Overrides:

flush in class OutputStream

Throws:

IOException - Any IO problem.

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class OutputStream

Throws:

IOException

write

public void write(int b)
           throws IOException

Specified by:

write in class OutputStream

Throws:

IOException

write

public void write(byte[] b,
                  int off,
                  int len)
           throws IOException

Overrides:

write in class OutputStream

Throws:

IOException