org.apache.hudi.hadoop.fs

Class SizeAwareFSDataOutputStream

java.lang.Object

java.io.OutputStream

java.io.FilterOutputStream

java.io.DataOutputStream

org.apache.hadoop.fs.FSDataOutputStream

org.apache.hudi.hadoop.fs.SizeAwareFSDataOutputStream

All Implemented Interfaces:

Closeable, DataOutput, Flushable, AutoCloseable, org.apache.hadoop.fs.CanSetDropBehind, org.apache.hadoop.fs.StreamCapabilities, org.apache.hadoop.fs.Syncable

public class SizeAwareFSDataOutputStream
extends org.apache.hadoop.fs.FSDataOutputStream

Wrapper over FSDataOutputStream to keep track of the size of the written bytes. This gives a cheap way to check on the underlying file size.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.fs.StreamCapabilities

org.apache.hadoop.fs.StreamCapabilities.StreamCapability

Field Summary

Fields inherited from class java.io.DataOutputStream

written

Fields inherited from class java.io.FilterOutputStream

out

Fields inherited from interface org.apache.hadoop.fs.StreamCapabilities

DROPBEHIND, HFLUSH, HSYNC, PREADBYTEBUFFER, READAHEAD, READBYTEBUFFER, UNBUFFER

Constructor Summary

Constructors

Constructor and Description
SizeAwareFSDataOutputStream(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.FSDataOutputStream out, ConsistencyGuard consistencyGuard, Runnable closeCallback)

Method Summary

Modifier and Type	Method and Description
void	close()
long	getBytesWritten()
void	write(byte[] b)
void	write(byte[] b, int off, int len)

Methods inherited from class org.apache.hadoop.fs.FSDataOutputStream

getPos, getWrappedStream, hasCapability, hflush, hsync, setDropBehind, sync

Methods inherited from class java.io.DataOutputStream

flush, size, write, writeBoolean, writeByte, writeBytes, writeChar, writeChars, writeDouble, writeFloat, writeInt, writeLong, writeShort, writeUTF

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SizeAwareFSDataOutputStream

public SizeAwareFSDataOutputStream(org.apache.hadoop.fs.Path path,
                                   org.apache.hadoop.fs.FSDataOutputStream out,
                                   ConsistencyGuard consistencyGuard,
                                   Runnable closeCallback)
                            throws IOException

Throws:

IOException

Method Detail

write

public void write(byte[] b,
                  int off,
                  int len)
           throws IOException

Specified by:

write in interface DataOutput

Overrides:

write in class DataOutputStream

Throws:

IOException

write

public void write(byte[] b)
           throws IOException

Specified by:

write in interface DataOutput

Overrides:

write in class FilterOutputStream

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.hadoop.fs.FSDataOutputStream

Throws:

IOException

getBytesWritten

public long getBytesWritten()