org.apache.druid.data.input.impl.prefetch

Class FileFetcher<T>

java.lang.Object

org.apache.druid.data.input.impl.prefetch.Fetcher<T>

org.apache.druid.data.input.impl.prefetch.FileFetcher<T>

All Implemented Interfaces:

Iterator<org.apache.druid.data.input.impl.prefetch.OpenedObject<T>>

public class FileFetcher<T>
extends Fetcher<T>

A file fetcher used by PrefetchableTextFilesFirehoseFactory. See the javadoc of PrefetchableTextFilesFirehoseFactory for more details.

Method Summary

Modifier and Type	Method and Description
protected long	download(T object, File outFile) Downloads an object.
protected org.apache.druid.data.input.impl.prefetch.OpenedObject<T>	generateOpenObject(T object) Generates an instance of OpenedObject for which the underlying stream may be re-opened and retried based on the exception and retry condition.
int	getMaxFetchRetry()

Methods inherited from class org.apache.druid.data.input.impl.prefetch.Fetcher

hasNext, next

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining, remove

Method Detail

getMaxFetchRetry

public int getMaxFetchRetry()

download

protected long download(T object,
                        File outFile)
                 throws IOException

Downloads an object. It retries downloading maxFetchRetry times and throws an exception.

Specified by:

download in class Fetcher<T>

Parameters:

object - an object to be downloaded

outFile - a file which the object data is stored

Returns:

number of downloaded bytes

Throws:

IOException

generateOpenObject

protected org.apache.druid.data.input.impl.prefetch.OpenedObject<T> generateOpenObject(T object)
                                                                                throws IOException

Generates an instance of OpenedObject for which the underlying stream may be re-opened and retried based on the exception and retry condition.

Specified by:

generateOpenObject in class Fetcher<T>

Throws:

IOException