org.apache.gobblin.util

Class RecordCountProvider

java.lang.Object

org.apache.gobblin.util.RecordCountProvider

public abstract class RecordCountProvider
extends Object

A class for obtaining record counts from data.

Constructor Summary

Constructors

Constructor and Description
RecordCountProvider()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.fs.Path	convertPath(org.apache.hadoop.fs.Path path, String extension, RecordCountProvider src) Convert a Path from another RecordCountProvider so that it can be used in getRecordCount(Path) of this RecordCountProvider.
protected org.apache.commons.lang3.NotImplementedException	getNotImplementedException(RecordCountProvider src)
long	getRecordCount(Collection<org.apache.hadoop.fs.Path> paths) Get record count for a list of paths.
abstract long	getRecordCount(org.apache.hadoop.fs.Path path) Get record count from a given Path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RecordCountProvider

public RecordCountProvider()

Method Detail

getRecordCount

public abstract long getRecordCount(org.apache.hadoop.fs.Path path)

Get record count from a given Path.

convertPath

public org.apache.hadoop.fs.Path convertPath(org.apache.hadoop.fs.Path path,
                                             String extension,
                                             RecordCountProvider src)

Convert a Path from another RecordCountProvider so that it can be used in getRecordCount(Path) of this RecordCountProvider.

getNotImplementedException

protected org.apache.commons.lang3.NotImplementedException getNotImplementedException(RecordCountProvider src)

getRecordCount

public long getRecordCount(Collection<org.apache.hadoop.fs.Path> paths)

Get record count for a list of paths.