| Package | Description |
|---|---|
| org.apache.hadoop.tools | |
| org.apache.hadoop.tools.util |
| Modifier and Type | Method and Description |
|---|---|
protected DistCpOptions |
DistCpOptions.clone() |
static DistCpOptions |
OptionsParser.parse(String[] args)
The parse method parses the command-line options, and creates
a corresponding Options object.
|
| Modifier and Type | Method and Description |
|---|---|
void |
CopyListing.buildListing(org.apache.hadoop.fs.Path pathToListFile,
DistCpOptions options)
Build listing function creates the input listing that distcp uses to
perform the copy.
|
void |
SimpleCopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListingFile,
DistCpOptions options)
The interface to be implemented by sub-classes, to create the source/target file listing.
|
void |
GlobbedCopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListingFile,
DistCpOptions options)
Implementation of CopyListing::buildListing().
|
void |
FileBasedCopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListFile,
DistCpOptions options)
Implementation of CopyListing::buildListing().
|
protected abstract void |
CopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListFile,
DistCpOptions options)
The interface to be implemented by sub-classes, to create the source/target file listing.
|
void |
SimpleCopyListing.doBuildListing(org.apache.hadoop.io.SequenceFile.Writer fileListWriter,
DistCpOptions options)
Collect the list of
|
static CopyListing |
CopyListing.getCopyListing(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.security.Credentials credentials,
DistCpOptions options)
Public Factory method with which the appropriate CopyListing implementation may be retrieved.
|
protected boolean |
SimpleCopyListing.shouldCopy(org.apache.hadoop.fs.Path path,
DistCpOptions options)
Provide an option to skip copy of a path, Allows for exclusion
of files such as
FileOutputCommitter.SUCCEEDED_FILE_NAME |
protected void |
SimpleCopyListing.validatePaths(DistCpOptions options) |
protected void |
GlobbedCopyListing.validatePaths(DistCpOptions options)
Validate input and output paths
|
protected void |
FileBasedCopyListing.validatePaths(DistCpOptions options)
Validate input and output paths
|
protected abstract void |
CopyListing.validatePaths(DistCpOptions options)
Validate input and output paths
|
| Constructor and Description |
|---|
DistCp(org.apache.hadoop.conf.Configuration configuration,
DistCpOptions inputOptions)
Public Constructor.
|
DistCpOptions(DistCpOptions that)
Copy constructor.
|
| Modifier and Type | Method and Description |
|---|---|
static Class<? extends org.apache.hadoop.mapreduce.InputFormat> |
DistCpUtils.getStrategy(org.apache.hadoop.conf.Configuration conf,
DistCpOptions options)
Returns the class that implements a copy strategy.
|
Copyright © 2015 Apache Software Foundation. All Rights Reserved.