Type Members

1.  class Accumulators extends Serializable
2.  class ConfigSerDeser extends Serializable

   Class to make Hadoop configurations serializable; uses the Writeable operations to do this.

   Class to make Hadoop configurations serializable; uses the Writeable operations to do this. Note: this only serializes the explicitly set values, not any set in site/default or other XML resources.

3.  sealed trait CopyActionResult extends Serializable
4.  case class CopyDefinitionWithDependencies(source: SerializableFileStatus, destination: URI, dependentFolders: Seq[SingleCopyDefinition]) extends Product with Serializable

   Definition of a copy that includes any copying of parent folders this file/folder depends on

   Definition of a copy that includes any copying of parent folders this file/folder depends on

   source

   Source file/folder to copy

   destination

   Destination to copy to

   dependentFolders

   Any dependent folder copies this file/folder depends on

5.  case class CopyPartitioner(indexes: Array[(Int, Int)]) extends Partitioner with Product with Serializable

   Custom partitioner based on the indexes array containing (partitionid, number of batches within partition) Will handle missing partitions.

6.  trait CopyResult extends DistCPResult

   Result of the DistCP copy used for both logging to a logger and a file.

7.  sealed trait DeleteActionResult extends Serializable
8.  case class DeleteResult(path: URI, actionResult: DeleteActionResult) extends DistCPResult with Product with Serializable

   Result of the DistCP delete used for both logging to a logger and a file.

9.  case class DirectoryCopyResult(source: URI, destination: URI, copyAction: DirectoryCreateActionResult) extends CopyResult with Product with Serializable
10.  sealed trait DirectoryCreateActionResult extends CopyActionResult
11.  trait DistCPResult extends Serializable

    Result of the DistCP action (copy/delete) used for both logging to a logger and a file.

12.  class ExceptionCountAccumulator extends AccumulatorV2[String, Map[String, Long]]
13.  sealed trait FileCopyActionResult extends CopyActionResult
14.  case class FileCopyResult(source: URI, destination: URI, len: Long, copyAction: FileCopyActionResult) extends CopyResult with Product with Serializable
15.  class FileSystemObjectCacher extends AnyRef

    FileSystem caching class.

    FileSystem caching class. Aims to prevent many of the same FileSystem objects being created between copy and delete actions in the same partition.

16.  sealed trait FileType extends Serializable
17.  trait Logging extends AnyRef
18.  case class SerializableFileStatus(uri: URI, len: Long, fileType: FileType) extends Serializable with Product

    Case class to represent a simple status of a File.

    Case class to represent a simple status of a File. Exists because FileStatus is not serializable

19.  case class SingleCopyDefinition(source: SerializableFileStatus, destination: URI) extends Product with Serializable

    Definition of a single copy

    Definition of a single copy

    source

    Source file/folder to copy

    destination

    Destination to copy to