Packages

object PartitionDiscoveryUtils

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. PartitionDiscoveryUtils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  6. def columnAndValuesAtDepth(files: List[Path], depth: Int): Either[String, List[(String, String)]]

    Discovers the column name and value of a given path at a given depth.

    Discovers the column name and value of a given path at a given depth.

    returns

    a Left with an error message if something goes wrong during the value discovery. a Right with a list of column name and column value, this does not check that the layout is correct just that all the sub-folders have a compatible "name" (i.e. in the form of col=value)

  7. def discoverPartitions(fs: FileSystem)(basePath: Path): Either[String, List[PartitionColumnValues]]

    Discovers all the partitions columns and values of a given basePath

    Discovers all the partitions columns and values of a given basePath

    returns

    a Left with an error message if something goes wrong during the partition discovery. a Right with a list of PartitionColumnValues. The list is ordered from the closest to the basePath column to the farthest. PartitionColumnValues are sorted alphabetically.

  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. final def fileDepth(fs: FileSystem)(basePath: Path, currentPath: Path, currDepth: Int = 0): Int

    Calculates the depth of the currentPath relative ot basePath

    Calculates the depth of the currentPath relative ot basePath

    Annotations
    @tailrec()
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  12. def getColumnAndValue(p: Path): Either[String, (String, String)]

    Given a path returns column name and value of the leaf of that path, if any present enclosed in a Right.

    Given a path returns column name and value of the leaf of that path, if any present enclosed in a Right. If any error occurs, the returned value will be a Left enclosing an error description

  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. def listDirectories(fs: FileSystem)(path: Path): List[Path]

    Recursively lists all the subdirectories in the input directory *

  16. def listFiles(fs: FileSystem)(path: Path): List[Path]

    Recursively lists all the files in the input directory *

  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  20. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  21. def toString(): String
    Definition Classes
    AnyRef → Any
  22. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  24. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from AnyRef

Inherited from Any

Ungrouped