Packages

package io

Package Members

  1. package orc

Type Members

  1. class DelegateSymlinkTextInputFormat extends SymlinkTextInputFormat

    Delegate for SymlinkTextInputFormat, created to address SPARK-40815.

    Delegate for SymlinkTextInputFormat, created to address SPARK-40815. Fixes an issue where SymlinkTextInputFormat returns empty splits which could result in the correctness issue when "spark.hadoopRDD.ignoreEmptySplits" is enabled.

    In this class, we update the split start and length to match the target file input thus fixing the issue.

Ungrouped