io.delta.kernel.internal.util

Class PartitionUtils

java.lang.Object

io.delta.kernel.internal.util.PartitionUtils

public class PartitionUtils
extends java.lang.Object

Method Summary

Modifier and Type	Method and Description
static StructType	physicalSchemaWithoutPartitionColumns(StructType logicalSchema, StructType physicalSchema, java.util.Set<java.lang.String> columnsToRemove) Utility method to remove the given columns (as columnsToRemove) from the given physicalSchema.
static ColumnarBatch	withPartitionColumns(ExpressionHandler expressionHandler, ColumnarBatch dataBatch, StructType dataBatchSchema, java.util.Map<java.lang.String,java.lang.String> partitionValues, StructType schemaWithPartitionCols)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

physicalSchemaWithoutPartitionColumns

public static StructType physicalSchemaWithoutPartitionColumns(StructType logicalSchema,
                                                               StructType physicalSchema,
                                                               java.util.Set<java.lang.String> columnsToRemove)

Utility method to remove the given columns (as columnsToRemove) from the given physicalSchema.

Parameters:

physicalSchema -

logicalSchema - To create a logical name to physical name map. Partition column names are in logical space and we need to identify the equivalent physical column name.

columnsToRemove -

Returns:

withPartitionColumns

public static ColumnarBatch withPartitionColumns(ExpressionHandler expressionHandler,
                                                 ColumnarBatch dataBatch,
                                                 StructType dataBatchSchema,
                                                 java.util.Map<java.lang.String,java.lang.String> partitionValues,
                                                 StructType schemaWithPartitionCols)