org.apache.hudi.client.utils

Class DeletePartitionUtils

java.lang.Object

org.apache.hudi.client.utils.DeletePartitionUtils

public class DeletePartitionUtils
extends Object

A utility class for helper functions when performing a delete partition operation.

Constructor Summary

Constructors

Constructor and Description
DeletePartitionUtils()

Method Summary

Modifier and Type	Method and Description
static void	checkForPendingTableServiceActions(HoodieTable table, List<String> partitionsToDrop) Check if there are any pending table service actions (requested + inflight) on a table affecting the partitions to be dropped.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DeletePartitionUtils

public DeletePartitionUtils()

Method Detail

checkForPendingTableServiceActions

public static void checkForPendingTableServiceActions(HoodieTable table,
                                                      List<String> partitionsToDrop)

Check if there are any pending table service actions (requested + inflight) on a table affecting the partitions to be dropped.

This check is to prevent a drop-partition from proceeding should a partition have a table service action in the pending stage. If this is allowed to happen, the filegroup that is an input for a table service action, might also be a candidate for being replaced. As such, when the table service action and drop-partition commits are committed, there will be two commits replacing a single filegroup.

For example, a timeline might have an execution order as such: 000.replacecommit.requested (clustering filegroup_1 + filegroup_2 -> filegroup_3) 001.replacecommit.requested, 001.replacecommit.inflight, 0001.replacecommit (drop_partition to replace filegroup_1) 000.replacecommit.inflight (clustering is executed now) 000.replacecommit (clustering completed) For an execution order as shown above, 000.replacecommit and 001.replacecommit will both flag filegroup_1 to be replaced. This will cause downstream duplicate key errors when a map is being constructed.

Parameters:

table - Table to perform validation on

partitionsToDrop - List of partitions to drop