org.apache.hudi.common.fs

Interface ConsistencyGuard

public interface ConsistencyGuard

Ensures file create/delete operation is visible.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	ConsistencyGuard.FileVisibility File Visibility.

Method Summary

Modifier and Type	Method and Description
default void	waitTill(String dirPath, List<String> files, ConsistencyGuard.FileVisibility targetVisibility) Wait Till target visibility is reached.
void	waitTillAllFilesAppear(String dirPath, List<String> files) Wait till all passed files belonging to a directory shows up in the listing.
void	waitTillAllFilesDisappear(String dirPath, List<String> files) Wait till all passed files belonging to a directory disappears from listing.
void	waitTillFileAppears(StoragePath filePath) Wait for file to be listable based on configurable timeout.
void	waitTillFileDisappears(StoragePath filePath) Wait for file to be listable based on configurable timeout.

Method Detail

waitTillFileAppears

void waitTillFileAppears(StoragePath filePath)
                  throws IOException,
                         TimeoutException

Wait for file to be listable based on configurable timeout.

Parameters:

filePath -

Throws:

IOException - when having trouble listing the path

TimeoutException - when retries exhausted

waitTillFileDisappears

void waitTillFileDisappears(StoragePath filePath)
                     throws IOException,
                            TimeoutException

Wait for file to be listable based on configurable timeout.

Parameters:

filePath -

Throws:

IOException - when having trouble listing the path

TimeoutException - when retries exhausted

waitTillAllFilesAppear

void waitTillAllFilesAppear(String dirPath,
                            List<String> files)
                     throws IOException,
                            TimeoutException

Wait till all passed files belonging to a directory shows up in the listing.

Throws:

IOException

TimeoutException

waitTillAllFilesDisappear

void waitTillAllFilesDisappear(String dirPath,
                               List<String> files)
                        throws IOException,
                               TimeoutException

Wait till all passed files belonging to a directory disappears from listing.

Throws:

IOException

TimeoutException

waitTill

default void waitTill(String dirPath,
                      List<String> files,
                      ConsistencyGuard.FileVisibility targetVisibility)
               throws IOException,
                      TimeoutException

Wait Till target visibility is reached.

Parameters:

dirPath - Directory Path

files - Files

targetVisibility - Target Visibility

Throws:

IOException

TimeoutException