org.apache.hudi.internal.schema.io

Class FileBasedInternalSchemaStorageManager

java.lang.Object

org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager

public class FileBasedInternalSchemaStorageManager
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
static String	SCHEMA_NAME

Constructor Summary

Constructors

Constructor and Description
FileBasedInternalSchemaStorageManager(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path baseTablePath)
FileBasedInternalSchemaStorageManager(HoodieTableMetaClient metaClient)

Method Summary

Modifier and Type	Method and Description
void	cleanOldFiles(List<String> validateCommits)
String	getHistorySchemaStr() Get latest history schema string.
String	getHistorySchemaStrByGivenValidCommits(List<String> validCommits) Get latest history schema string.
Option<InternalSchema>	getSchemaByKey(String versionId) Get internalSchema by using given versionId
void	persistHistorySchemaStr(String instantTime, String historySchemaStr) Persist history schema str.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SCHEMA_NAME

public static final String SCHEMA_NAME

See Also:

Constant Field Values

Constructor Detail

FileBasedInternalSchemaStorageManager

public FileBasedInternalSchemaStorageManager(org.apache.hadoop.conf.Configuration conf,
                                             org.apache.hadoop.fs.Path baseTablePath)

FileBasedInternalSchemaStorageManager

public FileBasedInternalSchemaStorageManager(HoodieTableMetaClient metaClient)

Method Detail

persistHistorySchemaStr

public void persistHistorySchemaStr(String instantTime,
                                    String historySchemaStr)

Persist history schema str.

cleanOldFiles

public void cleanOldFiles(List<String> validateCommits)

getHistorySchemaStr

public String getHistorySchemaStr()

Get latest history schema string.

getHistorySchemaStrByGivenValidCommits

public String getHistorySchemaStrByGivenValidCommits(List<String> validCommits)

Get latest history schema string. Using give validCommits to validate all legal histroy Schema files, and return the latest one. If the passed valid commits is null or empty, valid instants will be fetched from the file-system and used.

getSchemaByKey

public Option<InternalSchema> getSchemaByKey(String versionId)

Get internalSchema by using given versionId

Parameters:

versionId - schema version_id need to search

Returns:

internalSchema