org.apache.hudi.keygen

Class TimestampBasedAvroKeyGenerator

java.lang.Object

org.apache.hudi.keygen.KeyGenerator

org.apache.hudi.keygen.BaseKeyGenerator

org.apache.hudi.keygen.SimpleAvroKeyGenerator

org.apache.hudi.keygen.TimestampBasedAvroKeyGenerator

All Implemented Interfaces:

Serializable, KeyGeneratorInterface

public class TimestampBasedAvroKeyGenerator
extends SimpleAvroKeyGenerator

Avro Key generator, that relies on timestamps for partitioning field. Still picks record key by name.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TimestampBasedAvroKeyGenerator.TimestampType

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	encodePartitionPath

Fields inherited from class org.apache.hudi.keygen.BaseKeyGenerator

consistentLogicalTimestampEnabled, hiveStylePartitioning, partitionPathFields, recordKeyFields

Fields inherited from class org.apache.hudi.keygen.KeyGenerator

config

Constructor Summary

Constructors

Constructor and Description
TimestampBasedAvroKeyGenerator(TypedProperties config)

Method Summary

Modifier and Type	Method and Description
Object	getDefaultPartitionVal() Set default value to partitionVal if the input value of partitionPathField is null.
String	getPartitionPath(org.apache.avro.generic.GenericRecord record)
String	getPartitionPath(Object partitionVal) Parse and fetch partition path based on data type.

Methods inherited from class org.apache.hudi.keygen.SimpleAvroKeyGenerator

getRecordKey

Methods inherited from class org.apache.hudi.keygen.BaseKeyGenerator

getKey, getPartitionPathFields, getRecordKeyFieldNames, isConsistentLogicalTimestampEnabled

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

encodePartitionPath

protected final boolean encodePartitionPath

Constructor Detail

TimestampBasedAvroKeyGenerator

public TimestampBasedAvroKeyGenerator(TypedProperties config)
                               throws IOException

Throws:

IOException

Method Detail

getPartitionPath

public String getPartitionPath(org.apache.avro.generic.GenericRecord record)

Overrides:

getPartitionPath in class SimpleAvroKeyGenerator

getDefaultPartitionVal

public Object getDefaultPartitionVal()

Set default value to partitionVal if the input value of partitionPathField is null.

getPartitionPath

public String getPartitionPath(Object partitionVal)

Parse and fetch partition path based on data type.

Parameters:

partitionVal - partition path object value fetched from record/row

Returns:

the parsed partition path based on data type