Package org.apache.pinot.segment.local.recordtransformer

Class CompositeTransformer

java.lang.Object

org.apache.pinot.segment.local.recordtransformer.CompositeTransformer

All Implemented Interfaces:

Serializable, RecordTransformer

public class CompositeTransformer
extends Object
implements RecordTransformer

The CompositeTransformer class performs multiple transforms based on the inner RecordTransformers.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor	Description
CompositeTransformer(List<RecordTransformer> transformers)

Method Summary

Modifier and Type	Method	Description
static CompositeTransformer	getDefaultTransformer(TableConfig tableConfig, Schema schema)	Returns a record transformer that performs null value handling, time/expression/data-type transformation and record sanitization.
static CompositeTransformer	getPassThroughTransformer()	Returns a pass through record transformer that does not transform the record.
GenericRow	transform(GenericRow record)	Transforms a record based on some custom rules.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CompositeTransformer

public CompositeTransformer(List<RecordTransformer> transformers)

Method Detail

getDefaultTransformer

public static CompositeTransformer getDefaultTransformer(TableConfig tableConfig,
                                                         Schema schema)

Returns a record transformer that performs null value handling, time/expression/data-type transformation and record sanitization.

NOTE: DO NOT CHANGE THE ORDER OF THE RECORD TRANSFORMERS

• ExpressionTransformer before everyone else, so that we get the real columns for other transformers to work on
• FilterTransformer after ExpressionTransformer, so that we have source as well as destination columns
• DataTypeTransformer after FilterTransformer to convert values to comply with the schema
• NullValueTransformer after DataTypeTransformer because empty Collection/Map/Object[] will be replaced with null in DataTypeTransformer
• SanitizationTransformer after NullValueTransformer so that before sanitation, all values are non-null and follow the data types defined in the schema

getPassThroughTransformer

public static CompositeTransformer getPassThroughTransformer()

Returns a pass through record transformer that does not transform the record.

transform

@Nullable
public GenericRow transform(GenericRow record)

Description copied from interface: RecordTransformer

Transforms a record based on some custom rules.

Specified by:

transform in interface RecordTransformer

Parameters:

record - Record to transform

Returns:

Transformed record, or null if the record does not follow certain rules.