| ComplexTypeTransformer |
A transformer to handle the complex types such as Map and Collection, with flattening and unnesting.
|
| CompositeTransformer |
The CompositeTransformer class performs multiple transforms based on the inner RecordTransformers. |
| DataTypeTransformer |
The DataTypeTransformer class will convert the values to follow the data types in FieldSpec. |
| ExpressionTransformer |
The ExpressionTransformer class will evaluate the function expressions.
|
| FilterTransformer |
Based on filter config, decide whether to skip or allow this record.
|
| NullValueTransformer |
|
| SanitizationTransformer |
The SanitizationTransformer class will sanitize the values to follow certain rules including:
No null characters in string values
String values are within the length limit
TODO: add length limit to BYTES values if necessary
|
| SchemaConformingTransformer |
This transformer transforms records with varying keys such that they can be stored in a table with a fixed schema.
|
| SpecialValueTransformer |
The SpecialValueTransformer class will transform special values according to the following rules:
Negative zero (-0.0) should be converted to 0.0
NaN should be converted to default null
|
| TimeValidationTransformer |
The TimeValidationTransformer class will validate the time column value.
|