Class SparkRunnerKryoRegistrator
- java.lang.Object
-
- org.apache.beam.runners.spark.coders.SparkRunnerKryoRegistrator
-
- All Implemented Interfaces:
org.apache.spark.serializer.KryoRegistrator
public class SparkRunnerKryoRegistrator extends java.lang.Object implements org.apache.spark.serializer.KryoRegistratorCustomKryoRegistrators for Beam's Spark runner needs and registering used class in spark translation for better serialization performance. This is not the default serialization mechanism.To use it you must enable the Kryo based serializer using
spark.serializerwith valueorg.apache.spark.serializer.KryoSerializerand register this class via Sparkspark.kryo.registratorconfiguration.
-
-
Constructor Summary
Constructors Constructor Description SparkRunnerKryoRegistrator()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description voidregisterClasses(com.esotericsoftware.kryo.Kryo kryo)
-