Class SparkRunnerKryoRegistrator

  • All Implemented Interfaces:
    org.apache.spark.serializer.KryoRegistrator

    public class SparkRunnerKryoRegistrator
    extends java.lang.Object
    implements org.apache.spark.serializer.KryoRegistrator
    Custom KryoRegistrators for Beam's Spark runner needs and registering used class in spark translation for better serialization performance. This is not the default serialization mechanism.

    To use it you must enable the Kryo based serializer using spark.serializer with value org.apache.spark.serializer.KryoSerializer and register this class via Spark spark.kryo.registrator configuration.

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void registerClasses​(com.esotericsoftware.kryo.Kryo kryo)  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • SparkRunnerKryoRegistrator

        public SparkRunnerKryoRegistrator()
    • Method Detail

      • registerClasses

        public void registerClasses​(com.esotericsoftware.kryo.Kryo kryo)
        Specified by:
        registerClasses in interface org.apache.spark.serializer.KryoRegistrator