Class IcebergTaxiExamples


  • public class IcebergTaxiExamples
    extends java.lang.Object
    Reads real-time NYC taxi ride information from projects/pubsub-public-data/topics/taxirides-realtime and writes to Iceberg tables using Beam's Managed IcebergIO sink.

    This is a streaming pipeline that writes records to Iceberg tables dynamically, depending on each record's passenger count. New tables are created as needed. We set a triggering frequency of 10s; at around this interval, the sink will accumulate records and write them to the appropriate table, creating a new snapshot each time.

    • Method Summary

      All Methods Static Methods Concrete Methods 
      Modifier and Type Method Description
      static void main​(java.lang.String[] args)  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • IcebergTaxiExamples

        public IcebergTaxiExamples()
    • Method Detail

      • main

        public static void main​(java.lang.String[] args)