Class IcebergTaxiExamples
- java.lang.Object
-
- org.apache.beam.examples.cookbook.IcebergTaxiExamples
-
public class IcebergTaxiExamples extends java.lang.ObjectReads real-time NYC taxi ride information fromprojects/pubsub-public-data/topics/taxirides-realtimeand writes to Iceberg tables using Beam'sManagedIcebergIO sink.This is a streaming pipeline that writes records to Iceberg tables dynamically, depending on each record's passenger count. New tables are created as needed. We set a triggering frequency of 10s; at around this interval, the sink will accumulate records and write them to the appropriate table, creating a new snapshot each time.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static interfaceIcebergTaxiExamples.IcebergPipelineOptions
-
Constructor Summary
Constructors Constructor Description IcebergTaxiExamples()
-
Method Summary
All Methods Static Methods Concrete Methods Modifier and Type Method Description static voidmain(java.lang.String[] args)
-