org.apache.spark.groupon.metrics
Spark Streaming application to benchmark performance, mainly on the driver.
Spark Streaming application to benchmark performance, mainly on the driver. Run with something like this: $SPARK_HOME/bin/spark-submit --class org.apache.spark.groupon.metrics.example.MetricsBenchmarkApp --master yarn-cluster --queue public --conf spark.dynamicAllocation.enabled=false --conf spark.streaming.ui.retainedBatches=120 --conf spark.locality.wait=0s --files log4j.properties --num-executors 6 --executor-cores 1 metrics.jar 2400 12500 4
Spark's SparkPi example instrumented with metrics
Spark Streaming application to benchmark performance, mainly on the driver. Run with something like this: $SPARK_HOME/bin/spark-submit --class org.apache.spark.groupon.metrics.example.MetricsBenchmarkApp --master yarn-cluster --queue public --conf spark.dynamicAllocation.enabled=false --conf spark.streaming.ui.retainedBatches=120 --conf spark.locality.wait=0s --files log4j.properties --num-executors 6 --executor-cores 1 metrics.jar 2400 12500 4