public abstract class SparkRuntime extends Object
| Modifier and Type | Class and Description |
|---|---|
static class |
SparkRuntime.CalciteFlatMapFunction<T,R>
Combines linq4j
Function
and Spark FlatMapFunction. |
| Modifier | Constructor and Description |
|---|---|
private |
SparkRuntime() |
| Modifier and Type | Method and Description |
|---|---|
static <T> Enumerable<T> |
asEnumerable(org.apache.spark.api.java.JavaRDD<T> rdd)
Converts an RDD into an enumerable.
|
static <T> org.apache.spark.api.java.JavaRDD<T> |
createRdd(org.apache.spark.api.java.JavaSparkContext sc,
Enumerable<T> enumerable)
Converts an enumerable into an RDD.
|
static <T> org.apache.spark.api.java.JavaRDD<T> |
createRdd(org.apache.spark.api.java.JavaSparkContext sc,
T[] ts)
Converts an array into an RDD.
|
static org.apache.spark.api.java.JavaSparkContext |
getSparkContext(DataContext root)
Returns the Spark context for the current execution.
|
public static <T> org.apache.spark.api.java.JavaRDD<T> createRdd(org.apache.spark.api.java.JavaSparkContext sc,
T[] ts)
public static <T> org.apache.spark.api.java.JavaRDD<T> createRdd(org.apache.spark.api.java.JavaSparkContext sc,
Enumerable<T> enumerable)
public static <T> Enumerable<T> asEnumerable(org.apache.spark.api.java.JavaRDD<T> rdd)
public static org.apache.spark.api.java.JavaSparkContext getSparkContext(DataContext root)
Currently a global variable; maybe later held within root.
Copyright © 2012–2017 The Apache Software Foundation. All rights reserved.