Package

net.sansa_stack.rdf.spark

io

Permalink

package io

Wrap up implicit classes/methods to read/write RDF data from N-Triples or Turtle files into either DataFrame or RDD.

Linear Supertypes

AnyRef, Any

Ordering

Alphabetic
By Inheritance

Inherited

io
AnyRef
Any

Hide All
Show All

Visibility

Public
All

Type Members

class CustomErrorHandler extends ErrorHandler

A custom error handler that doesn't throw an exception on fatal parse errors.
A custom error handler that doesn't throw an exception on fatal parse errors. This allows for simply skipping those triples instead of aborting the whole parse process.
class JenaKryoRegistrator extends KryoRegistrator

Created by nilesh on 01/06/2016.
class ParquetTransformer extends AnyRef
implicit class RDFDataFrameReader extends Logging

Adds methods, rdf, ntriples and turtle, to DataFrameReader that allows to read N-Triples and Turtle files.
implicit class RDFDataFrameWriter[T] extends AnyRef

Adds methods, ntriples and turtle, to DataFrameWriter that allows to write N-Triples files.
implicit class RDFReader extends AnyRef

Adds methods, rdf(lang: Lang), ntriples, nquads, and turtle, to SparkSession that allows to read N-Triples, N-Quads and Turtle files.
implicit class RDFWriter[T] extends AnyRef

Adds methods, ntriples and turtle, to org.apache.spark.SparkContext that allows to write N-Triples and Turtle files.
class SQLSchema extends AnyRef

The SQL schema used for an RDF graph.

Value Members

object ErrorParseMode extends Enumeration
object NTripleReader

An N-Triples reader.
An N-Triples reader. One triple per line is assumed.
object ParquetTransformer

Takes an RDD[Triple] and serializes it as Parquet format to disk.
object RDFLang extends Enumeration
object SQLSchemaDefault extends SQLSchema
object SaveMode extends Enumeration

SaveMode is used to specify the expected behavior of saving an RDF dataset to a path.
object WarningParseMode extends Enumeration
package benchmark
package index
package nquads
package ntriples
package rdfxml
package stream
def toRow(nodes: Seq[Node]): Row

Converts a list Jena Node objects to a Spark SQL Row.
Converts a list Jena Node objects to a Spark SQL Row.
nodes
the nodes
returns
the row
def toRow(triple: Triple): Row

Converts a Jena Triple to a Spark SQL Row with three columns.
Converts a Jena Triple to a Spark SQL Row with three columns.
triple
the triple
returns
the row
package turtle

Inherited from AnyRef

Inherited from Any

Ungrouped