public interface HadoopCompat
This interface is public, but should be considered unstable and likely to change in the future as new Hadoop versions are released, or as janusgraph-hadoop-core uses additional Hadoop features, or as bugs are discovered. It's possible to write and use a third-party implementation, but be prepared to update it when upgrading to a newer JanusGraph release.
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.conf.Configuration |
getContextConfiguration(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Get configuration from the supplied task attempt context and return it.
|
long |
getContextCounter(org.apache.hadoop.mapreduce.TaskInputOutputContext context,
String group,
String name)
Return the current value of counter designated by
counter on context. |
org.apache.hadoop.conf.Configuration |
getJobContextConfiguration(org.apache.hadoop.mapreduce.JobContext context)
Get configuration from the supplied job context and return it.
|
String |
getJobFailureString(org.apache.hadoop.mapreduce.Job j) |
String |
getMapredJarConfigKey() |
ScanMetrics |
getMetrics(org.apache.hadoop.mapreduce.Counters c) |
String |
getSpeculativeMapConfigKey()
Return the Hadoop configuration key which takes a boolean value and
controls whether Hadoop will attempt speculative execution of mappers.
|
String |
getSpeculativeReduceConfigKey()
Return the Hadoop configuration key which takes a boolean value and
controls whether Hadoop will attempt speculative execution of reducers.
|
void |
incrementContextCounter(org.apache.hadoop.mapreduce.TaskInputOutputContext context,
String group,
String name,
long increment)
Add
increment to the counter designated by counter on context. |
JobClasspathConfigurer |
newDistCacheConfigurer()
Construct a
JobClasspathConfigurer
that walks the classpath and adds all jars its finds to the Hadoop Jobs's
class paths via the Hadoop Distributed Cache. |
org.apache.hadoop.conf.Configuration |
newImmutableConfiguration(org.apache.hadoop.conf.Configuration base)
Construct a
Configuration instance which throws
UnsupportedOperationException on any attempt to modify its state,
but which forwards to its parameter all method calls that don't mutate state (i.e. |
JobClasspathConfigurer |
newMapredJarConfigurer(String mapReduceJarPath)
Construct a
JobClasspathConfigurer
that sets the MapReduce job jar config key to the supplied value. |
org.apache.hadoop.mapreduce.TaskAttemptContext |
newTask(org.apache.hadoop.conf.Configuration c,
org.apache.hadoop.mapreduce.TaskAttemptID t)
Instantiate a new TaskAttemptContext using the given attempt ID and configuration.
|
org.apache.hadoop.mapreduce.TaskAttemptContext newTask(org.apache.hadoop.conf.Configuration c,
org.apache.hadoop.mapreduce.TaskAttemptID t)
c - configurationt - task attempt IDString getSpeculativeMapConfigKey()
String getSpeculativeReduceConfigKey()
String getMapredJarConfigKey()
void incrementContextCounter(org.apache.hadoop.mapreduce.TaskInputOutputContext context,
String group,
String name,
long increment)
increment to the counter designated by counter on context.context - Hadoop task IO context containing counter stategroup - the Hadoop counter group (heading under which the counter is displayed)name - the Hadoop counter name (the identifier for this counter within the group)increment - amount to add to the counter's current valuelong getContextCounter(org.apache.hadoop.mapreduce.TaskInputOutputContext context,
String group,
String name)
counter on context.context - Hadoop task IO context containing counter stategroup - the Hadoop counter group (heading under which the counter is displayed)name - the Hadoop counter name (the identifier for this counter within the group)org.apache.hadoop.conf.Configuration getContextConfiguration(org.apache.hadoop.mapreduce.TaskAttemptContext context)
context - Hadoop task attempt contextcontextorg.apache.hadoop.conf.Configuration getJobContextConfiguration(org.apache.hadoop.mapreduce.JobContext context)
context - Hadoop job contextcontextJobClasspathConfigurer newMapredJarConfigurer(String mapReduceJarPath)
JobClasspathConfigurer
that sets the MapReduce job jar config key to the supplied value. The job jar
should contain Faunus's classes plus its entire dependency tree ("fat" jar).mapReduceJarPath - path to the map reduce job jarJobClasspathConfigurer newDistCacheConfigurer()
JobClasspathConfigurer
that walks the classpath and adds all jars its finds to the Hadoop Jobs's
class paths via the Hadoop Distributed Cache.org.apache.hadoop.conf.Configuration newImmutableConfiguration(org.apache.hadoop.conf.Configuration base)
Configuration instance which throws
UnsupportedOperationException on any attempt to modify its state,
but which forwards to its parameter all method calls that don't mutate state (i.e. reads).base - the configuration to encapsulate behind an immutable forwarder classbaseScanMetrics getMetrics(org.apache.hadoop.mapreduce.Counters c)
String getJobFailureString(org.apache.hadoop.mapreduce.Job j)
Copyright © 2012–2020. All rights reserved.