ai.grakn.engine.loader

Class DistributedLoader

java.lang.Object

ai.grakn.engine.loader.Loader

ai.grakn.engine.loader.DistributedLoader

public class DistributedLoader
extends Loader

RESTLoader that distributes computation to multiple Grakn Engine instances

Field Summary

Fields inherited from class ai.grakn.engine.loader.Loader

batchSize, enqueuedJobs, errorJobs, finishedJobs, loadingJobs, queries, threadsNumber

Constructor Summary

Constructors

Constructor and Description
DistributedLoader(String graphName, Collection<String> hosts)

Method Summary

Modifier and Type	Method and Description
void	checkForStatusLoop() Loop checking the status of the hosts every 30 seconds.
void	resetAvailabilityMap()
void	resetJobsTerminated()
void	sendQueriesToLoader(Collection<InsertQuery> queries) Method to load data into the graph.
void	setPollingFrequency(long number) Amount of time to wait before checking number completed jobs with slaves
Loader	setThreadsNumber(int number) Set the number of thread that will execute insert transactions at a time
void	waitToFinish() Block the main thread until all of the transactions have finished loading

Methods inherited from class ai.grakn.engine.loader.Loader

add, flush, getBatchSize, handleError, printLoaderState, setBatchSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DistributedLoader

public DistributedLoader(String graphName,
                         Collection<String> hosts)

Method Detail

setThreadsNumber

public Loader setThreadsNumber(int number)

Description copied from class: Loader

Set the number of thread that will execute insert transactions at a time

Overrides:

setThreadsNumber in class Loader

resetAvailabilityMap

public void resetAvailabilityMap()

resetJobsTerminated

public void resetJobsTerminated()

setPollingFrequency

public void setPollingFrequency(long number)

Amount of time to wait before checking number completed jobs with slaves

waitToFinish

public void waitToFinish()

Block the main thread until all of the transactions have finished loading

Specified by:

waitToFinish in class Loader

sendQueriesToLoader

public void sendQueriesToLoader(Collection<InsertQuery> queries)

Description copied from class: Loader

Method to load data into the graph. Implementation depends on the type of the loader.

Specified by:

sendQueriesToLoader in class Loader

checkForStatusLoop

public void checkForStatusLoop()

Loop checking the status of the hosts every 30 seconds. This method updates the semaphore availability.