org.apache.hadoop.hive.ql.parse.repl.dump

Class ExportService

java.lang.Object

org.apache.hadoop.hive.ql.parse.repl.dump.ExportService

public class ExportService
extends Object

A service to dump/export table and partition in parallel manner using asynchronous threads

Constructor Summary

Constructors

Constructor and Description
ExportService(HiveConf hiveConf) Create and configure the ExportService.

Method Summary

Modifier and Type	Method and Description
boolean	await(long timeout, TimeUnit unit) Wait for termination of all submitted ExportJob to the ExportService.
long	getTotalTaskEverExecuted() Only for testing purpose.
boolean	isExportServiceRunning() Tells whether ExportService is started and configured.
void	submit(ExportJob job) Executes the submitted ExportJob
void	waitForTasksToFinishAndShutdown() Wait for all tasks submitted to ExecutorService threads to complete execution.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ExportService

public ExportService(HiveConf hiveConf)

Create and configure the ExportService. Create a fixed thread pool of size provided by config parameter REPL_TABLE_DUMP_PARALLELISM.

Parameters:

hiveConf -

Method Detail

isExportServiceRunning

public boolean isExportServiceRunning()

Tells whether ExportService is started and configured. If it is shutdown return false else return true

Returns:

false/true

submit

public void submit(ExportJob job)

Executes the submitted ExportJob

Parameters:

job -

await

public boolean await(long timeout,
                     TimeUnit unit)
              throws InterruptedException

Wait for termination of all submitted ExportJob to the ExportService.

Parameters:

timeout - indicates time to wait until all tasks complete execution

unit - time unit for wait timeout

Returns:

true if executor terminated and false if timeout elapsed

Throws:

InterruptedException

waitForTasksToFinishAndShutdown

public void waitForTasksToFinishAndShutdown()
                                     throws HiveException

Wait for all tasks submitted to ExecutorService threads to complete execution.

Throws:

HiveException

getTotalTaskEverExecuted

public long getTotalTaskEverExecuted()

Only for testing purpose. It returns how many number of tasks were executed in parallel manner at an instant by ExportService.

Returns:

Returns total number of executed tasks in parallel at an instant by ExportService.