A B C D E F G H I J L M N O P Q R S T U V W

A

AbstractCmdRunner - Class in alluxio.master.job.tracker

The base class for all the distributed job runner classes.

AbstractCmdRunner(FileSystemContext, JobMaster) - Constructor for class alluxio.master.job.tracker.AbstractCmdRunner

AbstractVoidPlanDefinition<T extends JobConfig,P extends java.io.Serializable> - Class in alluxio.job.plan

An abstract job definition where the run task method does not return a value.

AbstractVoidPlanDefinition() - Constructor for class alluxio.job.plan.AbstractVoidPlanDefinition

addCmdRunAttempt(CmdRunAttempt) - Method in class alluxio.master.job.common.CmdInfo

Add the CmdRunAttempt.

afterConnect() - Method in class alluxio.master.file.FileSystemMasterClient

afterConnect() - Method in class alluxio.worker.job.RetryHandlingJobMasterClient

alluxio.job - package alluxio.job

alluxio.job.plan - package alluxio.job.plan

alluxio.job.plan.batch - package alluxio.job.plan.batch

alluxio.job.plan.load - package alluxio.job.plan.load

alluxio.job.plan.migrate - package alluxio.job.plan.migrate

alluxio.job.plan.persist - package alluxio.job.plan.persist

alluxio.job.plan.replicate - package alluxio.job.plan.replicate

alluxio.job.plan.stress - package alluxio.job.plan.stress

alluxio.job.plan.transform - package alluxio.job.plan.transform

alluxio.job.plan.transform.compact - package alluxio.job.plan.transform.compact

alluxio.job.plan.transform.format - package alluxio.job.plan.transform.format

alluxio.job.plan.transform.format.csv - package alluxio.job.plan.transform.format.csv

alluxio.job.plan.transform.format.orc - package alluxio.job.plan.transform.format.orc

alluxio.job.plan.transform.format.parquet - package alluxio.job.plan.transform.format.parquet

alluxio.job.plan.transform.format.tables - package alluxio.job.plan.transform.format.tables

alluxio.job.util - package alluxio.job.util

alluxio.job.workflow - package alluxio.job.workflow

alluxio.job.workflow.composite - package alluxio.job.workflow.composite

alluxio.master - package alluxio.master

alluxio.master.file - package alluxio.master.file

alluxio.master.job - package alluxio.master.job

alluxio.master.job.command - package alluxio.master.job.command

alluxio.master.job.common - package alluxio.master.job.common

alluxio.master.job.metrics - package alluxio.master.job.metrics

alluxio.master.job.plan - package alluxio.master.job.plan

alluxio.master.job.tracker - package alluxio.master.job.tracker

alluxio.master.job.workflow - package alluxio.master.job.workflow

alluxio.underfs - package alluxio.underfs

alluxio.web - package alluxio.web

alluxio.worker - package alluxio.worker

alluxio.worker.job - package alluxio.worker.job

alluxio.worker.job.command - package alluxio.worker.job.command

alluxio.worker.job.task - package alluxio.worker.job.task

ALLUXIO_JOB_MASTER_SERVLET_RESOURCE_KEY - Static variable in class alluxio.web.JobMasterWebServer

ALLUXIO_JOB_WORKER_SERVLET_RESOURCE_KEY - Static variable in class alluxio.web.JobWorkerWebServer

AlluxioJobMaster - Class in alluxio.master

Entry point for the Alluxio job master program.

AlluxioJobMasterProcess - Class in alluxio.master

This class is responsible for initializing the different masters that are configured to run.

AlluxioJobMasterRestServiceHandler - Class in alluxio.master

This class is a REST handler for requesting general job master information.

AlluxioJobMasterRestServiceHandler(ServletContext) - Constructor for class alluxio.master.AlluxioJobMasterRestServiceHandler

AlluxioJobWorker - Class in alluxio.worker

Entry point for the Alluxio worker.

AlluxioJobWorkerProcess - Class in alluxio.worker

This class is responsible for initializing the different workers that are configured to run.

AlluxioJobWorkerRestServiceHandler - Class in alluxio.worker

This class is a REST handler for requesting general job worker information.

AlluxioJobWorkerRestServiceHandler(ServletContext) - Constructor for class alluxio.worker.AlluxioJobWorkerRestServiceHandler

B

BatchedJobDefinition - Class in alluxio.job.plan.batch

A simple loading job that loads the blocks of a file in a distributed and round-robin fashion.

BatchedJobDefinition() - Constructor for class alluxio.job.plan.batch.BatchedJobDefinition

Constructs a new BatchedJobDefinition.

BatchedJobDefinition.BatchedJobTask - Class in alluxio.job.plan.batch

A task representing loading a block into the memory of a worker.

BatchedJobDefinition.JobDefinitionFactory - Class in alluxio.job.plan.batch

Factory class for get the specific job definition.

BatchedJobTask(JobConfig, Serializable) - Constructor for class alluxio.job.plan.batch.BatchedJobDefinition.BatchedJobTask

batchIncrementForCancelStatus(BatchedJobConfig) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment for Cancel status for batch job.

batchIncrementForCompleteStatusWithRetry(BatchedJobConfig, FileSystem, RetryPolicy) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment for batch config for complete status.

batchIncrementForFailStatus(BatchedJobConfig) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment for Fail status for batch job.

beforeExecute(Thread, Runnable) - Method in class alluxio.worker.job.task.PausableThreadPoolExecutor

buildConsistentField(SchemaBuilder.FieldAssembler<Schema>, FieldSchema) - Static method in class alluxio.job.plan.transform.format.SchemaConversionUtils

Builds the fields that are consistent with Schema.

buildWriteSchema(List<FieldSchema>) - Static method in class alluxio.job.plan.transform.format.SchemaConversionUtils

Builds write schema.

BytesCommitter - Class in alluxio.job.plan.transform.format.tables

Determines whether to commit a table file based on the size of the file in bytes.

BytesCommitter(long) - Constructor for class alluxio.job.plan.transform.format.tables.BytesCommitter

C

cancel(long) - Method in class alluxio.master.job.JobMaster

Cancels a job.

cancel(long) - Method in class alluxio.master.job.JobMasterClientRestServiceHandler

Cancels a job.

cancel(CancelPRequest, StreamObserver<CancelPResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

cancel() - Method in class alluxio.master.job.plan.PlanCoordinator

Cancels the current job.

cancel(long) - Method in class alluxio.master.job.workflow.WorkflowTracker

Cancels a job with a particular job id.

cancelTask(long, long) - Method in class alluxio.worker.job.task.TaskExecutorManager

Cancels the given task.

checkJobStatus() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Returns the status of the job.

checkUri(AlluxioURI) - Static method in class alluxio.job.plan.transform.format.ReadWriterUtils

Checks preconditions of uri.

cleanup(Collection<Long>) - Method in class alluxio.master.job.workflow.WorkflowTracker

Recursively cleanup the parent workflows given plans to be removed from the PlanTracker.

close() - Method in class alluxio.job.plan.transform.format.csv.CsvReader

close() - Method in class alluxio.job.plan.transform.format.csv.CsvWriter

close() - Method in class alluxio.job.plan.transform.format.orc.OrcReader

close() - Method in class alluxio.job.plan.transform.format.parquet.ParquetReader

close() - Method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

close() - Method in interface alluxio.job.plan.transform.format.TableReader

Closes the reader, which will close the underlying stream.

close() - Method in class alluxio.job.plan.transform.format.tables.TablesWriter

close() - Method in interface alluxio.job.plan.transform.format.TableWriter

Closes a writer, which means the table is complete now.

close() - Method in class alluxio.master.job.JobMasterAuditContext

close() - Method in class alluxio.worker.job.command.CommandHandlingExecutor

CmdInfo - Class in alluxio.master.job.common

A class representation for Command Information.

CmdInfo(long, OperationType, JobSource, long, List<String>) - Constructor for class alluxio.master.job.common.CmdInfo

Constructor for CmdInfo class.

CmdJobTracker - Class in alluxio.master.job.tracker

CmdJobTracker to schedule a Cmd job to run.

CmdJobTracker(FileSystemContext, JobMaster) - Constructor for class alluxio.master.job.tracker.CmdJobTracker

Create a new instance of CmdJobTracker.

CmdJobTracker(FileSystemContext, DistLoadCliRunner, MigrateCliRunner, PersistRunner) - Constructor for class alluxio.master.job.tracker.CmdJobTracker

Constructor with runner providers.

CmdRunAttempt - Class in alluxio.master.job.tracker

class for handling submission for a child job within a distributed command.

CmdRunAttempt(RetryPolicy, JobMaster) - Constructor for class alluxio.master.job.tracker.CmdRunAttempt

CommandHandlingExecutor - Class in alluxio.worker.job.command

Manages the communication with the master.

CommandHandlingExecutor(JobServerContext, TaskExecutorManager, JobMasterClient, WorkerNetAddress) - Constructor for class alluxio.worker.job.command.CommandHandlingExecutor

Creates a new instance of CommandHandlingExecutor.

CommandManager - Class in alluxio.master.job.command

A command manager that manages the commands to issue to the workers.

CommandManager() - Constructor for class alluxio.master.job.command.CommandManager

Constructs a new CommandManager.

Committer - Interface in alluxio.job.plan.transform.format.tables

Determines when to commit/complete a table file when writing a stream of rows to a group of table files.

compact(List<TableReader>, TableWriter) - Method in interface alluxio.job.plan.transform.compact.Compactor

Compacts a list of inputs to the output.

CompactDefinition - Class in alluxio.job.plan.transform

The job definition for compacting files representing a structured table under a directory.

CompactDefinition() - Constructor for class alluxio.job.plan.transform.CompactDefinition

Constructs a new CompactDefinition.

Compactor - Interface in alluxio.job.plan.transform.compact

Compacts a list of inputs to an output.

CompactTask - Class in alluxio.job.plan.transform

A task for a job worker to compact files into one file.

CompactTask(ArrayList<String>, String) - Constructor for class alluxio.job.plan.transform.CompactTask

CompositeExecution - Class in alluxio.job.workflow.composite

Job execution for CompositeConfig.

CompositeExecution(CompositeConfig) - Constructor for class alluxio.job.workflow.composite.CompositeExecution

Default constructor.

CompositeExecutionFactory - Class in alluxio.job.workflow.composite

The factory for generating CompositeExecution from CompositeConfig.

CompositeExecutionFactory() - Constructor for class alluxio.job.workflow.composite.CompositeExecutionFactory

connectUfs(UnderFileSystem) - Method in class alluxio.underfs.JobUfsManager

coordinators() - Method in class alluxio.master.job.plan.PlanTracker

A collection of all PlanCoordinator currently tracked by the job master.

create(String) - Static method in class alluxio.job.plan.batch.BatchedJobDefinition.JobDefinitionFactory

create(AlluxioURI, PartitionInfo) - Static method in class alluxio.job.plan.transform.format.csv.CsvReader

Creates a CSV reader.

create(AlluxioURI) - Static method in class alluxio.job.plan.transform.format.orc.OrcReader

create(AlluxioURI) - Static method in class alluxio.job.plan.transform.format.parquet.ParquetReader

Creates a parquet reader.

create(TableSchema, AlluxioURI) - Static method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

Creates a Parquet writer.

create(TableSchema, AlluxioURI, PartitionInfo) - Static method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

Creates a parquet writer based on the partitionInfo.

create(TableSchema, AlluxioURI, int, boolean) - Static method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

Creates a Parquet writer specifying a row group size and whether to have dictionary enabled.

create(TableSchema, AlluxioURI, int, boolean, String) - Static method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

Creates a Parquet writer specifying a row group size.

create(AlluxioURI, PartitionInfo) - Static method in interface alluxio.job.plan.transform.format.TableReader

create(TableSchema, Committer, AlluxioURI) - Static method in class alluxio.job.plan.transform.format.tables.TablesWriter

create(TableSchema, AlluxioURI) - Static method in interface alluxio.job.plan.transform.format.TableWriter

create(TableSchema, AlluxioURI, PartitionInfo) - Static method in interface alluxio.job.plan.transform.format.TableWriter

create(CompositeConfig) - Method in class alluxio.job.workflow.composite.CompositeExecutionFactory

create(T) - Method in interface alluxio.job.workflow.WorkflowExecutionFactory

Creates a new WorkflowExecution based on the workflow configuration.

create(CommandManager, JobServerContext, List<WorkerInfo>, Long, JobConfig, Consumer<PlanInfo>) - Static method in class alluxio.master.job.plan.PlanCoordinator

Creates a new instance of the PlanCoordinator.

create(JobMasterClientContext) - Static method in class alluxio.worker.job.JobMasterClient.Factory

Factory method for JobMasterClient.

create() - Static method in class alluxio.worker.JobWorkerProcess.Factory

createBaseRpcServer() - Method in class alluxio.master.AlluxioJobMasterProcess

createWebServer() - Method in class alluxio.master.AlluxioJobMasterProcess

CsvReader - Class in alluxio.job.plan.transform.format.csv

A reader for reading CsvRow.

CsvRow - Class in alluxio.job.plan.transform.format.csv

A row in a CSV table represented in Avro format.

CsvRow(CsvSchema, GenericData.Record) - Constructor for class alluxio.job.plan.transform.format.csv.CsvRow

CsvSchema - Class in alluxio.job.plan.transform.format.csv

CSV table schema in Avro format.

CsvSchema(ArrayList<FieldSchema>) - Constructor for class alluxio.job.plan.transform.format.csv.CsvSchema

CsvReader uses AvroCSVReader to read records from CSV.

CsvUtils - Class in alluxio.job.plan.transform.format.csv

Utilities for implementing csv reader and writer.

CsvWriter - Class in alluxio.job.plan.transform.format.csv

A writer for writing CsvRow.

CsvWriter() - Constructor for class alluxio.job.plan.transform.format.csv.CsvWriter

D

Decimal - Class in alluxio.job.plan.transform.format.csv

Logical decimal type in Parquet.

Decimal(String) - Constructor for class alluxio.job.plan.transform.format.csv.Decimal

DEFAULT_ACTIVE_JOBS - Static variable in class alluxio.master.job.tracker.AbstractCmdRunner

DEFAULT_FILE_COUNT - Static variable in class alluxio.master.job.tracker.AbstractCmdRunner

DELIMITER - Static variable in class alluxio.master.job.tracker.CmdJobTracker

DistLoadCliRunner - Class in alluxio.master.job.tracker

A config runner for a DistLoadCli job.

DistLoadCliRunner(FileSystemContext, JobMaster) - Constructor for class alluxio.master.job.tracker.DistLoadCliRunner

constructor.

DistributedCmdMetrics - Class in alluxio.master.job.metrics

DistributedCmdMetrics has definitions for distributed command metrics and help methods.

DistributedCmdMetrics() - Constructor for class alluxio.master.job.metrics.DistributedCmdMetrics

E

equals(Object) - Method in class alluxio.job.plan.migrate.MigrateCommand

equals(Object) - Method in class alluxio.job.plan.replicate.SetReplicaTask

equals(Object) - Method in class alluxio.job.plan.transform.CompactTask

equals(Object) - Method in class alluxio.job.plan.transform.format.csv.CsvRow

equals(Object) - Method in class alluxio.job.plan.transform.format.csv.CsvSchema

equals(Object) - Method in class alluxio.job.plan.transform.format.parquet.ParquetRow

equals(Object) - Method in class alluxio.job.plan.transform.format.parquet.ParquetSchema

equals(Object) - Method in class alluxio.master.job.plan.PlanCoordinator

executeTask(long, long, RunTaskCommand, RunTaskContext) - Method in class alluxio.worker.job.task.TaskExecutorManager

Executes the given task.

F

failed(int, long, long) - Method in class alluxio.master.job.JobMaster

failed() - Method in class alluxio.master.job.plan.PlanTracker

failTasksForWorker(long) - Method in class alluxio.master.job.plan.PlanCoordinator

Fails any incomplete tasks being run on the specified worker.

fileSystemGet(URI, Configuration) - Static method in class alluxio.job.plan.transform.format.JobPath

Calls FileSystem.get, created to make testing easier.

FileSystemMasterClient - Class in alluxio.master.file

A wrapper for the gRPC client to interact with the file system master, used by Alluxio job service.

FileSystemMasterClient(MasterClientContext) - Constructor for class alluxio.master.file.FileSystemMasterClient

Creates an instance of FileSystemMasterClient.

findAllFailedPaths() - Method in class alluxio.master.job.tracker.CmdJobTracker

findCmdIds(List<Status>) - Method in class alluxio.master.job.tracker.CmdJobTracker

findFailedPaths(long) - Method in class alluxio.master.job.tracker.CmdJobTracker

findJobs(String, List<Status>) - Method in class alluxio.master.job.plan.PlanTracker

findJobs(String, List<Status>) - Method in class alluxio.master.job.workflow.WorkflowTracker

G

get(long) - Method in class alluxio.underfs.JobUfsManager

GET_INFO - Static variable in class alluxio.master.AlluxioJobMasterRestServiceHandler

GET_INFO - Static variable in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

getAddress() - Method in class alluxio.worker.AlluxioJobWorkerProcess

getAddress() - Method in interface alluxio.worker.JobWorkerProcess

getAllFailedPaths() - Method in class alluxio.master.job.JobMaster

getAllInfo() - Method in class alluxio.master.job.workflow.WorkflowTracker

getAlluxioSchema() - Method in class alluxio.job.plan.transform.format.csv.CsvSchema

getAlluxioSchema() - Method in class alluxio.job.plan.transform.format.orc.OrcSchema

getAllWorkerHealth() - Method in class alluxio.master.job.JobMaster

getAllWorkerHealth(GetAllWorkerHealthPRequest, StreamObserver<GetAllWorkerHealthPResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

getAndClearTaskUpdates() - Method in class alluxio.worker.job.task.TaskExecutorManager

getBlockId() - Method in class alluxio.job.plan.load.LoadDefinition.LoadTask

getBytes() - Method in class alluxio.job.plan.transform.format.csv.CsvWriter

getBytes() - Method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

getBytes() - Method in class alluxio.job.plan.transform.format.tables.TablesWriter

getBytes() - Method in interface alluxio.job.plan.transform.format.TableWriter

Note that the bytes written should take compression and encoding into consideration.

getCmdRunAttempt() - Method in class alluxio.master.job.common.CmdInfo

Get CmdRunAttempt.

getCmdStatus(long) - Method in class alluxio.master.job.JobMaster

Get command status.

getCmdStatus(GetCmdStatusRequest, StreamObserver<GetCmdStatusResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

getCmdStatus(long) - Method in class alluxio.master.job.tracker.CmdJobTracker

Get status information for a CMD.

getCmdStatusBlock(long) - Method in class alluxio.master.job.tracker.CmdJobTracker

Get a cmdStatusBlock information.

getCmdStatusDetailed(long) - Method in class alluxio.master.job.JobMaster

getCmdStatusDetailed(GetCmdStatusDetailedRequest, StreamObserver<GetCmdStatusDetailedResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

getColumn(String) - Method in class alluxio.job.plan.transform.format.csv.CsvRow

getColumn(String) - Method in class alluxio.job.plan.transform.format.orc.OrcRow

getColumn(String) - Method in class alluxio.job.plan.transform.format.parquet.ParquetRow

getColumn(String) - Method in interface alluxio.job.plan.transform.format.TableRow

getCoordinator(long) - Method in class alluxio.master.job.plan.PlanTracker

Gets a PlanCoordinator associated with the given job Id.

getCpuLoadAverage() - Method in class alluxio.worker.job.command.JobWorkerHealthReporter.JobWorkerHealthReport

Returns the system load average of the worker.

getCreationTime() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Returns the job creation time.

getDependencies() - Method in class alluxio.worker.JobWorker

getDestination() - Method in class alluxio.job.plan.migrate.MigrateCommand

getErrorMessage() - Method in class alluxio.job.workflow.WorkflowExecution

getErrorType() - Method in class alluxio.job.workflow.WorkflowExecution

getExecution(WorkflowConfig) - Method in enum alluxio.job.workflow.WorkflowExecutionRegistry

Gets the WorkflowExecution from workflow config.

getFailedFiles() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Return a copy of failed paths.

getFailedPaths(long) - Method in class alluxio.master.job.JobMaster

getFileCount() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Get file count.

getFileInfo(long) - Method in class alluxio.master.file.FileSystemMasterClient

getFilePath() - Method in class alluxio.job.plan.load.LoadDefinition.LoadTask

getFilePath() - Method in class alluxio.master.job.common.CmdInfo

Get file path.

getFilePath() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Set file path.

getFileSize(String, FileSystem, RetryPolicy) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

get file size for a given filePath, return 0 if exceeding retries.

getFileSize() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Get file size.

getFileSystem() - Method in class alluxio.job.JobServerContext

getFileSystem(Configuration) - Method in class alluxio.job.plan.transform.format.JobPath

getFsContext() - Method in class alluxio.job.JobServerContext

getInfo(Boolean) - Method in class alluxio.master.AlluxioJobMasterRestServiceHandler

getInfo(Boolean) - Method in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

getInputs() - Method in class alluxio.job.plan.transform.CompactTask

getJobConfig() - Method in class alluxio.job.plan.batch.BatchedJobDefinition.BatchedJobTask

getJobConfig() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Get job config.

getJobConfigClass() - Method in class alluxio.job.plan.batch.BatchedJobDefinition

getJobConfigClass() - Method in class alluxio.job.plan.load.LoadDefinition

getJobConfigClass() - Method in class alluxio.job.plan.migrate.MigrateDefinition

getJobConfigClass() - Method in class alluxio.job.plan.NoopPlanDefinition

getJobConfigClass() - Method in class alluxio.job.plan.persist.PersistDefinition

getJobConfigClass() - Method in interface alluxio.job.plan.PlanDefinition

getJobConfigClass() - Method in class alluxio.job.plan.replicate.MoveDefinition

getJobConfigClass() - Method in class alluxio.job.plan.replicate.SetReplicaDefinition

getJobConfigClass() - Method in class alluxio.job.plan.stress.StressBenchDefinition

getJobConfigClass() - Method in class alluxio.job.plan.transform.CompactDefinition

getJobControlId() - Method in class alluxio.master.job.common.CmdInfo

Get job control Id.

getJobDefinition(T) - Method in enum alluxio.job.plan.PlanDefinitionRegistry

Gets the job definition from the job configuration.

getJobId() - Method in class alluxio.job.RunTaskContext

getJobId() - Method in class alluxio.job.SelectExecutorsContext

getJobId() - Method in class alluxio.master.job.plan.PlanCoordinator

getJobId() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Returns the job Id.

getJobMaster() - Method in class alluxio.master.AlluxioJobMasterProcess

getJobServiceSummary(GetJobServiceSummaryPRequest, StreamObserver<GetJobServiceSummaryPResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

getJobSource() - Method in class alluxio.master.job.common.CmdInfo

Get job source.

getJobStatus(GetJobStatusPRequest, StreamObserver<GetJobStatusPResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

getJobStatusDetailed(GetJobStatusDetailedPRequest, StreamObserver<GetJobStatusDetailedPResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

getJobSubmissionTime() - Method in class alluxio.master.job.common.CmdInfo

Get submission time.

getJobTaskArgs() - Method in class alluxio.job.plan.batch.BatchedJobDefinition.BatchedJobTask

getJobWorkerHealthReport() - Method in class alluxio.worker.job.command.JobWorkerHealthReporter

getLastComputed() - Method in class alluxio.worker.job.command.JobWorkerHealthReporter.JobWorkerHealthReport

Returns the worker health observed time.

getLastUpdated() - Method in class alluxio.job.workflow.WorkflowExecution

getLogicalProcessorCount() - Method in class alluxio.worker.job.command.JobWorkerHealthReporter.JobWorkerHealthReport

Returns the system logical processor count.

getMetadata() - Method in class alluxio.job.plan.transform.format.parquet.ParquetReader

getMode() - Method in class alluxio.job.plan.replicate.SetReplicaTask

getName() - Method in class alluxio.job.workflow.composite.CompositeExecution

getName() - Method in class alluxio.job.workflow.WorkflowExecution

getName() - Method in class alluxio.master.job.JobMaster

getName() - Method in class alluxio.worker.JobWorker

getNewJobId() - Method in class alluxio.master.job.JobMaster

getNumActiveTasks() - Method in class alluxio.worker.job.task.PausableThreadPoolExecutor

getNumActiveTasks() - Method in class alluxio.worker.job.task.TaskExecutorManager

getOperationType() - Method in class alluxio.master.job.common.CmdInfo

Get operation type.

getOutput() - Method in class alluxio.job.plan.transform.CompactTask

getPlanInfo() - Method in class alluxio.master.job.plan.PlanCoordinator

getPlanInfoWire(boolean) - Method in class alluxio.master.job.plan.PlanCoordinator

getPrecision() - Method in class alluxio.job.plan.transform.format.csv.Decimal

getPrecisionAndScale(String) - Static method in class alluxio.job.plan.transform.format.csv.Decimal

Returns the decimal's precision and scale from the type definition.

getReadSchema() - Method in class alluxio.job.plan.transform.format.csv.CsvSchema

getRecord() - Method in class alluxio.job.plan.transform.format.parquet.ParquetRow

getRemoteServiceType() - Method in class alluxio.master.file.FileSystemMasterClient

getRemoteServiceType() - Method in class alluxio.worker.job.RetryHandlingJobMasterClient

getRows() - Method in class alluxio.job.plan.transform.format.csv.CsvWriter

getRows() - Method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

getRows() - Method in class alluxio.job.plan.transform.format.tables.TablesWriter

getRows() - Method in interface alluxio.job.plan.transform.format.TableWriter

getRpcAddress() - Method in class alluxio.worker.AlluxioJobWorkerProcess

getRpcAddress() - Method in interface alluxio.worker.JobWorkerProcess

getScale() - Method in class alluxio.job.plan.transform.format.csv.Decimal

getSchema() - Method in class alluxio.job.plan.transform.format.csv.CsvReader

getSchema() - Method in class alluxio.job.plan.transform.format.orc.OrcReader

getSchema() - Method in class alluxio.job.plan.transform.format.parquet.ParquetReader

getSchema() - Method in class alluxio.job.plan.transform.format.parquet.ParquetSchema

getSchema() - Method in interface alluxio.job.plan.transform.format.TableReader

getServiceName() - Method in class alluxio.master.file.FileSystemMasterClient

getServiceName() - Method in class alluxio.master.job.JobMasterClientRestServiceHandler

getServiceName() - Method in class alluxio.worker.job.RetryHandlingJobMasterClient

getServices() - Method in class alluxio.master.job.JobMaster

getServices() - Method in class alluxio.worker.JobWorker

getServiceVersion() - Method in class alluxio.master.file.FileSystemMasterClient

getServiceVersion() - Method in class alluxio.master.job.JobMasterClientRestServiceHandler

getServiceVersion() - Method in class alluxio.worker.job.RetryHandlingJobMasterClient

getSource() - Method in class alluxio.job.plan.migrate.MigrateCommand

getStartTimeMs() - Method in class alluxio.worker.AlluxioJobWorkerProcess

getStartTimeMs() - Method in interface alluxio.worker.JobWorkerProcess

getStatus() - Method in class alluxio.job.workflow.WorkflowExecution

getStatus(long) - Method in class alluxio.master.job.JobMaster

Gets information of the given job id (verbose = True).

getStatus(long, boolean) - Method in class alluxio.master.job.JobMaster

Gets information of the given job id.

getStatus(long) - Method in class alluxio.master.job.JobMasterClientRestServiceHandler

Gets the job status.

getStatus(long, boolean) - Method in class alluxio.master.job.workflow.WorkflowTracker

Gets information of the given job id.

getSummary() - Method in class alluxio.master.job.JobMaster

Gets summary of the job service.

getTaskExecutorPoolSize() - Method in class alluxio.worker.job.task.TaskExecutorManager

getTaskId() - Method in class alluxio.job.RunTaskContext

getUfsInfo(long) - Method in class alluxio.master.file.FileSystemMasterClient

getUfsManager() - Method in class alluxio.job.JobServerContext

getUptimeMs() - Method in class alluxio.worker.AlluxioJobWorkerProcess

getUptimeMs() - Method in interface alluxio.worker.JobWorkerProcess

getWebAddress() - Method in class alluxio.worker.AlluxioJobWorkerProcess

getWebAddress() - Method in interface alluxio.worker.JobWorkerProcess

getWorkerId() - Static method in class alluxio.worker.JobWorkerIdRegistry

getWorkerInfoList() - Method in class alluxio.master.job.JobMaster

getWorkerNetAddress() - Method in class alluxio.job.plan.load.LoadDefinition.LoadTask

getWorkerWithMostBlocks(List<BlockWorkerInfo>, List<FileBlockInfo>) - Static method in class alluxio.job.util.JobUtils

Returns whichever specified worker stores the most blocks from the block info list.

getWorkflowConfigClass() - Method in class alluxio.job.workflow.composite.CompositeExecutionFactory

getWorkflowConfigClass() - Method in interface alluxio.job.workflow.WorkflowExecutionFactory

getWriteSchema() - Method in class alluxio.job.plan.transform.format.csv.CsvSchema

getWriteSchema() - Method in class alluxio.job.plan.transform.format.orc.OrcSchema

H

hashCode() - Method in class alluxio.job.plan.migrate.MigrateCommand

hashCode() - Method in class alluxio.job.plan.replicate.SetReplicaTask

hashCode() - Method in class alluxio.job.plan.transform.CompactTask

hashCode() - Method in class alluxio.job.plan.transform.format.csv.CsvRow

hashCode() - Method in class alluxio.job.plan.transform.format.csv.CsvSchema

hashCode() - Method in class alluxio.job.plan.transform.format.parquet.ParquetRow

hashCode() - Method in class alluxio.job.plan.transform.format.parquet.ParquetSchema

hashCode() - Method in class alluxio.master.job.plan.PlanCoordinator

heartbeat(JobHeartbeatPRequest, StreamObserver<JobHeartbeatPResponse>) - Method in class alluxio.master.job.JobMasterWorkerServiceHandler

heartbeat() - Method in class alluxio.worker.job.command.CommandHandlingExecutor

heartbeat(JobWorkerHealth, List<JobInfo>) - Method in interface alluxio.worker.job.JobMasterClient

Periodic heartbeats to update the tasks' status from a worker, and returns the commands.

heartbeat(JobWorkerHealth, List<JobInfo>) - Method in class alluxio.worker.job.RetryHandlingJobMasterClient

I

incrementForAllConfigsCancelStatus(JobConfig) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment for both batch and non-batch configs for Cancel status.

incrementForAllConfigsCompleteStatus(JobConfig, FileSystem, RetryPolicy) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment for both batch and non-batch configs for COMPLETE status.

incrementForAllConfigsFailStatus(JobConfig) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment for both batch and non-batch configs for Fail status.

incrementForCancelStatus(String, long) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment cancelled job count.

incrementForCompleteStatusWithRetry(JobConfig, FileSystem, RetryPolicy) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment for non-batch config for complete status.

incrementForFailStatus(String, long) - Static method in class alluxio.master.job.metrics.DistributedCmdMetrics

Increment failed job count.

INVALID_WORKER_ID - Static variable in class alluxio.worker.JobWorkerIdRegistry

The default value to initialize job worker id, the job worker id generated by job master will never be the same as this value.

isHealthy() - Method in class alluxio.worker.job.command.JobWorkerHealthReporter.JobWorkerHealthReport

Determines whether the system is healthy from all the metrics it has collected.

isJobFinished() - Method in class alluxio.master.job.plan.PlanCoordinator

isReadWriteTypeInconsistent(String) - Static method in class alluxio.job.plan.transform.format.csv.CsvUtils

J

JobDefinitionFactory() - Constructor for class alluxio.job.plan.batch.BatchedJobDefinition.JobDefinitionFactory

JobMaster - Class in alluxio.master.job

The master that handles all job managing operations.

JobMaster(MasterContext, FileSystem, FileSystemContext, UfsManager) - Constructor for class alluxio.master.job.JobMaster

Creates a new instance of JobMaster.

JobMasterAuditContext - Class in alluxio.master.job

An audit context for job master.

JobMasterAuditContext(AsyncUserAccessAuditLogWriter) - Constructor for class alluxio.master.job.JobMasterAuditContext

Constructor of JobMasterAuditContext.

JobMasterClient - Interface in alluxio.worker.job

Interface for job service workers to communicate with the job master.

JobMasterClient.Factory - Class in alluxio.worker.job

Factory for JobMasterClient.

JobMasterClientRestServiceHandler - Class in alluxio.master.job

The REST service handler for job master.

JobMasterClientRestServiceHandler(ServletContext) - Constructor for class alluxio.master.job.JobMasterClientRestServiceHandler

Creates a new instance of JobMasterClientRestServiceHandler.

JobMasterClientServiceHandler - Class in alluxio.master.job

This class is a gRPC handler for job master RPCs invoked by a job service client.

JobMasterClientServiceHandler(JobMaster) - Constructor for class alluxio.master.job.JobMasterClientServiceHandler

Creates a new instance of JobMasterClientRestServiceHandler.

JobMasterWebServer - Class in alluxio.web

Job master web server.

JobMasterWebServer(String, InetSocketAddress, AlluxioJobMasterProcess) - Constructor for class alluxio.web.JobMasterWebServer

Creates a new instance of JobMasterWebServer.

JobMasterWorkerServiceHandler - Class in alluxio.master.job

This class is a gRPC handler for job master RPCs invoked by a job service worker.

JobMasterWorkerServiceHandler(JobMaster) - Constructor for class alluxio.master.job.JobMasterWorkerServiceHandler

Creates a new instance of JobMasterWorkerServiceHandler.

JobPath - Class in alluxio.job.plan.transform.format

Implementation of Path that has a cache for getting file system.

JobPath(String, String, String) - Constructor for class alluxio.job.plan.transform.format.JobPath

Copy of the constructor in Path.

JobServerContext - Class in alluxio.job

The context is used by job to access master-side resources and information.

JobServerContext(FileSystem, FileSystemContext, UfsManager) - Constructor for class alluxio.job.JobServerContext

Creates a new instance of JobServerContext.

JobUfsManager - Class in alluxio.underfs

Implementation of UfsManager to manage the ufs used by different job service processes.

JobUfsManager() - Constructor for class alluxio.underfs.JobUfsManager

Constructs an instance of JobUfsManager.

JobUtils - Class in alluxio.job.util

Utility class to make it easier to write jobs.

JobWorker - Class in alluxio.worker

A job worker that manages all the worker-related activities.

JobWorkerHealthReport(HardwareAbstractionLayer, WorkerNetAddress) - Constructor for class alluxio.worker.job.command.JobWorkerHealthReporter.JobWorkerHealthReport

Creates a new instance of JobWorkerHealthReporter.JobWorkerHealthReport.

JobWorkerHealthReporter - Class in alluxio.worker.job.command

The job worker health reporter.

JobWorkerHealthReporter(WorkerNetAddress) - Constructor for class alluxio.worker.job.command.JobWorkerHealthReporter

Creates a new instance of JobWorkerHealthReporter.

JobWorkerHealthReporter.JobWorkerHealthReport - Class in alluxio.worker.job.command

It represents the job worker health information.

JobWorkerIdRegistry - Class in alluxio.worker

The single place to get, set, and update job worker id.

JobWorkerProcess - Interface in alluxio.worker

A job worker in the Alluxio system.

JobWorkerProcess.Factory - Class in alluxio.worker

Factory for creating JobWorkerProcess.

JobWorkerWebServer - Class in alluxio.web

Job master web server.

JobWorkerWebServer(String, InetSocketAddress, JobWorkerProcess) - Constructor for class alluxio.web.JobWorkerWebServer

Creates a new instance of JobWorkerWebServer.

join(T, Map<WorkerInfo, SerializableVoid>) - Method in class alluxio.job.plan.AbstractVoidPlanDefinition

join(T, Map<WorkerInfo, R>) - Method in interface alluxio.job.plan.PlanDefinition

Joins the task results on the master.

join(StressBenchConfig, Map<WorkerInfo, String>) - Method in class alluxio.job.plan.stress.StressBenchDefinition

L

list(ListAllPOptions) - Method in class alluxio.master.job.JobMaster

list(List<String>, String) - Method in class alluxio.master.job.JobMasterClientRestServiceHandler

Lists all the jobs in the history.

list() - Method in class alluxio.master.job.plan.PlanTracker

A collection of all job Ids currently tracked in the job master.

list() - Method in class alluxio.master.job.workflow.WorkflowTracker

listAll(ListAllPRequest, StreamObserver<ListAllPResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

listCmds(ListAllPOptions) - Method in class alluxio.master.job.JobMaster

listDetailed() - Method in class alluxio.master.job.JobMaster

loadBlock(URIStatus, FileSystemContext, long, WorkerNetAddress, boolean) - Static method in class alluxio.job.util.JobUtils

Loads a block into the local worker.

LoadDefinition - Class in alluxio.job.plan.load

A simple loading job that loads the blocks of a file in a distributed and round-robin fashion.

LoadDefinition() - Constructor for class alluxio.job.plan.load.LoadDefinition

Constructs a new LoadDefinition.

LoadDefinition.LoadTask - Class in alluxio.job.plan.load

A task representing loading a block into the memory of a worker.

LoadTask(long, WorkerNetAddress, String) - Constructor for class alluxio.job.plan.load.LoadDefinition.LoadTask

LOG_ARGUMENT_LEVEL - Static variable in class alluxio.master.AlluxioJobMasterRestServiceHandler

LOG_ARGUMENT_LEVEL - Static variable in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

LOG_ARGUMENT_NAME - Static variable in class alluxio.master.AlluxioJobMasterRestServiceHandler

LOG_ARGUMENT_NAME - Static variable in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

LOG_LEVEL - Static variable in class alluxio.master.AlluxioJobMasterRestServiceHandler

LOG_LEVEL - Static variable in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

logLevel(String, String) - Method in class alluxio.master.AlluxioJobMasterRestServiceHandler

logLevel(String, String) - Method in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

M

mActiveJobs - Variable in class alluxio.master.job.tracker.AbstractCmdRunner

main(String[]) - Static method in class alluxio.master.AlluxioJobMaster

Starts the Alluxio job master.

main(String[]) - Static method in class alluxio.worker.AlluxioJobWorker

Starts the Alluxio job worker.

mFileSystem - Variable in class alluxio.master.job.tracker.AbstractCmdRunner

mFsContext - Variable in class alluxio.master.job.tracker.AbstractCmdRunner

mFsContext - Variable in class alluxio.master.job.tracker.CmdJobTracker

MigrateCliRunner - Class in alluxio.master.job.tracker

A config runner for a MigrateCli job.

MigrateCliRunner(FileSystemContext, JobMaster) - Constructor for class alluxio.master.job.tracker.MigrateCliRunner

constructor.

MigrateCommand - Class in alluxio.job.plan.migrate

A command telling a worker to migrate a file.

MigrateCommand(String, String) - Constructor for class alluxio.job.plan.migrate.MigrateCommand

MigrateDefinition - Class in alluxio.job.plan.migrate

A job that migrates a single file from source path to a destination path.

MigrateDefinition() - Constructor for class alluxio.job.plan.migrate.MigrateDefinition

Constructs a new MigrateDefinition.

mJobMap - Variable in class alluxio.master.job.tracker.AbstractCmdRunner

mJobMaster - Variable in class alluxio.master.job.tracker.AbstractCmdRunner

mJobMaster - Variable in class alluxio.master.job.tracker.CmdRunAttempt

Mode - Enum in alluxio.job.plan.replicate

setReplication Mode.

MoveDefinition - Class in alluxio.job.plan.replicate

A job to move a block.

MoveDefinition() - Constructor for class alluxio.job.plan.replicate.MoveDefinition

Constructs a new MoveDefinition.

mRetryPolicy - Variable in class alluxio.master.job.tracker.CmdRunAttempt

mSubmitted - Variable in class alluxio.master.job.tracker.AbstractCmdRunner

N

next() - Method in class alluxio.job.workflow.WorkflowExecution

Given the previous set of jobs were completed successfully, returns a list of jobs to execute next.

nextJobs() - Method in class alluxio.job.workflow.composite.CompositeExecution

nextJobs() - Method in class alluxio.job.workflow.WorkflowExecution

Given the previous set of jobs were completed successfully, returns a list of jobs to execute next.

NoopPlanDefinition - Class in alluxio.job.plan

This definition of a plan that does nothing.

NoopPlanDefinition() - Constructor for class alluxio.job.plan.NoopPlanDefinition

Constructs a new instance.

notifyTaskCompletion(long, long, Serializable) - Method in class alluxio.worker.job.task.TaskExecutorManager

Notifies the completion of the task.

notifyTaskFailure(long, long, Throwable) - Method in class alluxio.worker.job.task.TaskExecutorManager

Notifies the failure of the task.

notifyTaskRunning(long, long) - Method in class alluxio.worker.job.task.TaskExecutorManager

Noitfy the start of the task.

O

onPlanStatusChange(PlanInfo) - Method in class alluxio.master.job.workflow.WorkflowTracker

Updates internal state of the workflows based on the updated state of a plan.

OrcReader - Class in alluxio.job.plan.transform.format.orc

The Orc reader.

OrcRow - Class in alluxio.job.plan.transform.format.orc

A row in a Orc table.

OrcRow(OrcSchema, VectorizedRowBatch, int, List<String>) - Constructor for class alluxio.job.plan.transform.format.orc.OrcRow

Constructor for OrcRow.

OrcSchema - Class in alluxio.job.plan.transform.format.orc

The Orc Schema.

OrcSchema(Reader) - Constructor for class alluxio.job.plan.transform.format.orc.OrcSchema

Default constructor for OrcSchema.

P

ParquetReader - Class in alluxio.job.plan.transform.format.parquet

A reader for reading ParquetRow.

ParquetRow - Class in alluxio.job.plan.transform.format.parquet

A row in a Parquet table represented in Avro format.

ParquetRow(GenericData.Record) - Constructor for class alluxio.job.plan.transform.format.parquet.ParquetRow

ParquetSchema - Class in alluxio.job.plan.transform.format.parquet

Parquet table schema in Avro format.

ParquetSchema(Schema) - Constructor for class alluxio.job.plan.transform.format.parquet.ParquetSchema

ParquetWriter - Class in alluxio.job.plan.transform.format.parquet

A writer for writing ParquetRow.

PausableThreadPoolExecutor - Class in alluxio.worker.job.task

ThreadPoolExecutor that can be temporarily paused to prevent any threads from executing new tasks.

PausableThreadPoolExecutor(int, int, long, TimeUnit, BlockingQueue<Runnable>, ThreadFactory) - Constructor for class alluxio.worker.job.task.PausableThreadPoolExecutor

Copy of one of the constructors in ThreadPoolExecutor.

pause() - Method in class alluxio.worker.job.task.PausableThreadPoolExecutor

Pause all threads from executing new tasks.

PersistDefinition - Class in alluxio.job.plan.persist

A job that persists a file into the under storage.

PersistDefinition() - Constructor for class alluxio.job.plan.persist.PersistDefinition

Constructs a new PersistDefinition.

PersistRunner - Class in alluxio.master.job.tracker

A config runner for a Persist job.

PersistRunner(FileSystemContext, JobMaster) - Constructor for class alluxio.master.job.tracker.PersistRunner

constructor.

PlanCoordinator - Class in alluxio.master.job.plan

A job coordinator that coordinates the distributed task execution on the worker nodes.

PlanDefinition<T extends JobConfig,P extends java.io.Serializable,R extends java.io.Serializable> - Interface in alluxio.job.plan

A job definition.

PlanDefinitionRegistry - Enum in alluxio.job.plan

The central registry of all the job definitions.

PlanTracker - Class in alluxio.master.job.plan

The PlanTracker is used to create, remove, and provide access to the set of currently scheduled or finished jobs.

PlanTracker(long, long, long, WorkflowTracker) - Constructor for class alluxio.master.job.plan.PlanTracker

Create a new instance of PlanTracker.

pollAllPendingCommands(long) - Method in class alluxio.master.job.command.CommandManager

Polls all the pending commands to a worker and removes the commands from the queue.

printFailed() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Log failed file information.

Q

QUERY_RAW_CONFIGURATION - Static variable in class alluxio.master.AlluxioJobMasterRestServiceHandler

QUERY_RAW_CONFIGURATION - Static variable in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

R

read() - Method in class alluxio.job.plan.transform.format.csv.CsvReader

read() - Method in class alluxio.job.plan.transform.format.orc.OrcReader

read() - Method in class alluxio.job.plan.transform.format.parquet.ParquetReader

read() - Method in interface alluxio.job.plan.transform.format.TableReader

readNoCacheConf() - Static method in class alluxio.job.plan.transform.format.ReadWriterUtils

ReadWriterUtils - Class in alluxio.job.plan.transform.format

Utilities for implementing TableReader and TableWriter.

registerJobWorker(RegisterJobWorkerPRequest, StreamObserver<RegisterJobWorkerPResponse>) - Method in class alluxio.master.job.JobMasterWorkerServiceHandler

registerWorker(WorkerNetAddress) - Method in class alluxio.master.job.JobMaster

Returns a worker id for the given worker.

registerWorker(WorkerNetAddress) - Method in interface alluxio.worker.job.JobMasterClient

Returns a worker id for a workers net address.

registerWorker(WorkerNetAddress) - Method in class alluxio.worker.job.RetryHandlingJobMasterClient

registerWorker(JobMasterClient, WorkerNetAddress) - Static method in class alluxio.worker.JobWorkerIdRegistry

Registers with JobMaster to get a new job worker id.

restoreTaskUpdates(List<TaskInfo>) - Method in class alluxio.worker.job.task.TaskExecutorManager

Adds the given tasks to the task updates data structure.

resume() - Method in class alluxio.worker.job.task.PausableThreadPoolExecutor

Resume all threads to run new tasks.

RetryHandlingJobMasterClient - Class in alluxio.worker.job

A wrapper for the gRPC client to interact with the job service master, used by job service workers.

RetryHandlingJobMasterClient(JobMasterClientContext) - Constructor for class alluxio.worker.job.RetryHandlingJobMasterClient

Creates a new job master client.

RowsCommitter - Class in alluxio.job.plan.transform.format.tables

Determines whether to commit based on the number of rows that have been written.

RowsCommitter(int) - Constructor for class alluxio.job.plan.transform.format.tables.RowsCommitter

run(JobConfig) - Method in class alluxio.master.job.JobMaster

Runs a job with the given configuration.

run(JobConfig, long) - Method in class alluxio.master.job.JobMaster

Runs a job with the given configuration and job id.

run(JobConfig) - Method in class alluxio.master.job.JobMasterClientRestServiceHandler

Runs a job.

run(RunPRequest, StreamObserver<RunPResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

run(PlanConfig, CommandManager, JobServerContext, List<WorkerInfo>, long) - Method in class alluxio.master.job.plan.PlanTracker

Adds a job with the given JobConfig to the job tracker.

run(CmdConfig, long) - Method in class alluxio.master.job.tracker.CmdJobTracker

Run the PlanTracker to trigger a Cmd job based on CmdConfig.

run() - Method in class alluxio.master.job.tracker.CmdRunAttempt

Runs the job.

run(WorkflowConfig, long) - Method in class alluxio.master.job.workflow.WorkflowTracker

Runs a workflow with the given configuration and job id.

run() - Method in class alluxio.worker.job.task.TaskExecutor

runDistCp(AlluxioURI, AlluxioURI, boolean, int, long) - Method in class alluxio.master.job.tracker.MigrateCliRunner

Run a DistCp command.

runDistLoad(int, AlluxioURI, int, Set<String>, Set<String>, Set<String>, Set<String>, boolean, long) - Method in class alluxio.master.job.tracker.DistLoadCliRunner

Run a DistLoad command.

runPersistJob(PersistCmdConfig, long) - Method in class alluxio.master.job.tracker.PersistRunner

Run a Persist job.

runTask(BatchedJobConfig, BatchedJobDefinition.BatchedJobTask, RunTaskContext) - Method in class alluxio.job.plan.batch.BatchedJobDefinition

runTask(LoadConfig, ArrayList<LoadDefinition.LoadTask>, RunTaskContext) - Method in class alluxio.job.plan.load.LoadDefinition

runTask(MigrateConfig, MigrateCommand, RunTaskContext) - Method in class alluxio.job.plan.migrate.MigrateDefinition

Runs the task in the executor.

runTask(NoopPlanConfig, SerializableVoid, RunTaskContext) - Method in class alluxio.job.plan.NoopPlanDefinition

runTask(PersistConfig, SerializableVoid, RunTaskContext) - Method in class alluxio.job.plan.persist.PersistDefinition

runTask(T, P, RunTaskContext) - Method in interface alluxio.job.plan.PlanDefinition

Runs the task in the executor.

runTask(MoveConfig, SerializableVoid, RunTaskContext) - Method in class alluxio.job.plan.replicate.MoveDefinition

Runs the task in the executor.

runTask(SetReplicaConfig, SetReplicaTask, RunTaskContext) - Method in class alluxio.job.plan.replicate.SetReplicaDefinition

Runs the task in the executor.

runTask(StressBenchConfig, ArrayList<String>, RunTaskContext) - Method in class alluxio.job.plan.stress.StressBenchDefinition

runTask(CompactConfig, ArrayList<CompactTask>, RunTaskContext) - Method in class alluxio.job.plan.transform.CompactDefinition

RunTaskContext - Class in alluxio.job

A context which contains useful information that can be used when running a task on a job worker.

RunTaskContext(long, long, JobServerContext) - Constructor for class alluxio.job.RunTaskContext

Creates an instance of RunTaskContext.

S

SchemaConversionUtils - Class in alluxio.job.plan.transform.format

Utility Class for converting schema to Parquet.

SchemaConversionUtils() - Constructor for class alluxio.job.plan.transform.format.SchemaConversionUtils

selectExecutors(BatchedJobConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.batch.BatchedJobDefinition

selectExecutors(LoadConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.load.LoadDefinition

selectExecutors(MigrateConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.migrate.MigrateDefinition

Selects the workers to run the task.

selectExecutors(NoopPlanConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.NoopPlanDefinition

selectExecutors(PersistConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.persist.PersistDefinition

selectExecutors(T, List<WorkerInfo>, SelectExecutorsContext) - Method in interface alluxio.job.plan.PlanDefinition

Selects the workers to run the task.

selectExecutors(MoveConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.replicate.MoveDefinition

selectExecutors(SetReplicaConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.replicate.SetReplicaDefinition

selectExecutors(StressBenchConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.stress.StressBenchDefinition

selectExecutors(CompactConfig, List<WorkerInfo>, SelectExecutorsContext) - Method in class alluxio.job.plan.transform.CompactDefinition

SelectExecutorsContext - Class in alluxio.job

A context containing useful parameters for the job master to use when selecting the worker that a job should execute on.

SelectExecutorsContext(long, JobServerContext) - Constructor for class alluxio.job.SelectExecutorsContext

Creates a new instance of SelectExecutorsContext.

SERVICE_PREFIX - Static variable in class alluxio.master.AlluxioJobMasterRestServiceHandler

SERVICE_PREFIX - Static variable in class alluxio.worker.AlluxioJobWorkerRestServiceHandler

setAllowed(boolean) - Method in class alluxio.master.job.JobMasterAuditContext

setAuthType(AuthType) - Method in class alluxio.master.job.JobMasterAuditContext

Sets mAuthType field.

setClientVersion(String) - Method in class alluxio.master.job.JobMasterAuditContext

Sets client version.

setCommand(String) - Method in class alluxio.master.job.JobMasterAuditContext

Sets mCommand field.

setConfig(JobConfig) - Method in class alluxio.master.job.tracker.CmdRunAttempt

Set job config.

setCreationTimeNs(long) - Method in class alluxio.master.job.JobMasterAuditContext

Sets mCreationTimeNs field.

setDefaultTaskExecutorPoolSize(int) - Method in class alluxio.worker.job.task.TaskExecutorManager

Sets the number of threads in the task executor pool when not throttled.

setFileCount(long) - Method in class alluxio.master.job.tracker.CmdRunAttempt

Set file count.

setFilePath(String) - Method in class alluxio.master.job.tracker.CmdRunAttempt

Set file path.

setFileSize(long) - Method in class alluxio.master.job.tracker.CmdRunAttempt

Set file size.

setIp(String) - Method in class alluxio.master.job.JobMasterAuditContext

Sets mIp field.

setJobAsFailed(String, String) - Method in class alluxio.master.job.plan.PlanCoordinator

Sets the job as failed with given error message.

setJobConfigAndFileMetrics(List<URIStatus>, int, Set<String>, Set<String>, Set<String>, Set<String>, boolean, CmdRunAttempt) - Method in class alluxio.master.job.tracker.DistLoadCliRunner

setJobConfigAndFileMetrics(List<Pair<String, String>>, boolean, WriteType, CmdRunAttempt) - Method in class alluxio.master.job.tracker.MigrateCliRunner

Create a JobConfig and set file count and size for the Migrate job.

setJobId(long) - Method in class alluxio.master.job.JobMasterAuditContext

Sets mCreationTimeNs field.

setJobName(String) - Method in class alluxio.master.job.JobMasterAuditContext

Sets mJobName field.

SetReplicaDefinition - Class in alluxio.job.plan.replicate

A job to replicate a block.

SetReplicaDefinition() - Constructor for class alluxio.job.plan.replicate.SetReplicaDefinition

Constructs a new SetReplicaDefinition.

SetReplicaTask - Class in alluxio.job.plan.replicate

A task representing loading a block into the memory of a worker.

SetReplicaTask(Mode) - Constructor for class alluxio.job.plan.replicate.SetReplicaTask

setSucceeded(boolean) - Method in class alluxio.master.job.JobMasterAuditContext

setTaskPoolSize(int) - Method in class alluxio.master.job.JobMaster

setUgi(String) - Method in class alluxio.master.job.JobMasterAuditContext

Sets mUgi field.

shouldCommit(TableWriter) - Method in class alluxio.job.plan.transform.format.tables.BytesCommitter

shouldCommit(TableWriter) - Method in interface alluxio.job.plan.transform.format.tables.Committer

shouldCommit(TableWriter) - Method in class alluxio.job.plan.transform.format.tables.RowsCommitter

start(Boolean) - Method in class alluxio.master.job.JobMaster

start() - Method in class alluxio.worker.AlluxioJobWorkerProcess

start(WorkerNetAddress) - Method in class alluxio.worker.JobWorker

stop(Status, String, String) - Method in class alluxio.job.workflow.WorkflowExecution

stops future execution.

stop() - Method in class alluxio.master.job.JobMaster

stop() - Method in class alluxio.worker.AlluxioJobWorkerProcess

stop() - Method in class alluxio.worker.JobWorker

StressBenchDefinition - Class in alluxio.job.plan.stress

The definition for the stress bench job, which runs distributed benchmarks.

StressBenchDefinition() - Constructor for class alluxio.job.plan.stress.StressBenchDefinition

Constructs a new instance.

submit(CmdConfig) - Method in class alluxio.master.job.JobMaster

Submit a job with the given configuration.

submit(SubmitRequest, StreamObserver<SubmitResponse>) - Method in class alluxio.master.job.JobMasterClientServiceHandler

submitCancelTaskCommand(long, long, long) - Method in class alluxio.master.job.command.CommandManager

Submits a cancel-task command to a specified worker.

submitRunTaskCommand(long, long, JobConfig, Object, long) - Method in class alluxio.master.job.command.CommandManager

Submits a run-task command to a specified worker.

submitSetTaskPoolSizeCommand(long, int) - Method in class alluxio.master.job.command.CommandManager

Submits a set thread pool size command to specific worker.

T

TableReader - Interface in alluxio.job.plan.transform.format

A reader for reading rows in a table.

TableRow - Interface in alluxio.job.plan.transform.format

A row in a table.

TableSchema - Interface in alluxio.job.plan.transform.format

The table schema.

TablesWriter - Class in alluxio.job.plan.transform.format.tables

Writes a stream of rows to a list of tables, when Committer determines that the current table should be committed/completed, the table file is completed and a new table file is created.

TableWriter - Interface in alluxio.job.plan.transform.format

A writer for writing rows to a table.

TaskExecutor - Class in alluxio.worker.job.task

A thread that runs the task.

TaskExecutor(long, long, RunTaskCommand, RunTaskContext, TaskExecutorManager) - Constructor for class alluxio.worker.job.task.TaskExecutor

Creates a new instance of TaskExecutor.

TaskExecutorManager - Class in alluxio.worker.job.task

Manages the task executors.

TaskExecutorManager(int, WorkerNetAddress) - Constructor for class alluxio.worker.job.task.TaskExecutorManager

Constructs a new instance of TaskExecutorManager.

throttle() - Method in class alluxio.worker.job.task.TaskExecutorManager

Throttle the TaskExecutorManager.

toBigDecimal(String) - Method in class alluxio.job.plan.transform.format.csv.Decimal

toParquet() - Method in class alluxio.job.plan.transform.format.csv.CsvRow

toParquet() - Method in class alluxio.job.plan.transform.format.csv.CsvSchema

toParquet() - Method in class alluxio.job.plan.transform.format.orc.OrcRow

toParquet() - Method in class alluxio.job.plan.transform.format.orc.OrcSchema

toParquet() - Method in class alluxio.job.plan.transform.format.parquet.ParquetRow

toParquet() - Method in class alluxio.job.plan.transform.format.parquet.ParquetSchema

toParquet() - Method in interface alluxio.job.plan.transform.format.TableRow

toParquet() - Method in interface alluxio.job.plan.transform.format.TableSchema

toParquetBytes(String) - Method in class alluxio.job.plan.transform.format.csv.Decimal

toString() - Method in class alluxio.job.plan.batch.BatchedJobDefinition.BatchedJobTask

toString() - Method in class alluxio.job.plan.load.LoadDefinition.LoadTask

toString() - Method in class alluxio.job.plan.migrate.MigrateCommand

toString() - Method in class alluxio.job.plan.replicate.SetReplicaTask

toString() - Method in class alluxio.job.plan.transform.CompactTask

toString() - Method in class alluxio.master.job.common.CmdInfo

tostring.

toString() - Method in class alluxio.master.job.JobMasterAuditContext

toString() - Method in class alluxio.worker.AlluxioJobWorkerProcess

U

unfinishedTasks() - Method in class alluxio.worker.job.task.TaskExecutorManager

unthrottle() - Method in class alluxio.worker.job.task.TaskExecutorManager

Unthrottle the TaskExecutorManager.

updateTasks(List<TaskInfo>) - Method in class alluxio.master.job.plan.PlanCoordinator

Updates internal status with given tasks.

V

valueOf(String) - Static method in enum alluxio.job.plan.PlanDefinitionRegistry

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum alluxio.job.plan.replicate.Mode

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum alluxio.job.workflow.WorkflowExecutionRegistry

Returns the enum constant of this type with the specified name.

values() - Static method in enum alluxio.job.plan.PlanDefinitionRegistry

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum alluxio.job.plan.replicate.Mode

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum alluxio.job.workflow.WorkflowExecutionRegistry

Returns an array containing the constants of this enum type, in the order they are declared.

W

waitForCmdJob() - Method in class alluxio.master.job.tracker.AbstractCmdRunner

Waits for at least one job to complete.

waitForReady(int) - Method in class alluxio.worker.AlluxioJobWorkerProcess

workerHeartbeat(JobWorkerHealth, List<TaskInfo>) - Method in class alluxio.master.job.JobMaster

Updates the tasks' status when a worker periodically heartbeats with the master, and sends the commands for the worker to execute.

WorkflowExecution - Class in alluxio.job.workflow

Execution details of a workflow.

WorkflowExecution() - Constructor for class alluxio.job.workflow.WorkflowExecution

Default constructor.

WorkflowExecutionFactory<T extends WorkflowConfig> - Interface in alluxio.job.workflow

The workflow execution factory.

WorkflowExecutionRegistry - Enum in alluxio.job.workflow

Registry for WorkflowExecution.

WorkflowTracker - Class in alluxio.master.job.workflow

The WorkflowTracker.

WorkflowTracker(JobMaster) - Constructor for class alluxio.master.job.workflow.WorkflowTracker

Constructor for WorkflowTracker.

write(TableRow) - Method in class alluxio.job.plan.transform.format.csv.CsvWriter

write(TableRow) - Method in class alluxio.job.plan.transform.format.parquet.ParquetWriter

write(TableRow) - Method in class alluxio.job.plan.transform.format.tables.TablesWriter

write(TableRow) - Method in interface alluxio.job.plan.transform.format.TableWriter

Writes a row.

writeThroughConf() - Static method in class alluxio.job.plan.transform.format.ReadWriterUtils

A B C D E F G H I J L M N O P Q R S T U V W