com.netflix.genie.web.configs

Class JobConfig

java.lang.Object

com.netflix.genie.web.configs.JobConfig

@Configuration
public class JobConfig
extends java.lang.Object

Configuration for Jobs Setup and Run.

Since:

3.0.0

Constructor Summary

Constructors

Constructor and Description
JobConfig()

Method Summary

Modifier and Type	Method and Description
com.netflix.genie.core.jobs.workflow.WorkflowTask	applicationProcessorTask(com.netflix.spectator.api.Registry registry, com.netflix.genie.core.services.impl.GenieFileTransferService fts) Create an Application Task bean that processes all Applications needed for a job.
com.netflix.genie.core.jobs.workflow.WorkflowTask	clusterProcessorTask(com.netflix.spectator.api.Registry registry, com.netflix.genie.core.services.impl.GenieFileTransferService fts) Create an Cluster Task bean that processes the cluster needed for a job.
com.netflix.genie.core.jobs.workflow.WorkflowTask	commandProcessorTask(com.netflix.spectator.api.Registry registry, com.netflix.genie.core.services.impl.GenieFileTransferService fts) Create an Command Task bean that processes the command needed for a job.
HttpFileTransferImpl	httpFileTransfer(org.springframework.web.client.RestTemplate restTemplate, com.netflix.spectator.api.Registry registry) Bean to create a http[s] file transfer object.
com.netflix.genie.core.jobs.workflow.WorkflowTask	initialSetupTask(com.netflix.spectator.api.Registry registry) Create an setup Task bean that does initial setup before any of the tasks start.
com.netflix.genie.core.jobs.workflow.WorkflowTask	jobKickoffTask(com.netflix.genie.core.properties.JobsProperties jobsProperties, org.apache.commons.exec.Executor executor, java.lang.String hostName, com.netflix.spectator.api.Registry registry) Create an Job Kickoff Task bean that runs the job.
com.netflix.genie.core.jobs.workflow.WorkflowTask	jobKillLogicTask(com.netflix.spectator.api.Registry registry) Create a task that adds logic to handle kill requests to a job.
com.netflix.genie.core.jobs.workflow.WorkflowTask	jobProcessorTask(com.netflix.genie.core.services.AttachmentService attachmentService, com.netflix.spectator.api.Registry registry, com.netflix.genie.core.services.impl.GenieFileTransferService fts) Create an Job Task bean that processes Job information provided by user.
com.netflix.genie.core.services.impl.LocalFileTransferImpl	localFileTransfer() Bean to create a local file transfer object.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JobConfig

public JobConfig()

Method Detail

localFileTransfer

@Bean(name={"file.system.file","file.system.null"})
 @Order(value=2)
public com.netflix.genie.core.services.impl.LocalFileTransferImpl localFileTransfer()

Bean to create a local file transfer object.

Returns:

A unix copy implementation of the FileTransferService.

httpFileTransfer

@Bean(name={"file.system.http","file.system.https"})
 @Order(value=3)
public HttpFileTransferImpl httpFileTransfer(org.springframework.web.client.RestTemplate restTemplate,
                                                                                                                   com.netflix.spectator.api.Registry registry)

Bean to create a http[s] file transfer object.

Parameters:

restTemplate - The rest template to use

registry - The registry to use for metrics

Returns:

A http implementation of the FileTransferService.

jobKillLogicTask

@Bean
 @Order(value=0)
public com.netflix.genie.core.jobs.workflow.WorkflowTask jobKillLogicTask(com.netflix.spectator.api.Registry registry)

Create a task that adds logic to handle kill requests to a job.

Parameters:

registry - The metrics registry to use

Returns:

A jobKillLogicTask bean.

initialSetupTask

@Bean
 @Order(value=1)
public com.netflix.genie.core.jobs.workflow.WorkflowTask initialSetupTask(com.netflix.spectator.api.Registry registry)

Create an setup Task bean that does initial setup before any of the tasks start.

Parameters:

registry - The metrics registry to use

Returns:

An initial setup task object

clusterProcessorTask

@Bean
 @Order(value=2)
public com.netflix.genie.core.jobs.workflow.WorkflowTask clusterProcessorTask(com.netflix.spectator.api.Registry registry,
                                                                                                     @Qualifier(value="cacheGenieFileTransferService")
                                                                                                     com.netflix.genie.core.services.impl.GenieFileTransferService fts)

Create an Cluster Task bean that processes the cluster needed for a job.

Parameters:

registry - The metrics registry to use

fts - File transfer implementation

Returns:

An cluster task object

applicationProcessorTask

@Bean
 @Order(value=3)
public com.netflix.genie.core.jobs.workflow.WorkflowTask applicationProcessorTask(com.netflix.spectator.api.Registry registry,
                                                                                                         @Qualifier(value="cacheGenieFileTransferService")
                                                                                                         com.netflix.genie.core.services.impl.GenieFileTransferService fts)

Create an Application Task bean that processes all Applications needed for a job.

Parameters:

registry - The metrics registry to use

fts - File transfer implementation

Returns:

An application task object

commandProcessorTask

@Bean
 @Order(value=4)
public com.netflix.genie.core.jobs.workflow.WorkflowTask commandProcessorTask(com.netflix.spectator.api.Registry registry,
                                                                                                     @Qualifier(value="cacheGenieFileTransferService")
                                                                                                     com.netflix.genie.core.services.impl.GenieFileTransferService fts)

Create an Command Task bean that processes the command needed for a job.

Parameters:

registry - The metrics registry to use

fts - File transfer implementation

Returns:

An command task object

jobProcessorTask

@Bean
 @Order(value=5)
 @Autowired
public com.netflix.genie.core.jobs.workflow.WorkflowTask jobProcessorTask(com.netflix.genie.core.services.AttachmentService attachmentService,
                                                                                                             com.netflix.spectator.api.Registry registry,
                                                                                                             @Qualifier(value="genieFileTransferService")
                                                                                                             com.netflix.genie.core.services.impl.GenieFileTransferService fts)
                                                                                                      throws com.netflix.genie.common.exceptions.GenieException

Create an Job Task bean that processes Job information provided by user.

Parameters:

attachmentService - An implementation of the attachment service

registry - The metrics registry to use

fts - File transfer implementation

Returns:

An job task object

Throws:

com.netflix.genie.common.exceptions.GenieException - if there is any problem

jobKickoffTask

@Bean
 @Order(value=6)
 @Autowired
public com.netflix.genie.core.jobs.workflow.WorkflowTask jobKickoffTask(com.netflix.genie.core.properties.JobsProperties jobsProperties,
                                                                                                           org.apache.commons.exec.Executor executor,
                                                                                                           java.lang.String hostName,
                                                                                                           com.netflix.spectator.api.Registry registry)

Create an Job Kickoff Task bean that runs the job.

Parameters:

jobsProperties - The various jobs properties

executor - An instance of an executor

hostName - Host on which the job will run

registry - The metrics registry to use

Returns:

An application task object