org.apache.oozie

Class CoordinatorEngine

java.lang.Object

org.apache.oozie.BaseEngine

org.apache.oozie.CoordinatorEngine

public class CoordinatorEngine
extends BaseEngine

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CoordinatorEngine.FILTER_COMPARATORS

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	COORD_ACTIONS_LOG_MAX_COUNT
static java.lang.String[]	VALID_JOB_FILTERS

Fields inherited from class org.apache.oozie.BaseEngine

USE_XCOMMAND, user

Constructor Summary

Constructors

Constructor and Description
CoordinatorEngine() Create a system Coordinator engine, with no user and no group.
CoordinatorEngine(java.lang.String user) Create a Coordinator engine to perform operations on behave of a user.

Method Summary

Methods

Modifier and Type	Method and Description
void	change(java.lang.String jobId, java.lang.String changeValue) Change a coordinator job.
java.lang.String	dryRunSubmit(org.apache.hadoop.conf.Configuration conf) Dry run a job; like {@link BaseEngine#submitJob(org.apache.hadoop.conf.Configuration, boolean) but doesn't actually execute the job.
java.lang.String	getActionStatus(java.lang.String actionId) Return the status for an Action ID
CoordinatorActionBean	getCoordAction(java.lang.String actionId)
CoordinatorJobBean	getCoordJob(java.lang.String jobId) Return the info about a coord job.
CoordinatorJobBean	getCoordJob(java.lang.String jobId, java.lang.String filter, int offset, int length, boolean desc) Return the info about a coord job with actions subset.
CoordinatorJobInfo	getCoordJobs(java.lang.String filter, int start, int len)
java.lang.String	getDefinition(java.lang.String jobId) Return the a job definition.
org.apache.oozie.client.WorkflowJob	getJob(java.lang.String jobId) Return the info about a wf job.
org.apache.oozie.client.WorkflowJob	getJob(java.lang.String jobId, int start, int length) Return the info about a wf job with actions subset.
java.lang.String	getJobIdForExternalId(java.lang.String externalId) Return the workflow Job ID for an external ID.
java.lang.String	getJobStatus(java.lang.String jobId) Return the status for a Job ID
java.util.List<WorkflowJobBean>	getReruns(java.lang.String coordActionId)
CoordinatorActionInfo	ignore(java.lang.String jobId, java.lang.String type, java.lang.String scope)
void	kill(java.lang.String jobId) Kill a job.
CoordinatorActionInfo	killActions(java.lang.String jobId, java.lang.String rangeType, java.lang.String scope)
CoordinatorJobInfo	killJobs(java.lang.String filter, int start, int length) return a list of killed Coordinator job
java.util.Map<Pair<java.lang.String,CoordinatorEngine.FILTER_COMPARATORS>,java.util.List<java.lang.Object>>	parseJobFilter(java.lang.String filter)
void	reRun(java.lang.String jobId, org.apache.hadoop.conf.Configuration conf) Deprecated.
CoordinatorActionInfo	reRun(java.lang.String jobId, java.lang.String rerunType, java.lang.String scope, boolean refresh, boolean noCleanup, boolean failed) Rerun coordinator actions for given rerunType
void	resume(java.lang.String jobId) Resume a job.
CoordinatorJobInfo	resumeJobs(java.lang.String filter, int start, int length) return the jobs that've been resumed
void	start(java.lang.String jobId) Deprecated.
void	streamLog(java.lang.String jobId, java.lang.String logRetrievalScope, java.lang.String logRetrievalType, java.io.Writer writer, java.util.Map<java.lang.String,java.lang.String[]> params) Add list of actions to the filter based on conditions
void	streamLog(java.lang.String jobId, java.io.Writer writer, java.util.Map<java.lang.String,java.lang.String[]> params) Stream the log of a job.
java.lang.String	submitJob(org.apache.hadoop.conf.Configuration conf, boolean startJob) Submit a job.
void	suspend(java.lang.String jobId) Suspend a job.
CoordinatorJobInfo	suspendJobs(java.lang.String filter, int start, int length) return the jobs that've been suspended
java.lang.String	updateJob(org.apache.hadoop.conf.Configuration conf, java.lang.String jobId, boolean dryrun, boolean showDiff) Update coord job definition.

Methods inherited from class org.apache.oozie.BaseEngine

getJMSTopicName, getUser

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

COORD_ACTIONS_LOG_MAX_COUNT

public static final java.lang.String COORD_ACTIONS_LOG_MAX_COUNT

See Also:

Constant Field Values

VALID_JOB_FILTERS

public static final java.lang.String[] VALID_JOB_FILTERS

Constructor Detail

CoordinatorEngine

public CoordinatorEngine()

Create a system Coordinator engine, with no user and no group.

CoordinatorEngine

public CoordinatorEngine(java.lang.String user)

Create a Coordinator engine to perform operations on behave of a user.

Parameters:

user - user name.

Method Detail

getDefinition

public java.lang.String getDefinition(java.lang.String jobId)
                               throws BaseEngineException

Description copied from class: BaseEngine

Return the a job definition.

Specified by:

getDefinition in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the job definition.

Throws:

BaseEngineException - thrown if the job definition could no be obtained.

getCoordAction

public CoordinatorActionBean getCoordAction(java.lang.String actionId)
                                     throws BaseEngineException

Parameters:

actionId -

Returns:

CoordinatorActionBean

Throws:

BaseEngineException

getCoordJob

public CoordinatorJobBean getCoordJob(java.lang.String jobId)
                               throws BaseEngineException

Description copied from class: BaseEngine

Return the info about a coord job.

Specified by:

getCoordJob in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the coord job info.

Throws:

BaseEngineException - thrown if the job info could not be obtained.

getCoordJob

public CoordinatorJobBean getCoordJob(java.lang.String jobId,
                             java.lang.String filter,
                             int offset,
                             int length,
                             boolean desc)
                               throws BaseEngineException

Description copied from class: BaseEngine

Return the info about a coord job with actions subset.

Specified by:

getCoordJob in class BaseEngine

Parameters:

jobId - job Id.

filter - the status filter

offset - starting from this index in the list of actions belonging to the job

length - number of actions to be returned

Returns:

the coord job info.

Throws:

BaseEngineException - thrown if the job info could not be obtained.

getJobIdForExternalId

public java.lang.String getJobIdForExternalId(java.lang.String externalId)
                                       throws CoordinatorEngineException

Description copied from class: BaseEngine

Return the workflow Job ID for an external ID.

This is reverse lookup for recovery purposes.

Specified by:

getJobIdForExternalId in class BaseEngine

Parameters:

externalId - external ID provided at job submission time.

Returns:

the associated workflow job ID if any, null if none.

Throws:

CoordinatorEngineException

kill

public void kill(java.lang.String jobId)
          throws CoordinatorEngineException

Description copied from class: BaseEngine

Kill a job.

Specified by:

kill in class BaseEngine

Parameters:

jobId - job Id.

Throws:

CoordinatorEngineException

killActions

public CoordinatorActionInfo killActions(java.lang.String jobId,
                                java.lang.String rangeType,
                                java.lang.String scope)
                                  throws CoordinatorEngineException

Throws:

CoordinatorEngineException

change

public void change(java.lang.String jobId,
          java.lang.String changeValue)
            throws CoordinatorEngineException

Description copied from class: BaseEngine

Change a coordinator job.

Specified by:

change in class BaseEngine

Parameters:

jobId - job Id.

changeValue - change value.

Throws:

CoordinatorEngineException

ignore

public CoordinatorActionInfo ignore(java.lang.String jobId,
                           java.lang.String type,
                           java.lang.String scope)
                             throws CoordinatorEngineException

Throws:

CoordinatorEngineException

reRun

@Deprecated
public void reRun(java.lang.String jobId,
                    org.apache.hadoop.conf.Configuration conf)
           throws BaseEngineException

Deprecated.

Description copied from class: BaseEngine

Rerun a job.

Specified by:

reRun in class BaseEngine

Parameters:

jobId - job Id to rerun.

conf - configuration information for the rerun.

Throws:

BaseEngineException - thrown if the job could not be rerun.

reRun

public CoordinatorActionInfo reRun(java.lang.String jobId,
                          java.lang.String rerunType,
                          java.lang.String scope,
                          boolean refresh,
                          boolean noCleanup,
                          boolean failed)
                            throws BaseEngineException

Rerun coordinator actions for given rerunType

Parameters:

jobId -

rerunType -

scope -

refresh -

noCleanup -

Throws:

BaseEngineException

resume

public void resume(java.lang.String jobId)
            throws CoordinatorEngineException

Description copied from class: BaseEngine

Resume a job.

Specified by:

resume in class BaseEngine

Parameters:

jobId - job Id.

Throws:

CoordinatorEngineException

start

@Deprecated
public void start(java.lang.String jobId)
           throws BaseEngineException

Deprecated.

Description copied from class: BaseEngine

Start a job.

Specified by:

start in class BaseEngine

Parameters:

jobId - job Id.

Throws:

BaseEngineException - thrown if the job could not be started.

streamLog

public void streamLog(java.lang.String jobId,
             java.io.Writer writer,
             java.util.Map<java.lang.String,java.lang.String[]> params)
               throws java.io.IOException,
                      BaseEngineException

Description copied from class: BaseEngine

Stream the log of a job.

Specified by:

streamLog in class BaseEngine

Parameters:

jobId - job Id.

writer - writer to stream the log to.

params - additional parameters from the request

Throws:

java.io.IOException - thrown if the log cannot be streamed.

BaseEngineException - thrown if there is error in getting the Workflow/Coordinator Job Information for jobId.

streamLog

public void streamLog(java.lang.String jobId,
             java.lang.String logRetrievalScope,
             java.lang.String logRetrievalType,
             java.io.Writer writer,
             java.util.Map<java.lang.String,java.lang.String[]> params)
               throws java.io.IOException,
                      BaseEngineException,
                      CommandException

Add list of actions to the filter based on conditions

Parameters:

jobId - Job Id

logRetrievalScope - Value for the retrieval type

logRetrievalType - Based on which filter criteria the log is retrieved

writer - writer to stream the log to

params - additional parameters from the request

Throws:

java.io.IOException

BaseEngineException

CommandException

submitJob

public java.lang.String submitJob(org.apache.hadoop.conf.Configuration conf,
                         boolean startJob)
                           throws CoordinatorEngineException

Description copied from class: BaseEngine

Submit a job.

It validates configuration properties.

Specified by:

submitJob in class BaseEngine

Parameters:

conf - job configuration.

startJob - indicates if the job should be started or not.

Returns:

the job Id.

Throws:

CoordinatorEngineException

dryRunSubmit

public java.lang.String dryRunSubmit(org.apache.hadoop.conf.Configuration conf)
                              throws CoordinatorEngineException

Description copied from class: BaseEngine

Dry run a job; like {@link BaseEngine#submitJob(org.apache.hadoop.conf.Configuration, boolean) but doesn't actually execute the job.

It validates configuration properties.

Specified by:

dryRunSubmit in class BaseEngine

Parameters:

conf - job configuration.

Returns:

the result of the dryrun

Throws:

CoordinatorEngineException

suspend

public void suspend(java.lang.String jobId)
             throws CoordinatorEngineException

Description copied from class: BaseEngine

Suspend a job.

Specified by:

suspend in class BaseEngine

Parameters:

jobId - job Id.

Throws:

CoordinatorEngineException

getJob

public org.apache.oozie.client.WorkflowJob getJob(java.lang.String jobId)
                                           throws BaseEngineException

Description copied from class: BaseEngine

Return the info about a wf job.

Specified by:

getJob in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the workflow job info.

Throws:

DagEngineException - thrown if the job info could not be obtained.

BaseEngineException

getJob

public org.apache.oozie.client.WorkflowJob getJob(java.lang.String jobId,
                                         int start,
                                         int length)
                                           throws BaseEngineException

Description copied from class: BaseEngine

Return the info about a wf job with actions subset.

Specified by:

getJob in class BaseEngine

Parameters:

jobId - job Id

start - starting from this index in the list of actions belonging to the job

length - number of actions to be returned

Returns:

the workflow job info.

Throws:

DagEngineException - thrown if the job info could not be obtained.

BaseEngineException

getCoordJobs

public CoordinatorJobInfo getCoordJobs(java.lang.String filter,
                              int start,
                              int len)
                                throws CoordinatorEngineException

Parameters:

filter -

start -

len -

Returns:

CoordinatorJobInfo

Throws:

CoordinatorEngineException

parseJobFilter

public java.util.Map<Pair<java.lang.String,CoordinatorEngine.FILTER_COMPARATORS>,java.util.List<java.lang.Object>> parseJobFilter(java.lang.String filter)
                                                                                                                           throws CoordinatorEngineException

Throws:

CoordinatorEngineException

getReruns

public java.util.List<WorkflowJobBean> getReruns(java.lang.String coordActionId)
                                          throws CoordinatorEngineException

Throws:

CoordinatorEngineException

updateJob

public java.lang.String updateJob(org.apache.hadoop.conf.Configuration conf,
                         java.lang.String jobId,
                         boolean dryrun,
                         boolean showDiff)
                           throws CoordinatorEngineException

Update coord job definition.

Parameters:

conf - the conf

jobId - the job id

dryrun - the dryrun

showDiff - the show diff

Returns:

the string

Throws:

CoordinatorEngineException - the coordinator engine exception

getJobStatus

public java.lang.String getJobStatus(java.lang.String jobId)
                              throws CoordinatorEngineException

Return the status for a Job ID

Specified by:

getJobStatus in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the job's status

Throws:

CoordinatorEngineException - thrown if the job's status could not be obtained

getActionStatus

public java.lang.String getActionStatus(java.lang.String actionId)
                                 throws CoordinatorEngineException

Return the status for an Action ID

Parameters:

actionId - action Id.

Returns:

the action's status

Throws:

CoordinatorEngineException - thrown if the action's status could not be obtained

killJobs

public CoordinatorJobInfo killJobs(java.lang.String filter,
                          int start,
                          int length)
                            throws CoordinatorEngineException

return a list of killed Coordinator job

Parameters:

filter, - the filter string for which the coordinator jobs are killed

start, - the starting index for coordinator jobs

length, - maximum number of jobs to be killed

Returns:

the list of jobs being killed

Throws:

CoordinatorEngineException - thrown if one or more of the jobs cannot be killed

suspendJobs

public CoordinatorJobInfo suspendJobs(java.lang.String filter,
                             int start,
                             int length)
                               throws CoordinatorEngineException

return the jobs that've been suspended

Parameters:

filter - Filter for jobs that will be suspended, can be name, user, group, status, id or combination of any

start - Offset for the jobs that will be suspended

length - maximum number of jobs that will be suspended

Returns:

Throws:

CoordinatorEngineException

resumeJobs

public CoordinatorJobInfo resumeJobs(java.lang.String filter,
                            int start,
                            int length)
                              throws CoordinatorEngineException

return the jobs that've been resumed

Parameters:

filter - Filter for jobs that will be resumed, can be name, user, group, status, id or combination of any

start - Offset for the jobs that will be resumed

length - maximum number of jobs that will be resumed

Returns:

Throws:

CoordinatorEngineException