org.apache.oozie.action.hadoop

Class MapReduceActionExecutor

java.lang.Object

org.apache.oozie.action.ActionExecutor

org.apache.oozie.action.hadoop.JavaActionExecutor

org.apache.oozie.action.hadoop.MapReduceActionExecutor

public class MapReduceActionExecutor
extends JavaActionExecutor

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.oozie.action.ActionExecutor

ActionExecutor.Context, ActionExecutor.RETRYPOLICY

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	HADOOP_COUNTERS
static java.lang.String	OOZIE_ACTION_EXTERNAL_STATS_WRITE
static java.lang.String	OOZIE_MAPREDUCE_UBER_JAR_ENABLE

Fields inherited from class org.apache.oozie.action.hadoop.JavaActionExecutor

ACL_MODIFY_JOB, ACL_VIEW_JOB, CONF_HADOOP_YARN_UBER_MODE, HADOOP_CHILD_JAVA_ENV, HADOOP_CHILD_JAVA_OPTS, HADOOP_JOB_CLASSLOADER, HADOOP_JOB_TRACKER, HADOOP_JOB_TRACKER_2, HADOOP_MAP_JAVA_ENV, HADOOP_MAP_JAVA_OPTS, HADOOP_MAP_MEMORY_MB, HADOOP_NAME_NODE, HADOOP_REDUCE_JAVA_OPTS, HADOOP_USER, HADOOP_USER_CLASSPATH_FIRST, HADOOP_YARN_KILL_CHILD_JOBS_ON_AMRESTART, HADOOP_YARN_RM, HADOOP_YARN_UBER_MODE, LOG, MAX_EXTERNAL_STATS_SIZE, MR_JOB_USER_NAME, OOZIE_ACTION_LAUNCHER_PREFIX, OOZIE_COMMON_LIBDIR, OOZIE_CREDENTIALS_SKIP, workflowConf, YARN_AM_COMMAND_OPTS, YARN_AM_ENV, YARN_AM_RESOURCE_MB, YARN_MEMORY_MB_MIN

Fields inherited from class org.apache.oozie.action.ActionExecutor

ACTION_RETRY_INTERVAL, ACTION_RETRY_POLICY, CONF_PREFIX, ERROR_OTHER, MAX_RETRIES, OOZIE_ACTION_YARN_TAG, RETRY_INTERVAL

Constructor Summary

Constructors

Constructor and Description
MapReduceActionExecutor()

Method Summary

Methods

Modifier and Type	Method and Description
void	end(ActionExecutor.Context context, org.apache.oozie.client.WorkflowAction action) End an action after it has executed.
protected java.lang.String	getActualExternalId(org.apache.oozie.client.WorkflowAction action) Useful for overriding in actions that do subsequent job runs such as the MapReduce Action, where the launcher job is not the actual job that then gets monitored.
protected java.lang.String	getDefaultShareLibName(org.jdom.Element actionXml) Return the sharelib name for the action.
java.util.List<java.lang.Class>	getLauncherClasses()
protected java.lang.String	getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf, org.jdom.Element actionXml)
protected org.apache.hadoop.mapred.RunningJob	getRunningJob(ActionExecutor.Context context, org.apache.oozie.client.WorkflowAction action, org.apache.hadoop.mapred.JobClient jobClient)
static void	setStreaming(org.apache.hadoop.conf.Configuration conf, java.lang.String mapper, java.lang.String reducer, java.lang.String recordReader, java.lang.String[] recordReaderMapping, java.lang.String[] env)

Methods inherited from class org.apache.oozie.action.hadoop.JavaActionExecutor

addActionLibs, addShareLib, addSystemShareLibForAction, check, createBaseHadoopConf, createJobClient, extractHeapSizeMB, getActionCredentialsProperties, getActionData, getCaptureOutput, getCommonLauncherClasses, getCredProperties, getMaxExternalStatsSize, getMaxOutputData, getShareLibFilesForActionConf, getShareLibNames, getTrimmedEncodedPath, initActionType, isCompleted, kill, parseJobXmlAndConfiguration, parseJobXmlAndConfiguration, prepareActionDir, requiresNameNodeJobTracker, setActionCompletionData, setCredentialPropertyToActionConf, setCredentialTokens, setLibFilesArchives, start, submitLauncher, supportsConfigurationJobXML

Methods inherited from class org.apache.oozie.action.ActionExecutor

convertException, disableInit, enableInit, getActionDir, getActionDirPath, getActionSignal, getActionYarnTag, getMaxRetries, getOozieConf, getOozieRuntimeDir, getOozieSystemId, getRetryInterval, getRetryPolicy, getType, registerError, resetInitInfo, setMaxRetries, setRetryInterval, setRetryPolicy

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OOZIE_ACTION_EXTERNAL_STATS_WRITE

public static final java.lang.String OOZIE_ACTION_EXTERNAL_STATS_WRITE

See Also:

Constant Field Values

HADOOP_COUNTERS

public static final java.lang.String HADOOP_COUNTERS

See Also:

Constant Field Values

OOZIE_MAPREDUCE_UBER_JAR_ENABLE

public static final java.lang.String OOZIE_MAPREDUCE_UBER_JAR_ENABLE

See Also:

Constant Field Values

Constructor Detail

MapReduceActionExecutor

public MapReduceActionExecutor()

Method Detail

getLauncherClasses

public java.util.List<java.lang.Class> getLauncherClasses()

Overrides:

getLauncherClasses in class JavaActionExecutor

getActualExternalId

protected java.lang.String getActualExternalId(org.apache.oozie.client.WorkflowAction action)

Description copied from class: JavaActionExecutor

Useful for overriding in actions that do subsequent job runs such as the MapReduce Action, where the launcher job is not the actual job that then gets monitored.

Overrides:

getActualExternalId in class JavaActionExecutor

getLauncherMain

protected java.lang.String getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf,
                               org.jdom.Element actionXml)

Overrides:

getLauncherMain in class JavaActionExecutor

end

public void end(ActionExecutor.Context context,
       org.apache.oozie.client.WorkflowAction action)
         throws ActionExecutorException

Description copied from class: ActionExecutor

End an action after it has executed.

The ActionExecutor.Context.setEndData(org.apache.oozie.client.WorkflowAction.Status, java.lang.String) method must be called within this method.

Overrides:

end in class JavaActionExecutor

Parameters:

context - executor context.

action - the action to end.

Throws:

ActionExecutorException - thrown if the action could not end.

getDefaultShareLibName

protected java.lang.String getDefaultShareLibName(org.jdom.Element actionXml)

Return the sharelib name for the action.

Overrides:

getDefaultShareLibName in class JavaActionExecutor

Parameters:

actionXml -

Returns:

returns streaming if mapreduce-streaming action, NULL otherwise.

setStreaming

public static void setStreaming(org.apache.hadoop.conf.Configuration conf,
                java.lang.String mapper,
                java.lang.String reducer,
                java.lang.String recordReader,
                java.lang.String[] recordReaderMapping,
                java.lang.String[] env)

getRunningJob

protected org.apache.hadoop.mapred.RunningJob getRunningJob(ActionExecutor.Context context,
                                                org.apache.oozie.client.WorkflowAction action,
                                                org.apache.hadoop.mapred.JobClient jobClient)
                                                     throws java.lang.Exception

Overrides:

getRunningJob in class JavaActionExecutor

Throws:

java.lang.Exception