public class MapReduceActionExecutor extends JavaActionExecutor
ActionExecutor.Context, ActionExecutor.RETRYPOLICY
Modifier and Type | Field and Description |
---|---|
static String |
HADOOP_COUNTERS |
static String |
OOZIE_ACTION_EXTERNAL_STATS_WRITE |
static String |
OOZIE_MAPREDUCE_UBER_JAR_ENABLE |
ACL_MODIFY_JOB, ACL_VIEW_JOB, CONF_HADOOP_YARN_UBER_MODE, HADOOP_CHILD_JAVA_ENV, HADOOP_CHILD_JAVA_OPTS, HADOOP_JOB_CLASSLOADER, HADOOP_JOB_TRACKER, HADOOP_JOB_TRACKER_2, HADOOP_MAP_JAVA_ENV, HADOOP_MAP_JAVA_OPTS, HADOOP_MAP_MEMORY_MB, HADOOP_NAME_NODE, HADOOP_REDUCE_JAVA_OPTS, HADOOP_USER, HADOOP_USER_CLASSPATH_FIRST, HADOOP_YARN_KILL_CHILD_JOBS_ON_AMRESTART, HADOOP_YARN_RM, HADOOP_YARN_TIMELINE_SERVICE_ENABLED, HADOOP_YARN_UBER_MODE, LOG, MAX_EXTERNAL_STATS_SIZE, OOZIE_COMMON_LIBDIR, OOZIE_CREDENTIALS_SKIP, workflowConf, YARN_AM_COMMAND_OPTS, YARN_AM_ENV, YARN_AM_RESOURCE_MB, YARN_MEMORY_MB_MIN
ACTION_RETRY_INTERVAL, ACTION_RETRY_POLICY, CONF_PREFIX, ERROR_OTHER, MAX_RETRIES, OOZIE_ACTION_YARN_TAG, RETRY_INTERVAL
Constructor and Description |
---|
MapReduceActionExecutor() |
Modifier and Type | Method and Description |
---|---|
void |
end(ActionExecutor.Context context,
WorkflowAction action)
End an action after it has executed.
|
protected String |
getActualExternalId(WorkflowAction action)
Useful for overriding in actions that do subsequent job runs
such as the MapReduce Action, where the launcher job is not the
actual job that then gets monitored.
|
protected String |
getDefaultShareLibName(org.jdom.Element actionXml)
Return the sharelib name for the action.
|
List<Class> |
getLauncherClasses() |
protected String |
getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf,
org.jdom.Element actionXml) |
protected org.apache.hadoop.mapred.RunningJob |
getRunningJob(ActionExecutor.Context context,
WorkflowAction action,
org.apache.hadoop.mapred.JobClient jobClient) |
static void |
setStreaming(org.apache.hadoop.conf.Configuration conf,
String mapper,
String reducer,
String recordReader,
String[] recordReaderMapping,
String[] env) |
addActionLibs, addShareLib, addSystemShareLibForAction, check, createBaseHadoopConf, createBaseHadoopConf, createJobClient, extractHeapSizeMB, getActionCredentialsProperties, getActionData, getCaptureOutput, getCommonLauncherClasses, getCredProperties, getMaxExternalStatsSize, getShareLibFilesForActionConf, getShareLibNames, initActionType, injectCallback, isCompleted, kill, loadHadoopDefaultResources, parseJobXmlAndConfiguration, parseJobXmlAndConfiguration, prepareActionDir, requiresNameNodeJobTracker, setActionCompletionData, setCredentialPropertyToActionConf, setCredentialTokens, setLibFilesArchives, start, submitLauncher, supportsConfigurationJobXML
convertException, disableInit, enableInit, getActionDir, getActionDirPath, getActionSignal, getActionYarnTag, getMaxRetries, getOozieConf, getOozieRuntimeDir, getOozieSystemId, getRetryInterval, getRetryPolicy, getType, registerError, resetInitInfo, setMaxRetries, setRetryInterval, setRetryPolicy
public static final String OOZIE_ACTION_EXTERNAL_STATS_WRITE
public static final String HADOOP_COUNTERS
public static final String OOZIE_MAPREDUCE_UBER_JAR_ENABLE
public MapReduceActionExecutor()
public List<Class> getLauncherClasses()
getLauncherClasses
in class JavaActionExecutor
protected String getActualExternalId(WorkflowAction action)
JavaActionExecutor
getActualExternalId
in class JavaActionExecutor
protected String getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf, org.jdom.Element actionXml)
getLauncherMain
in class JavaActionExecutor
public void end(ActionExecutor.Context context, WorkflowAction action) throws ActionExecutorException
ActionExecutor
The ActionExecutor.Context.setEndData(org.apache.oozie.client.WorkflowAction.Status, java.lang.String)
method must be called within this
method.
end
in class JavaActionExecutor
context
- executor context.action
- the action to end.ActionExecutorException
- thrown if the action could not end.protected String getDefaultShareLibName(org.jdom.Element actionXml)
getDefaultShareLibName
in class JavaActionExecutor
actionXml
- streaming
if mapreduce-streaming action, NULL
otherwise.public static void setStreaming(org.apache.hadoop.conf.Configuration conf, String mapper, String reducer, String recordReader, String[] recordReaderMapping, String[] env)
protected org.apache.hadoop.mapred.RunningJob getRunningJob(ActionExecutor.Context context, WorkflowAction action, org.apache.hadoop.mapred.JobClient jobClient) throws Exception
getRunningJob
in class JavaActionExecutor
Exception
Copyright © 2018 Apache Software Foundation. All rights reserved.