org.apache.oozie.action.hadoop

Class SqoopActionExecutor

java.lang.Object

org.apache.oozie.action.ActionExecutor

org.apache.oozie.action.hadoop.JavaActionExecutor

org.apache.oozie.action.hadoop.SqoopActionExecutor

public class SqoopActionExecutor
extends JavaActionExecutor

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.oozie.action.ActionExecutor

ActionExecutor.Context, ActionExecutor.RETRYPOLICY

Field Summary

Fields

Modifier and Type	Field and Description
static String	OOZIE_ACTION_EXTERNAL_STATS_WRITE

Fields inherited from class org.apache.oozie.action.hadoop.JavaActionExecutor

ACL_MODIFY_JOB, ACL_VIEW_JOB, CONF_HADOOP_YARN_UBER_MODE, HADOOP_CHILD_JAVA_ENV, HADOOP_CHILD_JAVA_OPTS, HADOOP_JOB_CLASSLOADER, HADOOP_JOB_TRACKER, HADOOP_JOB_TRACKER_2, HADOOP_MAP_JAVA_ENV, HADOOP_MAP_JAVA_OPTS, HADOOP_MAP_MEMORY_MB, HADOOP_NAME_NODE, HADOOP_REDUCE_JAVA_OPTS, HADOOP_USER, HADOOP_USER_CLASSPATH_FIRST, HADOOP_YARN_KILL_CHILD_JOBS_ON_AMRESTART, HADOOP_YARN_RM, HADOOP_YARN_TIMELINE_SERVICE_ENABLED, HADOOP_YARN_UBER_MODE, LOG, MAX_EXTERNAL_STATS_SIZE, OOZIE_COMMON_LIBDIR, OOZIE_CREDENTIALS_SKIP, workflowConf, YARN_AM_COMMAND_OPTS, YARN_AM_ENV, YARN_AM_RESOURCE_MB, YARN_MEMORY_MB_MIN

Fields inherited from class org.apache.oozie.action.ActionExecutor

ACTION_RETRY_INTERVAL, ACTION_RETRY_POLICY, CONF_PREFIX, ERROR_OTHER, MAX_RETRIES, OOZIE_ACTION_YARN_TAG, RETRY_INTERVAL

Constructor Summary

Constructors

Constructor and Description
SqoopActionExecutor()

Method Summary

Methods

Modifier and Type	Method and Description
void	end(ActionExecutor.Context context, WorkflowAction action) We will gather counters from all executed action Hadoop jobs (e.g.
protected String	getDefaultShareLibName(org.jdom.Element actionXml) Return the sharelib name for the action.
List<Class>	getLauncherClasses()
protected String	getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf, org.jdom.Element actionXml)

Methods inherited from class org.apache.oozie.action.hadoop.JavaActionExecutor

addActionLibs, addShareLib, addSystemShareLibForAction, check, createBaseHadoopConf, createBaseHadoopConf, createJobClient, extractHeapSizeMB, getActionCredentialsProperties, getActionData, getActualExternalId, getCaptureOutput, getCommonLauncherClasses, getCredProperties, getMaxExternalStatsSize, getRunningJob, getShareLibFilesForActionConf, getShareLibNames, initActionType, injectCallback, isCompleted, kill, loadHadoopDefaultResources, parseJobXmlAndConfiguration, parseJobXmlAndConfiguration, prepareActionDir, requiresNameNodeJobTracker, setActionCompletionData, setCredentialPropertyToActionConf, setCredentialTokens, setLibFilesArchives, start, submitLauncher, supportsConfigurationJobXML

Methods inherited from class org.apache.oozie.action.ActionExecutor

convertException, disableInit, enableInit, getActionDir, getActionDirPath, getActionSignal, getActionYarnTag, getMaxRetries, getOozieConf, getOozieRuntimeDir, getOozieSystemId, getRetryInterval, getRetryPolicy, getType, registerError, resetInitInfo, setMaxRetries, setRetryInterval, setRetryPolicy

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OOZIE_ACTION_EXTERNAL_STATS_WRITE

public static final String OOZIE_ACTION_EXTERNAL_STATS_WRITE

See Also:

Constant Field Values

Constructor Detail

SqoopActionExecutor

public SqoopActionExecutor()

Method Detail

getLauncherClasses

public List<Class> getLauncherClasses()

Overrides:

getLauncherClasses in class JavaActionExecutor

getLauncherMain

protected String getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf,
                     org.jdom.Element actionXml)

Overrides:

getLauncherMain in class JavaActionExecutor

end

public void end(ActionExecutor.Context context,
       WorkflowAction action)
         throws ActionExecutorException

We will gather counters from all executed action Hadoop jobs (e.g. jobs that moved data, not the launcher itself) and merge them together. There will be only one job most of the time. The only exception is import-all-table option that will execute one job per one exported table.

Overrides:

end in class JavaActionExecutor

Parameters:

context - Action context

action - Workflow action

Throws:

ActionExecutorException

getDefaultShareLibName

protected String getDefaultShareLibName(org.jdom.Element actionXml)

Return the sharelib name for the action.

Overrides:

getDefaultShareLibName in class JavaActionExecutor

Parameters:

actionXml -

Returns:

returns sqoop.