org.apache.oozie.action.hadoop

Class SqoopActionExecutor

java.lang.Object

org.apache.oozie.action.ActionExecutor

org.apache.oozie.action.hadoop.JavaActionExecutor

org.apache.oozie.action.hadoop.SqoopActionExecutor

public class SqoopActionExecutor
extends JavaActionExecutor

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.oozie.action.ActionExecutor

ActionExecutor.Context

Field Summary

Fields

Modifier and Type	Field and Description
static String	OOZIE_ACTION_EXTERNAL_STATS_WRITE

Fields inherited from class org.apache.oozie.action.hadoop.JavaActionExecutor

ACL_MODIFY_JOB, ACL_VIEW_JOB, HADOOP_CHILD_JAVA_ENV, HADOOP_CHILD_JAVA_OPTS, HADOOP_JOB_TRACKER, HADOOP_JOB_TRACKER_2, HADOOP_MAP_JAVA_ENV, HADOOP_MAP_JAVA_OPTS, HADOOP_MAP_MEMORY_MB, HADOOP_NAME_NODE, HADOOP_YARN_RM, HADOOP_YARN_UBER_MODE, LOG, MAX_EXTERNAL_STATS_SIZE, MAX_EXTERNAL_STATS_SIZE_DEFAULT, OOZIE_COMMON_LIBDIR, YARN_AM_COMMAND_OPTS, YARN_AM_ENV, YARN_AM_RESOURCE_MB, YARN_MEMORY_MB_MIN

Fields inherited from class org.apache.oozie.action.ActionExecutor

CONF_PREFIX, ERROR_OTHER, MAX_RETRIES, requiresNNJT, RETRY_INTERVAL

Constructor Summary

Constructors

Constructor and Description
SqoopActionExecutor()

Method Summary

Methods

Modifier and Type	Method and Description
void	end(ActionExecutor.Context context, org.apache.oozie.client.WorkflowAction action) We will gather counters from all executed action Hadoop jobs (e.g.
protected void	getActionData(org.apache.hadoop.fs.FileSystem actionFs, org.apache.hadoop.mapred.RunningJob runningJob, org.apache.oozie.client.WorkflowAction action, ActionExecutor.Context context) Get the stats and external child IDs
protected boolean	getCaptureOutput(org.apache.oozie.client.WorkflowAction action)
protected String	getDefaultShareLibName(org.jdom.Element actionXml) Return the sharelib name for the action.
List<Class>	getLauncherClasses()
protected String	getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf, org.jdom.Element actionXml)

Methods inherited from class org.apache.oozie.action.hadoop.JavaActionExecutor

addActionLibs, addShareLib, addSystemShareLibForAction, check, createBaseHadoopConf, createJobClient, extractHeapSizeMB, getActionCredentialsProperties, getCommonLauncherClasses, getCredProperties, getMaxExternalStatsSize, getRunningJob, getShareLibNames, initActionType, isCompleted, kill, parseJobXmlAndConfiguration, prepareActionDir, setActionCompletionData, setCredentialPropertyToActionConf, setCredentialTokens, setLibFilesArchives, start, submitLauncher

Methods inherited from class org.apache.oozie.action.ActionExecutor

convertException, disableInit, enableInit, getActionDir, getActionDirPath, getActionSignal, getMaxRetries, getOozieConf, getOozieRuntimeDir, getOozieSystemId, getRetryInterval, getType, registerError, resetInitInfo, setMaxRetries, setRetryInterval

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OOZIE_ACTION_EXTERNAL_STATS_WRITE

public static final String OOZIE_ACTION_EXTERNAL_STATS_WRITE

See Also:

Constant Field Values

Constructor Detail

SqoopActionExecutor

public SqoopActionExecutor()

Method Detail

getLauncherClasses

public List<Class> getLauncherClasses()

Overrides:

getLauncherClasses in class JavaActionExecutor

getLauncherMain

protected String getLauncherMain(org.apache.hadoop.conf.Configuration launcherConf,
                     org.jdom.Element actionXml)

Overrides:

getLauncherMain in class JavaActionExecutor

end

public void end(ActionExecutor.Context context,
       org.apache.oozie.client.WorkflowAction action)
         throws ActionExecutorException

We will gather counters from all executed action Hadoop jobs (e.g. jobs that moved data, not the launcher itself) and merge them together. There will be only one job most of the time. The only exception is import-all-table option that will execute one job per one exported table.

Overrides:

end in class JavaActionExecutor

Parameters:

context - Action context

action - Workflow action

Throws:

ActionExecutorException

getActionData

protected void getActionData(org.apache.hadoop.fs.FileSystem actionFs,
                 org.apache.hadoop.mapred.RunningJob runningJob,
                 org.apache.oozie.client.WorkflowAction action,
                 ActionExecutor.Context context)
                      throws HadoopAccessorException,
                             org.jdom.JDOMException,
                             IOException,
                             URISyntaxException

Get the stats and external child IDs

Overrides:

getActionData in class JavaActionExecutor

Parameters:

actionFs - the FileSystem object

runningJob - the runningJob

action - the Workflow action

context - executor context

Throws:

HadoopAccessorException

org.jdom.JDOMException

IOException

URISyntaxException

getCaptureOutput

protected boolean getCaptureOutput(org.apache.oozie.client.WorkflowAction action)
                            throws org.jdom.JDOMException

Overrides:

getCaptureOutput in class JavaActionExecutor

Throws:

org.jdom.JDOMException

getDefaultShareLibName

protected String getDefaultShareLibName(org.jdom.Element actionXml)

Return the sharelib name for the action.

Overrides:

getDefaultShareLibName in class JavaActionExecutor

Parameters:

actionXml -

Returns:

returns sqoop.