org.apache.oozie

Class BundleEngine

java.lang.Object

org.apache.oozie.BaseEngine

org.apache.oozie.BundleEngine

public class BundleEngine
extends BaseEngine

Field Summary

Fields inherited from class org.apache.oozie.BaseEngine

USE_XCOMMAND, user

Constructor Summary

Constructors

Constructor and Description
BundleEngine() Create a system Bundle engine, with no user and no group.
BundleEngine(String user) Create a Bundle engine to perform operations on behave of a user.

Method Summary

Modifier and Type	Method and Description
void	change(String jobId, String changeValue) Change a coordinator job.
void	changeSLA(String id, String actions, String dates, String childIds, String newParams) Change SLA properties for job
void	disableSLAAlert(String id, String actions, String dates, String childIds) Disable SLA alert for job
String	dryRunSubmit(org.apache.hadoop.conf.Configuration conf) Dry run a job; like BaseEngine.submitJob(org.apache.hadoop.conf.Configuration, boolean) but doesn't actually execute the job.
void	enableSLAAlert(String id, String actions, String dates, String childIds) Enable SLA alert for job
BulkResponseInfo	getBulkJobs(String bulkFilter, int start, int len) Get bulk job response
BundleJobBean	getBundleJob(String jobId)
BundleJobInfo	getBundleJobs(String filter, int start, int len) Get bundle jobs
CoordinatorJob	getCoordJob(String jobId) Return the info about a coord job.
CoordinatorJob	getCoordJob(String jobId, String filter, int start, int length, boolean desc) Return the info about a coord job with actions subset.
String	getDefinition(String jobId) Return the a job definition.
WorkflowJob	getJob(String jobId) Return the info about a wf job.
WorkflowJob	getJob(String jobId, int start, int length) Return the info about a wf job with actions subset.
String	getJobIdForExternalId(String externalId) Return the workflow Job ID for an external ID.
String	getJobStatus(String jobId) Return the status for a Job ID
void	kill(String jobId) Kill a job.
BundleJobInfo	killJobs(String filter, int start, int len) return a list of killed Bundle job
static Map<String,List<String>>	parseBulkFilter(String bulkParams) Parse filter string to a map with key = filter name and values = filter values Allowed keys are defined as constants on top
void	reRun(String jobId, org.apache.hadoop.conf.Configuration conf) Deprecated.
void	reRun(String jobId, String coordScope, String dateScope, boolean refresh, boolean noCleanup) Rerun Bundle actions for given rerunType
void	resume(String jobId) Resume a job.
BundleJobInfo	resumeJobs(String filter, int start, int len) return a list of resumed Bundle job
void	start(String jobId) Start a job.
protected void	streamJobLog(XLogStreamer logStreamer, String jobId, Writer writer) Stream job log.
String	submitJob(org.apache.hadoop.conf.Configuration conf, boolean startJob) Submit a job.
void	suspend(String jobId) Suspend a job.
BundleJobInfo	suspendJobs(String filter, int start, int len) return a list of suspended Bundle job

Methods inherited from class org.apache.oozie.BaseEngine

getJMSTopicName, getUser, streamAuditLog, streamErrorLog, streamLog

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BundleEngine

public BundleEngine()

Create a system Bundle engine, with no user and no group.

BundleEngine

public BundleEngine(String user)

Create a Bundle engine to perform operations on behave of a user.

Parameters:

user - user name.

Method Detail

change

public void change(String jobId,
                   String changeValue)
            throws BundleEngineException

Description copied from class: BaseEngine

Change a coordinator job.

Specified by:

change in class BaseEngine

Parameters:

jobId - job Id.

changeValue - change value.

Throws:

BundleEngineException

dryRunSubmit

public String dryRunSubmit(org.apache.hadoop.conf.Configuration conf)
                    throws BundleEngineException

Description copied from class: BaseEngine

Dry run a job; like BaseEngine.submitJob(org.apache.hadoop.conf.Configuration, boolean) but doesn't actually execute the job.

It validates configuration properties.

Specified by:

dryRunSubmit in class BaseEngine

Parameters:

conf - job configuration.

Returns:

the result of the dryrun

Throws:

BundleEngineException

getCoordJob

public CoordinatorJob getCoordJob(String jobId)
                           throws BundleEngineException

Description copied from class: BaseEngine

Return the info about a coord job.

Specified by:

getCoordJob in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the coord job info.

Throws:

BundleEngineException

getBundleJob

public BundleJobBean getBundleJob(String jobId)
                           throws BundleEngineException

Throws:

BundleEngineException

getCoordJob

public CoordinatorJob getCoordJob(String jobId,
                                  String filter,
                                  int start,
                                  int length,
                                  boolean desc)
                           throws BundleEngineException

Description copied from class: BaseEngine

Return the info about a coord job with actions subset.

Specified by:

getCoordJob in class BaseEngine

Parameters:

jobId - job Id.

filter - the status filter

start - starting from this index in the list of actions belonging to the job

length - number of actions to be returned

desc - true if actions are sorted in a descending order of nominal time, false if asc order

Returns:

the coord job info.

Throws:

BundleEngineException

getDefinition

public String getDefinition(String jobId)
                     throws BundleEngineException

Description copied from class: BaseEngine

Return the a job definition.

Specified by:

getDefinition in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the job definition.

Throws:

BundleEngineException

getJob

public WorkflowJob getJob(String jobId)
                   throws BundleEngineException

Description copied from class: BaseEngine

Return the info about a wf job.

Specified by:

getJob in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the workflow job info.

Throws:

BundleEngineException

getJob

public WorkflowJob getJob(String jobId,
                          int start,
                          int length)
                   throws BundleEngineException

Description copied from class: BaseEngine

Return the info about a wf job with actions subset.

Specified by:

getJob in class BaseEngine

Parameters:

jobId - job Id

start - starting from this index in the list of actions belonging to the job

length - number of actions to be returned

Returns:

the workflow job info.

Throws:

BundleEngineException

getJobIdForExternalId

public String getJobIdForExternalId(String externalId)
                             throws BundleEngineException

Description copied from class: BaseEngine

Return the workflow Job ID for an external ID.

This is reverse lookup for recovery purposes.

Specified by:

getJobIdForExternalId in class BaseEngine

Parameters:

externalId - external ID provided at job submission time.

Returns:

the associated workflow job ID if any, null if none.

Throws:

BundleEngineException

kill

public void kill(String jobId)
          throws BundleEngineException

Description copied from class: BaseEngine

Kill a job.

Specified by:

kill in class BaseEngine

Parameters:

jobId - job Id.

Throws:

BundleEngineException

reRun

@Deprecated
public void reRun(String jobId,
                              org.apache.hadoop.conf.Configuration conf)
                       throws BundleEngineException

Deprecated.

Description copied from class: BaseEngine

Rerun a job.

Specified by:

reRun in class BaseEngine

Parameters:

jobId - job Id to rerun.

conf - configuration information for the rerun.

Throws:

BundleEngineException

reRun

public void reRun(String jobId,
                  String coordScope,
                  String dateScope,
                  boolean refresh,
                  boolean noCleanup)
           throws BaseEngineException

Rerun Bundle actions for given rerunType

Parameters:

jobId - bundle job id

coordScope - the rerun scope for coordinator job names separated by ","

dateScope - the rerun scope for coordinator nominal times separated by ","

refresh - true if user wants to refresh input/outpur dataset urls

noCleanup - false if user wants to cleanup output events for given rerun actions

Throws:

BaseEngineException - thrown if failed to rerun

resume

public void resume(String jobId)
            throws BundleEngineException

Description copied from class: BaseEngine

Resume a job.

Specified by:

resume in class BaseEngine

Parameters:

jobId - job Id.

Throws:

BundleEngineException

start

public void start(String jobId)
           throws BundleEngineException

Description copied from class: BaseEngine

Start a job.

Specified by:

start in class BaseEngine

Parameters:

jobId - job Id.

Throws:

BundleEngineException

streamJobLog

protected void streamJobLog(XLogStreamer logStreamer,
                            String jobId,
                            Writer writer)
                     throws IOException,
                            BundleEngineException

Description copied from class: BaseEngine

Stream job log.

Specified by:

streamJobLog in class BaseEngine

Parameters:

logStreamer - the log streamer

jobId - the job id

writer - the writer

Throws:

IOException - Signals that an I/O exception has occurred.

BundleEngineException

submitJob

public String submitJob(org.apache.hadoop.conf.Configuration conf,
                        boolean startJob)
                 throws BundleEngineException

Description copied from class: BaseEngine

Submit a job.

It validates configuration properties.

Specified by:

submitJob in class BaseEngine

Parameters:

conf - job configuration.

startJob - indicates if the job should be started or not.

Returns:

the job Id.

Throws:

BundleEngineException

suspend

public void suspend(String jobId)
             throws BundleEngineException

Description copied from class: BaseEngine

Suspend a job.

Specified by:

suspend in class BaseEngine

Parameters:

jobId - job Id.

Throws:

BundleEngineException

getBundleJobs

public BundleJobInfo getBundleJobs(String filter,
                                   int start,
                                   int len)
                            throws BundleEngineException

Get bundle jobs

Parameters:

filter - the filter string

start - start location for paging

len - total length to get

Returns:

bundle job info

Throws:

BundleEngineException - thrown if failed to get bundle job info

getBulkJobs

public BulkResponseInfo getBulkJobs(String bulkFilter,
                                    int start,
                                    int len)
                             throws BundleEngineException

Get bulk job response

Parameters:

bulkFilter - the filter string

start - start location for paging

len - total length to get

Returns:

bulk job info

Throws:

BundleEngineException - thrown if failed to get bulk job info

parseBulkFilter

public static Map<String,List<String>> parseBulkFilter(String bulkParams)
                                                throws BundleEngineException

Parse filter string to a map with key = filter name and values = filter values Allowed keys are defined as constants on top

Parameters:

bulkParams - the filter string

Returns:

filter key-value pair map

Throws:

BundleEngineException - thrown if failed to parse filter string

getJobStatus

public String getJobStatus(String jobId)
                    throws BundleEngineException

Return the status for a Job ID

Specified by:

getJobStatus in class BaseEngine

Parameters:

jobId - job Id.

Returns:

the job's status

Throws:

BundleEngineException - thrown if the job's status could not be obtained

enableSLAAlert

public void enableSLAAlert(String id,
                           String actions,
                           String dates,
                           String childIds)
                    throws BaseEngineException

Description copied from class: BaseEngine

Enable SLA alert for job

Specified by:

enableSLAAlert in class BaseEngine

Parameters:

id - job ID

actions - list of actions

dates - dates

childIds - child IDs

Throws:

BaseEngineException - thrown if SLA alert could not be enabled

disableSLAAlert

public void disableSLAAlert(String id,
                            String actions,
                            String dates,
                            String childIds)
                     throws BaseEngineException

Description copied from class: BaseEngine

Disable SLA alert for job

Specified by:

disableSLAAlert in class BaseEngine

Parameters:

id - job ID

actions - list of actions

dates - dates

childIds - child IDs

Throws:

BaseEngineException - thrown if SLA alert could not be disabled

changeSLA

public void changeSLA(String id,
                      String actions,
                      String dates,
                      String childIds,
                      String newParams)
               throws BaseEngineException

Description copied from class: BaseEngine

Change SLA properties for job

Specified by:

changeSLA in class BaseEngine

Parameters:

id - job ID

actions - list of actions

dates - dates

childIds - child IDs

newParams - parameters to

Throws:

BaseEngineException - thrown if SLA alert could not be enabled

killJobs

public BundleJobInfo killJobs(String filter,
                              int start,
                              int len)
                       throws BundleEngineException

return a list of killed Bundle job

Parameters:

filter - the filter string for which the bundle jobs are killed

start - the starting index for bundle jobs

len - maximum number of jobs to be killed

Returns:

the list of jobs being killed

Throws:

BundleEngineException - thrown if one or more of the jobs cannot be killed

suspendJobs

public BundleJobInfo suspendJobs(String filter,
                                 int start,
                                 int len)
                          throws BundleEngineException

return a list of suspended Bundle job

Parameters:

filter - the filter string for which the bundle jobs are suspended

start - the starting index for bundle jobs

len - maximum number of jobs to be suspended

Returns:

the list of jobs being suspended

Throws:

BundleEngineException - thrown if one or more of the jobs cannot be suspended

resumeJobs

public BundleJobInfo resumeJobs(String filter,
                                int start,
                                int len)
                         throws BundleEngineException

return a list of resumed Bundle job

Parameters:

filter - the filter string for which the bundle jobs are resumed

start - the starting index for bundle jobs

len - maximum number of jobs to be resumed

Returns:

the list of jobs being resumed

Throws:

BundleEngineException - thrown if one or more of the jobs cannot be resumed