oozie.output.compression.codec
gz
The name of the compression codec to use.
The implementation class for the codec needs to be specified through another property oozie.compression.codecs.
You can specify a comma separated list of 'Codec_name'='Codec_class' for oozie.compression.codecs
where codec class implements the interface org.apache.oozie.compression.CompressionCodec.
If oozie.compression.codecs is not specified, gz codec implementation is used by default.
oozie.action.mapreduce.uber.jar.enable
false
If true, enables the oozie.mapreduce.uber.jar mapreduce workflow configuration property, which is used to specify an
uber jar in HDFS. Submitting a workflow with an uber jar requires at least Hadoop 2.2.0 or 1.2.0. If false, workflows
which specify the oozie.mapreduce.uber.jar configuration property will fail.
oozie.processing.timezone
UTC
Oozie server timezone. Valid values are UTC and GMT(+/-)####, for example 'GMT+0530' would be India
timezone. All dates parsed and genered dates by Oozie Coordinator/Bundle will be done in the specified
timezone. The default value of 'UTC' should not be changed under normal circumtances. If for any reason
is changed, note that GMT(+/-)#### timezones do not observe DST changes.
oozie.base.url
http://localhost:8080/oozie
Base Oozie URL.
oozie.system.id
oozie-${user.name}
The Oozie system ID.
oozie.systemmode
NORMAL
System mode for Oozie at startup.
oozie.delete.runtime.dir.on.shutdown
true
If the runtime directory should be kept after Oozie shutdowns down.
oozie.services
org.apache.oozie.service.SchedulerService,
org.apache.oozie.service.InstrumentationService,
org.apache.oozie.service.MemoryLocksService,
org.apache.oozie.service.UUIDService,
org.apache.oozie.service.ELService,
org.apache.oozie.service.AuthorizationService,
org.apache.oozie.service.UserGroupInformationService,
org.apache.oozie.service.HadoopAccessorService,
org.apache.oozie.service.JobsConcurrencyService,
org.apache.oozie.service.URIHandlerService,
org.apache.oozie.service.DagXLogInfoService,
org.apache.oozie.service.SchemaService,
org.apache.oozie.service.LiteWorkflowAppService,
org.apache.oozie.service.JPAService,
org.apache.oozie.service.StoreService,
org.apache.oozie.service.SLAStoreService,
org.apache.oozie.service.DBLiteWorkflowStoreService,
org.apache.oozie.service.CallbackService,
org.apache.oozie.service.ActionService,
org.apache.oozie.service.ShareLibService,
org.apache.oozie.service.CallableQueueService,
org.apache.oozie.service.ActionCheckerService,
org.apache.oozie.service.RecoveryService,
org.apache.oozie.service.PurgeService,
org.apache.oozie.service.CoordinatorEngineService,
org.apache.oozie.service.BundleEngineService,
org.apache.oozie.service.DagEngineService,
org.apache.oozie.service.CoordMaterializeTriggerService,
org.apache.oozie.service.StatusTransitService,
org.apache.oozie.service.PauseTransitService,
org.apache.oozie.service.GroupsService,
org.apache.oozie.service.ProxyUserService,
org.apache.oozie.service.XLogStreamingService,
org.apache.oozie.service.JvmPauseMonitorService,
org.apache.oozie.service.SparkConfigurationService
All services to be created and managed by Oozie Services singleton.
Class names must be separated by commas.
oozie.services.ext
To add/replace services defined in 'oozie.services' with custom implementations.
Class names must be separated by commas.
oozie.service.XLogStreamingService.buffer.len
4096
4K buffer for streaming the logs progressively
oozie.service.HCatAccessorService.jmsconnections
default=java.naming.factory.initial#org.apache.activemq.jndi.ActiveMQInitialContextFactory;java.naming.provider.url#tcp://localhost:61616;connectionFactoryNames#ConnectionFactory
Specify the map of endpoints to JMS configuration properties. In general, endpoint
identifies the HCatalog server URL. "default" is used if no endpoint is mentioned
in the query. If some JMS property is not defined, the system will use the property
defined jndi.properties. jndi.properties files is retrieved from the application classpath.
Mapping rules can also be provided for mapping Hcatalog servers to corresponding JMS providers.
hcat://${1}.${2}.server.com:8020=java.naming.factory.initial#Dummy.Factory;java.naming.provider.url#tcp://broker.${2}:61616
oozie.service.JMSTopicService.topic.name
default=${username}
Topic options are ${username} or ${jobId} or a fixed string which can be specified as default or for a
particular job type.
For e.g To have a fixed string topic for workflows, coordinators and bundles,
specify in the following comma-separated format: {jobtype1}={some_string1}, {jobtype2}={some_string2}
where job type can be WORKFLOW, COORDINATOR or BUNDLE.
e.g. Following defines topic for workflow job, workflow action, coordinator job, coordinator action,
bundle job and bundle action
WORKFLOW=workflow,
COORDINATOR=coordinator,
BUNDLE=bundle
For jobs with no defined topic, default topic will be ${username}
oozie.jms.producer.connection.properties
java.naming.factory.initial#org.apache.activemq.jndi.ActiveMQInitialContextFactory;java.naming.provider.url#tcp://localhost:61616;connectionFactoryNames#ConnectionFactory
oozie.service.JMSAccessorService.connectioncontext.impl
org.apache.oozie.jms.DefaultConnectionContext
Specifies the Connection Context implementation
oozie.service.ConfigurationService.ignore.system.properties
oozie.service.AuthorizationService.security.enabled
Specifies "oozie.*" properties to cannot be overriden via Java system properties.
Property names must be separted by commas.
oozie.service.ConfigurationService.verify.available.properties
true
Specifies whether the available configurations check is enabled or not.
oozie.service.SchedulerService.threads
10
The number of threads to be used by the SchedulerService to run deamon tasks.
If maxed out, scheduled daemon tasks will be queued up and delayed until threads become available.
oozie.service.AuthorizationService.authorization.enabled
false
Specifies whether security (user name/admin role) is enabled or not.
If disabled any user can manage Oozie system and manage any job.
oozie.service.AuthorizationService.default.group.as.acl
false
Enables old behavior where the User's default group is the job's ACL.
oozie.service.InstrumentationService.logging.interval
60
Interval, in seconds, at which instrumentation should be logged by the InstrumentationService.
If set to 0 it will not log instrumentation data.
oozie.service.PurgeService.older.than
30
Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than
7
Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than
7
Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.action
false
Whether to purge completed workflows and their corresponding coordinator actions
of long running coordinator jobs if the completed workflow jobs are older than the value
specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit
100
Completed Actions purge - limit each purge to this value
oozie.service.PurgeService.purge.interval
3600
Interval at which the purge service will run, in seconds.
oozie.service.RecoveryService.wf.actions.older.than
120
Age of the actions which are eligible to be queued for recovery, in seconds.
oozie.service.RecoveryService.wf.actions.created.time.interval
7
Created time period of the actions which are eligible to be queued for recovery in days.
oozie.service.RecoveryService.callable.batch.size
10
This value determines the number of callable which will be batched together
to be executed by a single thread.
oozie.service.RecoveryService.push.dependency.interval
200
This value determines the delay for push missing dependency command queueing
in Recovery Service
oozie.service.RecoveryService.interval
60
Interval at which the RecoverService will run, in seconds.
oozie.service.RecoveryService.coord.older.than
600
Age of the Coordinator jobs or actions which are eligible to be queued for recovery, in seconds.
oozie.service.RecoveryService.bundle.older.than
600
Age of the Bundle jobs which are eligible to be queued for recovery, in seconds.
oozie.service.CallableQueueService.queue.size
10000
Max callable queue size
oozie.service.CallableQueueService.threads
10
Number of threads used for executing callables
oozie.service.CallableQueueService.callable.concurrency
3
Maximum concurrency for a given callable type.
Each command is a callable type (submit, start, run, signal, job, jobs, suspend,resume, etc).
Each action type is a callable type (Map-Reduce, Pig, SSH, FS, sub-workflow, etc).
All commands that use action executors (action-start, action-end, action-kill and action-check) use
the action type as the callable type.
oozie.service.CallableQueueService.callable.next.eligible
true
If true, when a callable in the queue has already reached max concurrency,
Oozie continuously find next one which has not yet reach max concurrency.
oozie.service.CallableQueueService.InterruptMapMaxSize
500
Maximum Size of the Interrupt Map, the interrupt element will not be inserted in the map if exceeded the size.
oozie.service.CallableQueueService.InterruptTypes
kill,resume,suspend,bundle_kill,bundle_resume,bundle_suspend,coord_kill,coord_change,coord_resume,coord_suspend
Getting the types of XCommands that are considered to be of Interrupt type
oozie.service.CoordMaterializeTriggerService.lookup.interval
300
Coordinator Job Lookup interval.(in seconds).
oozie.service.CoordMaterializeTriggerService.materialization.window
3600
Coordinator Job Lookup command materialized each
job for this next "window" duration
oozie.service.CoordMaterializeTriggerService.callable.batch.size
10
This value determines the number of callable which will be batched together
to be executed by a single thread.
oozie.service.CoordMaterializeTriggerService.materialization.system.limit
50
This value determines the number of coordinator jobs to be materialized at a given time.
oozie.service.coord.normal.default.timeout
120
Default timeout for a coordinator action input check (in minutes) for normal job.
-1 means infinite timeout
oozie.service.coord.default.max.timeout
86400
Default maximum timeout for a coordinator action input check (in minutes). 86400= 60days
oozie.service.coord.input.check.requeue.interval
60000
Command re-queue interval for coordinator data input check (in millisecond).
oozie.service.coord.push.check.requeue.interval
600000
Command re-queue interval for push dependencies (in millisecond).
oozie.service.coord.default.concurrency
1
Default concurrency for a coordinator job to determine how many maximum action should
be executed at the same time. -1 means infinite concurrency.
oozie.service.coord.default.throttle
12
Default throttle for a coordinator job to determine how many maximum action should
be in WAITING state at the same time.
oozie.service.coord.materialization.throttling.factor
0.05
Determine how many maximum actions should be in WAITING state for a single job at any time. The value is calculated by
this factor X the total queue size.
oozie.service.coord.check.maximum.frequency
true
When true, Oozie will reject any coordinators with a frequency faster than 5 minutes. It is not recommended to disable
this check or submit coordinators with frequencies faster than 5 minutes: doing so can cause unintended behavior and
additional system stress.
oozie.service.ELService.groups
job-submit,workflow,wf-sla-submit,coord-job-submit-freq,coord-job-submit-nofuncs,coord-job-submit-data,coord-job-submit-instances,coord-sla-submit,coord-action-create,coord-action-create-inst,coord-sla-create,coord-action-start,coord-job-wait-timeout
List of groups for different ELServices
oozie.service.ELService.constants.job-submit
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.functions.job-submit
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.constants.job-submit
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions without having to include all the built in ones.
oozie.service.ELService.ext.functions.job-submit
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions without having to include all the built in ones.
oozie.service.ELService.constants.workflow
KB=org.apache.oozie.util.ELConstantsFunctions#KB,
MB=org.apache.oozie.util.ELConstantsFunctions#MB,
GB=org.apache.oozie.util.ELConstantsFunctions#GB,
TB=org.apache.oozie.util.ELConstantsFunctions#TB,
PB=org.apache.oozie.util.ELConstantsFunctions#PB,
RECORDS=org.apache.oozie.action.hadoop.HadoopELFunctions#RECORDS,
MAP_IN=org.apache.oozie.action.hadoop.HadoopELFunctions#MAP_IN,
MAP_OUT=org.apache.oozie.action.hadoop.HadoopELFunctions#MAP_OUT,
REDUCE_IN=org.apache.oozie.action.hadoop.HadoopELFunctions#REDUCE_IN,
REDUCE_OUT=org.apache.oozie.action.hadoop.HadoopELFunctions#REDUCE_OUT,
GROUPS=org.apache.oozie.action.hadoop.HadoopELFunctions#GROUPS
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.workflow
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.workflow
firstNotNull=org.apache.oozie.util.ELConstantsFunctions#firstNotNull,
concat=org.apache.oozie.util.ELConstantsFunctions#concat,
replaceAll=org.apache.oozie.util.ELConstantsFunctions#replaceAll,
appendAll=org.apache.oozie.util.ELConstantsFunctions#appendAll,
trim=org.apache.oozie.util.ELConstantsFunctions#trim,
timestamp=org.apache.oozie.util.ELConstantsFunctions#timestamp,
urlEncode=org.apache.oozie.util.ELConstantsFunctions#urlEncode,
toJsonStr=org.apache.oozie.util.ELConstantsFunctions#toJsonStr,
toPropertiesStr=org.apache.oozie.util.ELConstantsFunctions#toPropertiesStr,
toConfigurationStr=org.apache.oozie.util.ELConstantsFunctions#toConfigurationStr,
wf:id=org.apache.oozie.DagELFunctions#wf_id,
wf:name=org.apache.oozie.DagELFunctions#wf_name,
wf:appPath=org.apache.oozie.DagELFunctions#wf_appPath,
wf:conf=org.apache.oozie.DagELFunctions#wf_conf,
wf:user=org.apache.oozie.DagELFunctions#wf_user,
wf:group=org.apache.oozie.DagELFunctions#wf_group,
wf:callback=org.apache.oozie.DagELFunctions#wf_callback,
wf:transition=org.apache.oozie.DagELFunctions#wf_transition,
wf:lastErrorNode=org.apache.oozie.DagELFunctions#wf_lastErrorNode,
wf:errorCode=org.apache.oozie.DagELFunctions#wf_errorCode,
wf:errorMessage=org.apache.oozie.DagELFunctions#wf_errorMessage,
wf:run=org.apache.oozie.DagELFunctions#wf_run,
wf:actionData=org.apache.oozie.DagELFunctions#wf_actionData,
wf:actionExternalId=org.apache.oozie.DagELFunctions#wf_actionExternalId,
wf:actionTrackerUri=org.apache.oozie.DagELFunctions#wf_actionTrackerUri,
wf:actionExternalStatus=org.apache.oozie.DagELFunctions#wf_actionExternalStatus,
hadoop:counters=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_counters,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf,
fs:exists=org.apache.oozie.action.hadoop.FsELFunctions#fs_exists,
fs:isDir=org.apache.oozie.action.hadoop.FsELFunctions#fs_isDir,
fs:dirSize=org.apache.oozie.action.hadoop.FsELFunctions#fs_dirSize,
fs:fileSize=org.apache.oozie.action.hadoop.FsELFunctions#fs_fileSize,
fs:blockSize=org.apache.oozie.action.hadoop.FsELFunctions#fs_blockSize,
hcat:exists=org.apache.oozie.coord.HCatELFunctions#hcat_exists
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.WorkflowAppService.WorkflowDefinitionMaxLength
100000
The maximum length of the workflow definition in bytes
An error will be reported if the length exceeds the given maximum
oozie.service.ELService.ext.functions.workflow
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.wf-sla-submit
MINUTES=org.apache.oozie.util.ELConstantsFunctions#SUBMIT_MINUTES,
HOURS=org.apache.oozie.util.ELConstantsFunctions#SUBMIT_HOURS,
DAYS=org.apache.oozie.util.ELConstantsFunctions#SUBMIT_DAYS
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.wf-sla-submit
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.wf-sla-submit
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.wf-sla-submit
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
l
oozie.service.ELService.constants.coord-job-submit-freq
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-job-submit-freq
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-job-submit-freq
coord:days=org.apache.oozie.coord.CoordELFunctions#ph1_coord_days,
coord:months=org.apache.oozie.coord.CoordELFunctions#ph1_coord_months,
coord:hours=org.apache.oozie.coord.CoordELFunctions#ph1_coord_hours,
coord:minutes=org.apache.oozie.coord.CoordELFunctions#ph1_coord_minutes,
coord:endOfDays=org.apache.oozie.coord.CoordELFunctions#ph1_coord_endOfDays,
coord:endOfMonths=org.apache.oozie.coord.CoordELFunctions#ph1_coord_endOfMonths,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-job-submit-freq
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-job-wait-timeout
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.constants.coord-job-wait-timeout
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions without having to include all the built in ones.
oozie.service.ELService.functions.coord-job-wait-timeout
coord:days=org.apache.oozie.coord.CoordELFunctions#ph1_coord_days,
coord:months=org.apache.oozie.coord.CoordELFunctions#ph1_coord_months,
coord:hours=org.apache.oozie.coord.CoordELFunctions#ph1_coord_hours,
coord:minutes=org.apache.oozie.coord.CoordELFunctions#ph1_coord_minutes,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-job-wait-timeout
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions without having to include all the built in ones.
oozie.service.ELService.constants.coord-job-submit-nofuncs
MINUTE=org.apache.oozie.coord.CoordELConstants#SUBMIT_MINUTE,
HOUR=org.apache.oozie.coord.CoordELConstants#SUBMIT_HOUR,
DAY=org.apache.oozie.coord.CoordELConstants#SUBMIT_DAY,
MONTH=org.apache.oozie.coord.CoordELConstants#SUBMIT_MONTH,
YEAR=org.apache.oozie.coord.CoordELConstants#SUBMIT_YEAR
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-job-submit-nofuncs
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-job-submit-nofuncs
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-job-submit-nofuncs
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-job-submit-instances
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-job-submit-instances
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-job-submit-instances
coord:hoursInDay=org.apache.oozie.coord.CoordELFunctions#ph1_coord_hoursInDay_echo,
coord:daysInMonth=org.apache.oozie.coord.CoordELFunctions#ph1_coord_daysInMonth_echo,
coord:tzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_tzOffset_echo,
coord:current=org.apache.oozie.coord.CoordELFunctions#ph1_coord_current_echo,
coord:currentRange=org.apache.oozie.coord.CoordELFunctions#ph1_coord_currentRange_echo,
coord:offset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_offset_echo,
coord:latest=org.apache.oozie.coord.CoordELFunctions#ph1_coord_latest_echo,
coord:latestRange=org.apache.oozie.coord.CoordELFunctions#ph1_coord_latestRange_echo,
coord:future=org.apache.oozie.coord.CoordELFunctions#ph1_coord_future_echo,
coord:futureRange=org.apache.oozie.coord.CoordELFunctions#ph1_coord_futureRange_echo,
coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
coord:absolute=org.apache.oozie.coord.CoordELFunctions#ph1_coord_absolute_echo,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-job-submit-instances
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-job-submit-data
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-job-submit-data
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-job-submit-data
coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,
coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,
coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,
coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,
coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,
coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,
coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,
coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,
coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,
coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,
coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,
coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,
coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,
coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,
coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,
coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitions_echo,
coord:dataOutPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataOutPartitions_echo,
coord:dataOutPartitionValue=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataOutPartitionValue_echo,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-job-submit-data
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-sla-submit
MINUTES=org.apache.oozie.coord.CoordELConstants#SUBMIT_MINUTES,
HOURS=org.apache.oozie.coord.CoordELConstants#SUBMIT_HOURS,
DAYS=org.apache.oozie.coord.CoordELConstants#SUBMIT_DAYS
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-sla-submit
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-sla-submit
coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,
coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_fixed,
coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,
coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,
coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,
coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,
coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,
coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,
coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,
coord:dataOutPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataOutPartitions_echo,
coord:dataOutPartitionValue=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataOutPartitionValue_echo,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-sla-submit
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-action-create
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-action-create
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-action-create
coord:hoursInDay=org.apache.oozie.coord.CoordELFunctions#ph2_coord_hoursInDay,
coord:daysInMonth=org.apache.oozie.coord.CoordELFunctions#ph2_coord_daysInMonth,
coord:tzOffset=org.apache.oozie.coord.CoordELFunctions#ph2_coord_tzOffset,
coord:current=org.apache.oozie.coord.CoordELFunctions#ph2_coord_current,
coord:currentRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_currentRange,
coord:offset=org.apache.oozie.coord.CoordELFunctions#ph2_coord_offset,
coord:latest=org.apache.oozie.coord.CoordELFunctions#ph2_coord_latest_echo,
coord:latestRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_latestRange_echo,
coord:future=org.apache.oozie.coord.CoordELFunctions#ph2_coord_future_echo,
coord:futureRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_futureRange_echo,
coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph2_coord_actionId,
coord:name=org.apache.oozie.coord.CoordELFunctions#ph2_coord_name,
coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph2_coord_formatTime,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
coord:absolute=org.apache.oozie.coord.CoordELFunctions#ph2_coord_absolute_echo,
coord:absoluteRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_absolute_range,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-action-create
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-action-create-inst
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-action-create-inst
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-action-create-inst
coord:hoursInDay=org.apache.oozie.coord.CoordELFunctions#ph2_coord_hoursInDay,
coord:daysInMonth=org.apache.oozie.coord.CoordELFunctions#ph2_coord_daysInMonth,
coord:tzOffset=org.apache.oozie.coord.CoordELFunctions#ph2_coord_tzOffset,
coord:current=org.apache.oozie.coord.CoordELFunctions#ph2_coord_current_echo,
coord:currentRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_currentRange_echo,
coord:offset=org.apache.oozie.coord.CoordELFunctions#ph2_coord_offset_echo,
coord:latest=org.apache.oozie.coord.CoordELFunctions#ph2_coord_latest_echo,
coord:latestRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_latestRange_echo,
coord:future=org.apache.oozie.coord.CoordELFunctions#ph2_coord_future_echo,
coord:futureRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_futureRange_echo,
coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph2_coord_formatTime,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
coord:absolute=org.apache.oozie.coord.CoordELFunctions#ph2_coord_absolute_echo,
coord:absoluteRange=org.apache.oozie.coord.CoordELFunctions#ph2_coord_absolute_range,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-action-create-inst
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-sla-create
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-sla-create
MINUTES=org.apache.oozie.coord.CoordELConstants#SUBMIT_MINUTES,
HOURS=org.apache.oozie.coord.CoordELConstants#SUBMIT_HOURS,
DAYS=org.apache.oozie.coord.CoordELConstants#SUBMIT_DAYS
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-sla-create
coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph3_coord_dataOut,
coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph2_coord_nominalTime,
coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph2_coord_actualTime,
coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph2_coord_dateOffset,
coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph2_coord_dateTzOffset,
coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph2_coord_formatTime,
coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph2_coord_actionId,
coord:name=org.apache.oozie.coord.CoordELFunctions#ph2_coord_name,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph3_coord_databaseOut,
coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph3_coord_tableOut,
coord:dataOutPartitions=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataOutPartitions,
coord:dataOutPartitionValue=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataOutPartitionValue,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-sla-create
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.constants.coord-action-start
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
oozie.service.ELService.ext.constants.coord-action-start
EL constant declarations, separated by commas, format is [PREFIX:]NAME=CLASS#CONSTANT.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.functions.coord-action-start
coord:hoursInDay=org.apache.oozie.coord.CoordELFunctions#ph3_coord_hoursInDay,
coord:daysInMonth=org.apache.oozie.coord.CoordELFunctions#ph3_coord_daysInMonth,
coord:tzOffset=org.apache.oozie.coord.CoordELFunctions#ph3_coord_tzOffset,
coord:latest=org.apache.oozie.coord.CoordELFunctions#ph3_coord_latest,
coord:latestRange=org.apache.oozie.coord.CoordELFunctions#ph3_coord_latestRange,
coord:future=org.apache.oozie.coord.CoordELFunctions#ph3_coord_future,
coord:futureRange=org.apache.oozie.coord.CoordELFunctions#ph3_coord_futureRange,
coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph3_coord_dataIn,
coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph3_coord_dataOut,
coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph3_coord_nominalTime,
coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph3_coord_actualTime,
coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph3_coord_dateOffset,
coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph3_coord_dateTzOffset,
coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph3_coord_formatTime,
coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph3_coord_actionId,
coord:name=org.apache.oozie.coord.CoordELFunctions#ph3_coord_name,
coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,
coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,
coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph3_coord_databaseIn,
coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph3_coord_databaseOut,
coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph3_coord_tableIn,
coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph3_coord_tableOut,
coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataInPartitionFilter,
coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataInPartitionMin,
coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataInPartitionMax,
coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataInPartitions,
coord:dataOutPartitions=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataOutPartitions,
coord:dataOutPartitionValue=org.apache.oozie.coord.HCatELFunctions#ph3_coord_dataOutPartitionValue,
hadoop:conf=org.apache.oozie.action.hadoop.HadoopELFunctions#hadoop_conf
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
oozie.service.ELService.ext.functions.coord-action-start
EL functions declarations, separated by commas, format is [PREFIX:]NAME=CLASS#METHOD.
This property is a convenience property to add extensions to the built in executors without having to
include all the built in ones.
oozie.service.ELService.latest-el.use-current-time
false
Determine whether to use the current time to determine the latest dependency or the action creation time.
This is for backward compatibility with older oozie behaviour.
oozie.service.UUIDService.generator
counter
random : generated UUIDs will be random strings.
counter: generated UUIDs generated will be a counter postfixed with the system startup time.
oozie.service.DBLiteWorkflowStoreService.status.metrics.collection.interval
5
Workflow Status metrics collection interval in minutes.
oozie.service.DBLiteWorkflowStoreService.status.metrics.window
3600
Workflow Status metrics collection window in seconds. Workflow status will be instrumented for the window.
oozie.db.schema.name
oozie
Oozie DataBase Name
oozie.service.JPAService.create.db.schema
false
Creates Oozie DB.
If set to true, it creates the DB schema if it does not exist. If the DB schema exists is a NOP.
If set to false, it does not create the DB schema. If the DB schema does not exist it fails start up.
oozie.service.JPAService.validate.db.connection
true
Validates DB connections from the DB connection pool.
If the 'oozie.service.JPAService.create.db.schema' property is set to true, this property is ignored.
oozie.service.JPAService.validate.db.connection.eviction.interval
300000
Validates DB connections from the DB connection pool.
When validate db connection 'TestWhileIdle' is true, the number of milliseconds to sleep
between runs of the idle object evictor thread.
oozie.service.JPAService.validate.db.connection.eviction.num
10
Validates DB connections from the DB connection pool.
When validate db connection 'TestWhileIdle' is true, the number of objects to examine during
each run of the idle object evictor thread.
oozie.service.JPAService.connection.data.source
org.apache.commons.dbcp.BasicDataSource
DataSource to be used for connection pooling.
oozie.service.JPAService.connection.properties
DataSource connection properties.
oozie.service.JPAService.jdbc.driver
org.apache.derby.jdbc.EmbeddedDriver
JDBC driver class.
oozie.service.JPAService.jdbc.url
jdbc:derby:${oozie.data.dir}/${oozie.db.schema.name}-db;create=true
JDBC URL.
oozie.service.JPAService.jdbc.username
sa
DB user name.
oozie.service.JPAService.jdbc.password
DB user password.
IMPORTANT: if password is emtpy leave a 1 space string, the service trims the value,
if empty Configuration assumes it is NULL.
IMPORTANT: if the StoreServicePasswordService is active, it will reset this value with the value given in
the console.
oozie.service.JPAService.pool.max.active.conn
10
Max number of connections.
oozie.service.SchemaService.wf.schemas
oozie-workflow-0.1.xsd,oozie-workflow-0.2.xsd,oozie-workflow-0.2.5.xsd,oozie-workflow-0.3.xsd,oozie-workflow-0.4.xsd,
oozie-workflow-0.4.5.xsd,oozie-workflow-0.5.xsd,
shell-action-0.1.xsd,shell-action-0.2.xsd,shell-action-0.3.xsd,
email-action-0.1.xsd,email-action-0.2.xsd,
hive-action-0.2.xsd,hive-action-0.3.xsd,hive-action-0.4.xsd,hive-action-0.5.xsd,
sqoop-action-0.2.xsd,sqoop-action-0.3.xsd,sqoop-action-0.4.xsd,
ssh-action-0.1.xsd,ssh-action-0.2.xsd,
distcp-action-0.1.xsd,distcp-action-0.2.xsd,
oozie-sla-0.1.xsd,oozie-sla-0.2.xsd,
hive2-action-0.1.xsd,
spark-action-0.1.xsd
List of schemas for workflows (separated by commas).
oozie.service.SchemaService.wf.ext.schemas
List of additional schemas for workflows (separated by commas).
oozie.service.SchemaService.coord.schemas
oozie-coordinator-0.1.xsd,oozie-coordinator-0.2.xsd,oozie-coordinator-0.3.xsd,oozie-coordinator-0.4.xsd,
oozie-sla-0.1.xsd,oozie-sla-0.2.xsd
List of schemas for coordinators (separated by commas).
oozie.service.SchemaService.coord.ext.schemas
List of additional schemas for coordinators (separated by commas).
oozie.service.SchemaService.bundle.schemas
oozie-bundle-0.1.xsd,oozie-bundle-0.2.xsd
List of schemas for bundles (separated by commas).
oozie.service.SchemaService.bundle.ext.schemas
List of additional schemas for bundles (separated by commas).
oozie.service.SchemaService.sla.schemas
gms-oozie-sla-0.1.xsd,oozie-sla-0.2.xsd
List of schemas for semantic validation for GMS SLA (separated by commas).
oozie.service.SchemaService.sla.ext.schemas
List of additional schemas for semantic validation for GMS SLA (separated by commas).
oozie.service.CallbackService.base.url
${oozie.base.url}/callback
Base callback URL used by ActionExecutors.
oozie.service.CallbackService.early.requeue.max.retries
5
If Oozie receives a callback too early (while the action is in PREP state), it will requeue the command this many times
to give the action time to transition to RUNNING.
oozie.servlet.CallbackServlet.max.data.len
2048
Max size in characters for the action completion data output.
oozie.external.stats.max.size
-1
Max size in bytes for action stats. -1 means infinite value.
oozie.JobCommand.job.console.url
${oozie.base.url}?job=
Base console URL for a workflow job.
oozie.service.ActionService.executor.classes
org.apache.oozie.action.decision.DecisionActionExecutor,
org.apache.oozie.action.hadoop.JavaActionExecutor,
org.apache.oozie.action.hadoop.FsActionExecutor,
org.apache.oozie.action.hadoop.MapReduceActionExecutor,
org.apache.oozie.action.hadoop.PigActionExecutor,
org.apache.oozie.action.hadoop.HiveActionExecutor,
org.apache.oozie.action.hadoop.ShellActionExecutor,
org.apache.oozie.action.hadoop.SqoopActionExecutor,
org.apache.oozie.action.hadoop.DistcpActionExecutor,
org.apache.oozie.action.hadoop.Hive2ActionExecutor,
org.apache.oozie.action.ssh.SshActionExecutor,
org.apache.oozie.action.oozie.SubWorkflowActionExecutor,
org.apache.oozie.action.email.EmailActionExecutor,
org.apache.oozie.action.hadoop.SparkActionExecutor
List of ActionExecutors classes (separated by commas).
Only action types with associated executors can be used in workflows.
oozie.service.ActionService.executor.ext.classes
List of ActionExecutors extension classes (separated by commas). Only action types with associated
executors can be used in workflows. This property is a convenience property to add extensions to the built
in executors without having to include all the built in ones.
oozie.service.ActionCheckerService.action.check.interval
60
The frequency at which the ActionCheckService will run.
oozie.service.ActionCheckerService.action.check.delay
600
The time, in seconds, between an ActionCheck for the same action.
oozie.service.ActionCheckerService.callable.batch.size
10
This value determines the number of actions which will be batched together
to be executed by a single thread.
oozie.service.StatusTransitService.statusTransit.interval
60
The frequency in seconds at which the StatusTransitService will run.
oozie.service.StatusTransitService.backward.support.for.coord.status
false
true, if coordinator job submits using 'uri:oozie:coordinator:0.1' and wants to keep Oozie 2.x status transit.
if set true,
1. SUCCEEDED state in coordinator job means materialization done.
2. No DONEWITHERROR state in coordinator job
3. No PAUSED or PREPPAUSED state in coordinator job
4. PREPSUSPENDED becomes SUSPENDED in coordinator job
oozie.service.StatusTransitService.backward.support.for.states.without.error
true
true, if you want to keep Oozie 3.2 status transit.
Change it to false for Oozie 4.x releases.
if set true,
No states like RUNNINGWITHERROR, SUSPENDEDWITHERROR and PAUSEDWITHERROR
for coordinator and bundle
oozie.service.PauseTransitService.PauseTransit.interval
60
The frequency in seconds at which the PauseTransitService will run.
oozie.action.max.output.data
2048
Max size in characters for output data.
oozie.action.fs.glob.max
1000
Maximum number of globbed files.
oozie.action.launcher.mapreduce.job.ubertask.enable
true
Enables Uber Mode for the launcher job in YARN/Hadoop 2 (no effect in Hadoop 1) for all action types by default.
This can be overridden on a per-action-type basis by setting
oozie.action.#action-type#.launcher.mapreduce.job.ubertask.enable in oozie-site.xml (where #action-type# is the action
type; for example, "pig"). And that can be overridden on a per-action basis by setting
oozie.launcher.mapreduce.job.ubertask.enable in an action's configuration section in a workflow. In summary, the
priority is this:
1. action's configuration section in a workflow
2. oozie.action.#action-type#.launcher.mapreduce.job.ubertask.enable in oozie-site
3. oozie.action.launcher.mapreduce.job.ubertask.enable in oozie-site
oozie.action.shell.launcher.mapreduce.job.ubertask.enable
false
The Shell action may have issues with the $PATH environment when using Uber Mode, and so Uber Mode is disabled by
default for it. See oozie.action.launcher.mapreduce.job.ubertask.enable
oozie.action.launcher.yarn.timeline-service.enabled
false
Enables/disables getting delegation tokens for ATS for the launcher job in
YARN/Hadoop 2.6 (no effect in Hadoop 1) for all action types by default if tez-site.xml is present in
distributed cache.
This can be overridden on a per-action basis by setting
oozie.launcher.yarn.timeline-service.enabled in an action's configuration section in a workflow.
oozie.action.retries.max
3
The number of retries for executing an action in case of failure
oozie.action.retry.interval
10
The interval between retries of an action in case of failure
oozie.action.retry.policy
periodic
Retry policy of an action in case of failure. Possible values are periodic/exponential
oozie.action.ssh.delete.remote.tmp.dir
true
If set to true, it will delete temporary directory at the end of execution of ssh action.
oozie.action.ssh.http.command
curl
Command to use for callback to oozie, normally is 'curl' or 'wget'.
The command must available in PATH environment variable of the USER@HOST box shell.
oozie.action.ssh.http.command.post.options
--data-binary @#stdout --request POST --header "content-type:text/plain"
The callback command POST options.
Used when the ouptut of the ssh action is captured.
oozie.action.ssh.allow.user.at.host
true
Specifies whether the user specified by the ssh action is allowed or is to be replaced
by the Job user
oozie.action.subworkflow.max.depth
50
The maximum depth for subworkflows. For example, if set to 3, then a workflow can start subwf1, which can start subwf2,
which can start subwf3; but if subwf3 tries to start subwf4, then the action will fail. This is helpful in preventing
errant workflows from starting infintely recursive subworkflows.
oozie.service.HadoopAccessorService.kerberos.enabled
false
Indicates if Oozie is configured to use Kerberos.
local.realm
LOCALHOST
Kerberos Realm used by Oozie and Hadoop. Using 'local.realm' to be aligned with Hadoop configuration
oozie.service.HadoopAccessorService.keytab.file
${user.home}/oozie.keytab
Location of the Oozie user keytab file.
oozie.service.HadoopAccessorService.kerberos.principal
${user.name}/localhost@${local.realm}
Kerberos principal for Oozie service.
oozie.service.HadoopAccessorService.jobTracker.whitelist
Whitelisted job tracker for Oozie service.
oozie.service.HadoopAccessorService.nameNode.whitelist
Whitelisted job tracker for Oozie service.
oozie.service.HadoopAccessorService.hadoop.configurations
*=hadoop-conf
Comma separated AUTHORITY=HADOOP_CONF_DIR, where AUTHORITY is the HOST:PORT of
the Hadoop service (JobTracker, YARN, HDFS). The wildcard '*' configuration is
used when there is no exact match for an authority. The HADOOP_CONF_DIR contains
the relevant Hadoop *-site.xml files. If the path is relative is looked within
the Oozie configuration directory; though the path can be absolute (i.e. to point
to Hadoop client conf/ directories in the local filesystem.
oozie.service.HadoopAccessorService.action.configurations
*=action-conf
Comma separated AUTHORITY=ACTION_CONF_DIR, where AUTHORITY is the HOST:PORT of
the Hadoop MapReduce service (JobTracker, YARN). The wildcard '*' configuration is
used when there is no exact match for an authority. The ACTION_CONF_DIR may contain
ACTION.xml files where ACTION is the action type ('java', 'map-reduce', 'pig',
'hive', 'sqoop', etc.). If the ACTION.xml file exists, its properties will be used
as defaults properties for the action. If the path is relative is looked within
the Oozie configuration directory; though the path can be absolute (i.e. to point
to Hadoop client conf/ directories in the local filesystem.
oozie.service.HadoopAccessorService.action.configurations.load.default.resources
true
true means that default and site xml files of hadoop (core-default, core-site,
hdfs-default, hdfs-site, mapred-default, mapred-site, yarn-default, yarn-site)
are parsed into actionConf on Oozie server. false means that site xml files are
not loaded on server, instead loaded on launcher node.
This is only done for pig and hive actions which handle loading those files
automatically from the classpath on launcher task. It defaults to true.
oozie.credentials.credentialclasses
A list of credential class mapping for CredentialsProvider
oozie.actions.main.classnames
distcp=org.apache.hadoop.tools.DistCp
A list of class name mapping for Action classes
oozie.service.WorkflowAppService.system.libpath
/user/${user.name}/share/lib
System library path to use for workflow applications.
This path is added to workflow application if their job properties sets
the property 'oozie.use.system.libpath' to true.
oozie.command.default.lock.timeout
5000
Default timeout (in milliseconds) for commands for acquiring an exclusive lock on an entity.
oozie.command.default.requeue.delay
10000
Default time (in milliseconds) for commands that are requeued for delayed execution.
oozie.service.LiteWorkflowStoreService.user.retry.max
3
Automatic retry max count for workflow action is 3 in default.
oozie.service.LiteWorkflowStoreService.user.retry.inteval
10
Automatic retry interval for workflow action is in minutes and the default value is 10 minutes.
oozie.service.LiteWorkflowStoreService.user.retry.error.code
JA008,JA009,JA017,JA018,JA019,FS009,FS008,FS014
Automatic retry interval for workflow action is handled for these specified error code:
FS009, FS008 is file exists error when using chmod in fs action.
FS014 is permission error in fs action
JA018 is output directory exists error in workflow map-reduce action.
JA019 is error while executing distcp action.
JA017 is job not exists error in action executor.
JA008 is FileNotFoundException in action executor.
JA009 is IOException in action executor.
ALL is the any kind of error in action executor.
oozie.service.LiteWorkflowStoreService.user.retry.error.code.ext
Automatic retry interval for workflow action is handled for these specified extra error code:
ALL is the any kind of error in action executor.
oozie.service.LiteWorkflowStoreService.node.def.version
_oozie_inst_v_1
NodeDef default version, _oozie_inst_v_0 or _oozie_inst_v_1
oozie.authentication.type
simple
Defines authentication used for Oozie HTTP endpoint.
Supported values are: simple | kerberos | #AUTHENTICATION_HANDLER_CLASSNAME#
oozie.server.authentication.type
${oozie.authentication.type}
Defines authentication used for Oozie server communicating to other Oozie server over HTTP(s).
Supported values are: simple | kerberos | #AUTHENTICATOR_CLASSNAME#
oozie.authentication.token.validity
36000
Indicates how long (in seconds) an authentication token is valid before it has
to be renewed.
oozie.authentication.cookie.domain
The domain to use for the HTTP cookie that stores the authentication token.
In order to authentiation to work correctly across multiple hosts
the domain must be correctly set.
oozie.authentication.simple.anonymous.allowed
true
Indicates if anonymous requests are allowed when using 'simple' authentication.
oozie.authentication.kerberos.principal
HTTP/localhost@${local.realm}
Indicates the Kerberos principal to be used for HTTP endpoint.
The principal MUST start with 'HTTP/' as per Kerberos HTTP SPNEGO specification.
oozie.authentication.kerberos.keytab
${oozie.service.HadoopAccessorService.keytab.file}
Location of the keytab file with the credentials for the principal.
Referring to the same keytab file Oozie uses for its Kerberos credentials for Hadoop.
oozie.authentication.kerberos.name.rules
DEFAULT
The kerberos names rules is to resolve kerberos principal names, refer to Hadoop's
KerberosName for more details.
oozie.coord.execution.none.tolerance
1
Default time tolerance in minutes after action nominal time for an action to be skipped
when execution order is "NONE"
oozie.coord.actions.default.length
1000
Default number of coordinator actions to be retrieved by the info command
oozie.validate.ForkJoin
true
If true, fork and join should be validated at wf submission time.
oozie.coord.action.get.all.attributes
false
Setting to true is not recommended as coord job/action info will bring all columns of the action in memory.
Set it true only if backward compatibility for action/job info is required.
oozie.service.HadoopAccessorService.supported.filesystems
hdfs,hftp,webhdfs
Enlist the different filesystems supported for federation. If wildcard "*" is specified,
then ALL file schemes will be allowed.
oozie.service.URIHandlerService.uri.handlers
org.apache.oozie.dependency.FSURIHandler
Enlist the different uri handlers supported for data availability checks.
oozie.notification.url.connection.timeout
10000
Defines the timeout, in milliseconds, for Oozie HTTP notification callbacks. Oozie does
HTTP notifications for workflow jobs which set the 'oozie.wf.action.notification.url',
'oozie.wf.worklfow.notification.url' and/or 'oozie.coord.action.notification.url'
properties in their job.properties. Refer to section '5 Oozie Notifications' in the
Workflow specification for details.
oozie.hadoop-2.0.2-alpha.workaround.for.distributed.cache
false
Due to a bug in Hadoop 2.0.2-alpha, MAPREDUCE-4820, launcher jobs fail to set
the distributed cache for the action job because the local JARs are implicitly
included triggering a duplicate check.
This flag removes the distributed cache files for the action as they'll be
included from the local JARs of the JobClient (MRApps) submitting the action
job from the launcher.
oozie.service.EventHandlerService.filter.app.types
workflow_job, coordinator_action
The app-types among workflow/coordinator/bundle job/action for which
for which events system is enabled.
oozie.service.EventHandlerService.event.queue
org.apache.oozie.event.MemoryEventQueue
The implementation for EventQueue in use by the EventHandlerService.
oozie.service.EventHandlerService.event.listeners
org.apache.oozie.jms.JMSJobEventListener
oozie.service.EventHandlerService.queue.size
10000
Maximum number of events to be contained in the event queue.
oozie.service.EventHandlerService.worker.interval
30
The default interval (seconds) at which the worker threads will be scheduled to run
and process events.
oozie.service.EventHandlerService.batch.size
10
The batch size for batched draining per thread from the event queue.
oozie.service.EventHandlerService.worker.threads
3
Number of worker threads to be scheduled to run and process events.
oozie.sla.service.SLAService.capacity
5000
Maximum number of sla records to be contained in the memory structure.
oozie.sla.service.SLAService.alert.events
END_MISS
Default types of SLA events for being alerted of.
oozie.sla.service.SLAService.calculator.impl
org.apache.oozie.sla.SLACalculatorMemory
The implementation for SLACalculator in use by the SLAService.
oozie.sla.service.SLAService.job.event.latency
90000
Time in milliseconds to account of latency of getting the job status event
to compare against and decide sla miss/met
oozie.sla.service.SLAService.check.interval
30
Time interval, in seconds, at which SLA Worker will be scheduled to run
oozie.sla.disable.alerts.older.than
48
Time threshold, in HOURS, for disabling SLA alerting for jobs whose
nominal time is older than this.
oozie.zookeeper.connection.string
localhost:2181
Comma-separated values of host:port pairs of the ZooKeeper servers.
oozie.zookeeper.namespace
oozie
The namespace to use. All of the Oozie Servers that are planning on talking to each other should have the same
namespace.
oozie.zookeeper.connection.timeout
180
Default ZK connection timeout (in sec). If connection is lost for more than timeout, then Oozie server will shutdown
itself if oozie.zookeeper.server.shutdown.ontimeout is true.
oozie.zookeeper.server.shutdown.ontimeout
true
If true, Oozie server will shutdown itself on ZK
connection timeout.
oozie.http.hostname
localhost
Oozie server host name.
oozie.http.port
11000
Oozie server port.
oozie.instance.id
${oozie.http.hostname}
Each Oozie server should have its own unique instance id. The default is system property
=${OOZIE_HTTP_HOSTNAME}= (i.e. the hostname).
oozie.service.ShareLibService.mapping.file
Sharelib mapping files contains list of key=value,
where key will be the sharelib name for the action and value is a comma separated list of
DFS directories or jar files.
Example.
oozie.pig_10=hdfs:///share/lib/pig/pig-0.10.1/lib/
oozie.pig=hdfs:///share/lib/pig/pig-0.11.1/lib/
oozie.distcp=hdfs:///share/lib/hadoop-2.2.0/share/hadoop/tools/lib/hadoop-distcp-2.2.0.jar
oozie.service.ShareLibService.fail.fast.on.startup
false
Fails server starup if sharelib initilzation fails.
oozie.service.ShareLibService.purge.interval
1
How often, in days, Oozie should check for old ShareLibs and LauncherLibs to purge from HDFS.
oozie.service.ShareLibService.temp.sharelib.retention.days
7
ShareLib retention time in days.
oozie.action.ship.launcher.jar
false
Specifies whether launcher jar is shipped or not.
oozie.action.jobinfo.enable
false
JobInfo will contain information of bundle, coordinator, workflow and actions. If enabled, hadoop job will have
property(oozie.job.info) which value is multiple key/value pair separated by ",". This information can be used for
analytics like how many oozie jobs are submitted for a particular period, what is the total number of failed pig jobs,
etc from mapreduce job history logs and configuration.
User can also add custom workflow property to jobinfo by adding property which prefix with "oozie.job.info."
Eg.
oozie.job.info="bundle.id=,bundle.name=,coord.name=,coord.nominal.time=,coord.name=,wf.id=,
wf.name=,action.name=,action.type=,launcher=true"
oozie.service.XLogStreamingService.max.log.scan.duration
-1
Max log scan duration in hours. If log scan request end_date - start_date > value,
then exception is thrown to reduce the scan duration. -1 indicate no limit.
oozie.service.XLogStreamingService.actionlist.max.log.scan.duration
-1
Max log scan duration in hours for coordinator job when list of actions are specified.
If log streaming request end_date - start_date > value, then exception is thrown to reduce the scan duration.
-1 indicate no limit.
This setting is separate from max.log.scan.duration as we want to allow higher durations when actions are specified.
oozie.service.JvmPauseMonitorService.warn-threshold.ms
10000
The JvmPauseMonitorService runs a thread that repeatedly tries to detect when the JVM pauses, which could indicate
that the JVM or host machine is overloaded or other problems. This thread sleeps for 500ms; if it sleeps for
significantly longer, then there is likely a problem. This property specifies the threadshold for when Oozie should log
a WARN level message; there is also a counter named "jvm.pause.warn-threshold".
oozie.service.JvmPauseMonitorService.info-threshold.ms
1000
The JvmPauseMonitorService runs a thread that repeatedly tries to detect when the JVM pauses, which could indicate
that the JVM or host machine is overloaded or other problems. This thread sleeps for 500ms; if it sleeps for
significantly longer, then there is likely a problem. This property specifies the threadshold for when Oozie should log
an INFO level message; there is also a counter named "jvm.pause.info-threshold".
oozie.service.ZKLocksService.locks.reaper.threshold
300
The frequency at which the ChildReaper will run.
Duration should be in sec. Default is 5 min.
oozie.service.ZKLocksService.locks.reaper.threads
2
Number of fixed threads used by ChildReaper to
delete empty locks.
oozie.service.AbandonedCoordCheckerService.check.interval
1440
Interval, in minutes, at which AbandonedCoordCheckerService should run.
oozie.service.AbandonedCoordCheckerService.check.delay
60
Delay, in minutes, at which AbandonedCoordCheckerService should run.
oozie.service.AbandonedCoordCheckerService.failure.limit
25
Failure limit. A job is considered to be abandoned/faulty if total number of actions in
failed/timedout/suspended >= "Failure limit" and there are no succeeded action.
oozie.service.AbandonedCoordCheckerService.kill.jobs
false
If true, AbandonedCoordCheckerService will kill abandoned coords.
oozie.service.AbandonedCoordCheckerService.job.older.than
2880
In minutes, job will be considered as abandoned/faulty if job is older than this value.
oozie.notification.proxy
System level proxy setting for job notifications.
oozie.wf.rerun.disablechild
false
By setting this option, workflow rerun will be disabled if parent workflow or coordinator exist and
it will only rerun through parent.
oozie.use.system.libpath
false
Default value of oozie.use.system.libpath. If user haven't specified =oozie.use.system.libpath=
in the job.properties and this value is true and Oozie will include sharelib jars for workflow.
oozie.service.PauseTransitService.callable.batch.size
10
This value determines the number of callable which will be batched together
to be executed by a single thread.
oozie.configuration.substitute.depth
20
This value determines the depth of substitution in configurations.
If set -1, No limitation on substitution.
oozie.service.SparkConfigurationService.spark.configurations
*=spark-conf
Comma separated AUTHORITY=SPARK_CONF_DIR, where AUTHORITY is the HOST:PORT of
the ResourceManager of a YARN cluster. The wildcard '*' configuration is
used when there is no exact match for an authority. The SPARK_CONF_DIR contains
the relevant spark-defaults.conf properties file. If the path is relative is looked within
the Oozie configuration directory; though the path can be absolute. This is only used
when the Spark master is set to either "yarn-client" or "yarn-cluster".
oozie.email.attachment.enabled
true
This value determines whether to support email attachment of a file on HDFS.
Set it false if there is any security concern.