This project has retired. For details please refer to its Attic page.

org.apache.oozie.coord
Class HCatELFunctions

java.lang.Object
  org.apache.oozie.coord.HCatELFunctions

public class HCatELFunctions
extends Object

This class implements the EL function for HCat datasets in coordinator

Constructor Summary

HCatELFunctions()

Method Summary

static boolean	hcat_exists(String uri) Return true if partitions exists or false if not.
static String	ph1_coord_databaseIn_echo(String dataName) Echo the same EL function without evaluating anything
static String	ph1_coord_databaseOut_echo(String dataName)
static String	ph1_coord_dataInPartitionFilter_echo(String dataInName, String type)
static String	ph1_coord_dataInPartitionMax_echo(String dataInName, String partition)
static String	ph1_coord_dataInPartitionMin_echo(String dataInName, String partition)
static String	ph1_coord_dataOutPartitions_echo(String dataOutName)
static String	ph1_coord_dataOutPartitionValue_echo(String dataOutName, String partition)
static String	ph1_coord_tableIn_echo(String dataName)
static String	ph1_coord_tableOut_echo(String dataName)
static String	ph3_coord_databaseIn(String dataName) Extract the hcat DB name from the URI-template associate with 'dataInName'.
static String	ph3_coord_databaseOut(String dataName) Extract the hcat DB name from the URI-template associate with 'dataOutName'.
static String	ph3_coord_dataInPartitionFilter(String dataInName, String type) Used to specify the HCat partition filter which is input dependency for workflow job. Look for two evaluator-level variables A) .datain. B) .datain..unresolved A defines the current list of HCat URIs.
static String	ph3_coord_dataInPartitionMax(String dataInName, String partitionName) Used to specify the MINIMUM value of an HCat partition which is input dependency for workflow job. Look for two evaluator-level variables A) .datain. B) .datain..unresolved A defines the current list of HCat URIs.
static String	ph3_coord_dataInPartitionMin(String dataInName, String partitionName) Used to specify the MAXIMUM value of an HCat partition which is input dependency for workflow job. Look for two evaluator-level variables A) .datain. B) .datain..unresolved A defines the current list of HCat URIs.
static String	ph3_coord_dataOutPartitions(String dataOutName) Used to specify the entire HCat partition defining output for workflow job. Look for two evaluator-level variables A) .dataout. B) .dataout..unresolved A defines the data-out HCat URI.
static String	ph3_coord_dataOutPartitionValue(String dataOutName, String partitionName) Used to specify the HCat partition's value defining output for workflow job. Look for two evaluator-level variables A) .dataout. B) .dataout..unresolved A defines the current list of HCat URIs.
static String	ph3_coord_tableIn(String dataName) Extract the hcat Table name from the URI-template associate with 'dataInName'.
static String	ph3_coord_tableOut(String dataName) Extract the hcat Table name from the URI-template associate with 'dataOutName'.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatELFunctions

public HCatELFunctions()

Method Detail

hcat_exists

public static boolean hcat_exists(String uri)
                           throws Exception

Return true if partitions exists or false if not.

Parameters:

uri - hcatalog partition uri.

Returns:

true if the uri exists, false if it does not.

Throws:

Exception

ph1_coord_databaseIn_echo

public static String ph1_coord_databaseIn_echo(String dataName)

Echo the same EL function without evaluating anything

Parameters:

dataInName -

Returns:

the same EL function

ph1_coord_databaseOut_echo

public static String ph1_coord_databaseOut_echo(String dataName)

ph1_coord_tableIn_echo

public static String ph1_coord_tableIn_echo(String dataName)

ph1_coord_tableOut_echo

public static String ph1_coord_tableOut_echo(String dataName)

ph1_coord_dataInPartitionFilter_echo

public static String ph1_coord_dataInPartitionFilter_echo(String dataInName,
                                                          String type)

ph1_coord_dataInPartitionMin_echo

public static String ph1_coord_dataInPartitionMin_echo(String dataInName,
                                                       String partition)

ph1_coord_dataInPartitionMax_echo

public static String ph1_coord_dataInPartitionMax_echo(String dataInName,
                                                       String partition)

ph1_coord_dataOutPartitions_echo

public static String ph1_coord_dataOutPartitions_echo(String dataOutName)

ph1_coord_dataOutPartitionValue_echo

public static String ph1_coord_dataOutPartitionValue_echo(String dataOutName,
                                                          String partition)

ph3_coord_databaseIn

public static String ph3_coord_databaseIn(String dataName)

Extract the hcat DB name from the URI-template associate with 'dataInName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataInName -

Returns:

DB name

ph3_coord_databaseOut

public static String ph3_coord_databaseOut(String dataName)

Extract the hcat DB name from the URI-template associate with 'dataOutName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataOutName -

Returns:

DB name

ph3_coord_tableIn

public static String ph3_coord_tableIn(String dataName)

Extract the hcat Table name from the URI-template associate with 'dataInName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataInName -

Returns:

Table name

ph3_coord_tableOut

public static String ph3_coord_tableOut(String dataName)

Extract the hcat Table name from the URI-template associate with 'dataOutName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataOutName -

Returns:

Table name

ph3_coord_dataInPartitionFilter

public static String ph3_coord_dataInPartitionFilter(String dataInName,
                                                     String type)

Used to specify the HCat partition filter which is input dependency for workflow job.

Look for two evaluator-level variables

A) .datain. B) .datain..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the partition filter.

Parameters:

dataInName - : Datain name

type - : for action type - pig, MR or hive

ph3_coord_dataOutPartitionValue

public static String ph3_coord_dataOutPartitionValue(String dataOutName,
                                                     String partitionName)

Used to specify the HCat partition's value defining output for workflow job.

Look for two evaluator-level variables

A) .dataout. B) .dataout..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the partition value.

Parameters:

dataOutName - : Dataout name

partitionName - : Specific partition name whose value is wanted

ph3_coord_dataOutPartitions

public static String ph3_coord_dataOutPartitions(String dataOutName)

Used to specify the entire HCat partition defining output for workflow job.

Look for two evaluator-level variables

A) .dataout. B) .dataout..unresolved

A defines the data-out HCat URI.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the partition.

Parameters:

dataOutName - : DataOut name

ph3_coord_dataInPartitionMin

public static String ph3_coord_dataInPartitionMin(String dataInName,
                                                  String partitionName)

Used to specify the MAXIMUM value of an HCat partition which is input dependency for workflow job.

Look for two evaluator-level variables

A) .datain. B) .datain..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the max partition value.

Parameters:

dataInName - : Datain name

partitionName - : Specific partition name whose MAX value is wanted

ph3_coord_dataInPartitionMax

public static String ph3_coord_dataInPartitionMax(String dataInName,
                                                  String partitionName)

Used to specify the MINIMUM value of an HCat partition which is input dependency for workflow job.

Look for two evaluator-level variables

A) .datain. B) .datain..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the min partition value.

Parameters:

dataInName - : Datain name

partitionName - : Specific partition name whose MIN value is wanted