org.apache.oozie.coord

Class HCatELFunctions

java.lang.Object

org.apache.oozie.coord.HCatELFunctions

public class HCatELFunctions
extends java.lang.Object

This class implements the EL function for HCat datasets in coordinator

Constructor Summary

Constructors

Constructor and Description
HCatELFunctions()

Method Summary

Methods

Modifier and Type	Method and Description
static boolean	hcat_exists(java.lang.String uri) Return true if partitions exists or false if not.
static java.lang.String	ph1_coord_databaseIn_echo(java.lang.String dataName) Echo the same EL function without evaluating anything
static java.lang.String	ph1_coord_databaseOut_echo(java.lang.String dataName)
static java.lang.String	ph1_coord_dataInPartitionFilter_echo(java.lang.String dataInName, java.lang.String type)
static java.lang.String	ph1_coord_dataInPartitionMax_echo(java.lang.String dataInName, java.lang.String partition)
static java.lang.String	ph1_coord_dataInPartitionMin_echo(java.lang.String dataInName, java.lang.String partition)
static java.lang.String	ph1_coord_dataInPartitions_echo(java.lang.String dataInName, java.lang.String type)
static java.lang.String	ph1_coord_dataOutPartitions_echo(java.lang.String dataOutName)
static java.lang.String	ph1_coord_dataOutPartitionValue_echo(java.lang.String dataOutName, java.lang.String partition)
static java.lang.String	ph1_coord_tableIn_echo(java.lang.String dataName)
static java.lang.String	ph1_coord_tableOut_echo(java.lang.String dataName)
static java.lang.String	ph3_coord_databaseIn(java.lang.String dataName) Extract the hcat DB name from the URI-template associate with 'dataInName'.
static java.lang.String	ph3_coord_databaseOut(java.lang.String dataName) Extract the hcat DB name from the URI-template associate with 'dataOutName'.
static java.lang.String	ph3_coord_dataInPartitionFilter(java.lang.String dataInName, java.lang.String type) Used to specify the HCat partition filter which is input dependency for workflow job. Look for two evaluator-level variables A) .datain. B) .datain..unresolved A defines the current list of HCat URIs.
static java.lang.String	ph3_coord_dataInPartitionMax(java.lang.String dataInName, java.lang.String partitionName) Used to specify the MINIMUM value of an HCat partition which is input dependency for workflow job. Look for two evaluator-level variables A) .datain. B) .datain..unresolved A defines the current list of HCat URIs.
static java.lang.String	ph3_coord_dataInPartitionMin(java.lang.String dataInName, java.lang.String partitionName) Used to specify the MAXIMUM value of an HCat partition which is input dependency for workflow job. Look for two evaluator-level variables A) .datain. B) .datain..unresolved A defines the current list of HCat URIs.
static java.lang.String	ph3_coord_dataInPartitions(java.lang.String dataInName, java.lang.String type) Used to specify the entire HCat partition defining input for workflow job.
static java.lang.String	ph3_coord_dataOutPartitions(java.lang.String dataOutName) Used to specify the entire HCat partition defining output for workflow job. Look for two evaluator-level variables A) .dataout. B) .dataout..unresolved A defines the data-out HCat URI.
static java.lang.String	ph3_coord_dataOutPartitionValue(java.lang.String dataOutName, java.lang.String partitionName) Used to specify the HCat partition's value defining output for workflow job. Look for two evaluator-level variables A) .dataout. B) .dataout..unresolved A defines the current list of HCat URIs.
static java.lang.String	ph3_coord_tableIn(java.lang.String dataName) Extract the hcat Table name from the URI-template associate with 'dataInName'.
static java.lang.String	ph3_coord_tableOut(java.lang.String dataName) Extract the hcat Table name from the URI-template associate with 'dataOutName'.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatELFunctions

public HCatELFunctions()

Method Detail

hcat_exists

public static boolean hcat_exists(java.lang.String uri)
                           throws java.lang.Exception

Return true if partitions exists or false if not.

Parameters:

uri - hcatalog partition uri.

Returns:

true if the uri exists, false if it does not.

Throws:

java.lang.Exception

ph1_coord_databaseIn_echo

public static java.lang.String ph1_coord_databaseIn_echo(java.lang.String dataName)

Echo the same EL function without evaluating anything

Parameters:

dataInName -

Returns:

the same EL function

ph1_coord_databaseOut_echo

public static java.lang.String ph1_coord_databaseOut_echo(java.lang.String dataName)

ph1_coord_tableIn_echo

public static java.lang.String ph1_coord_tableIn_echo(java.lang.String dataName)

ph1_coord_tableOut_echo

public static java.lang.String ph1_coord_tableOut_echo(java.lang.String dataName)

ph1_coord_dataInPartitionFilter_echo

public static java.lang.String ph1_coord_dataInPartitionFilter_echo(java.lang.String dataInName,
                                                    java.lang.String type)

ph1_coord_dataInPartitionMin_echo

public static java.lang.String ph1_coord_dataInPartitionMin_echo(java.lang.String dataInName,
                                                 java.lang.String partition)

ph1_coord_dataInPartitionMax_echo

public static java.lang.String ph1_coord_dataInPartitionMax_echo(java.lang.String dataInName,
                                                 java.lang.String partition)

ph1_coord_dataOutPartitions_echo

public static java.lang.String ph1_coord_dataOutPartitions_echo(java.lang.String dataOutName)

ph1_coord_dataInPartitions_echo

public static java.lang.String ph1_coord_dataInPartitions_echo(java.lang.String dataInName,
                                               java.lang.String type)

ph1_coord_dataOutPartitionValue_echo

public static java.lang.String ph1_coord_dataOutPartitionValue_echo(java.lang.String dataOutName,
                                                    java.lang.String partition)

ph3_coord_databaseIn

public static java.lang.String ph3_coord_databaseIn(java.lang.String dataName)

Extract the hcat DB name from the URI-template associate with 'dataInName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataInName -

Returns:

DB name

ph3_coord_databaseOut

public static java.lang.String ph3_coord_databaseOut(java.lang.String dataName)

Extract the hcat DB name from the URI-template associate with 'dataOutName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataOutName -

Returns:

DB name

ph3_coord_tableIn

public static java.lang.String ph3_coord_tableIn(java.lang.String dataName)

Extract the hcat Table name from the URI-template associate with 'dataInName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataInName -

Returns:

Table name

ph3_coord_tableOut

public static java.lang.String ph3_coord_tableOut(java.lang.String dataName)

Extract the hcat Table name from the URI-template associate with 'dataOutName'. Caller needs to specify the EL-evaluator level variable 'oozie.coord.el.dataset.bean' with synchronous dataset object (SyncCoordDataset)

Parameters:

dataOutName -

Returns:

Table name

ph3_coord_dataInPartitionFilter

public static java.lang.String ph3_coord_dataInPartitionFilter(java.lang.String dataInName,
                                               java.lang.String type)

Used to specify the HCat partition filter which is input dependency for workflow job.

Look for two evaluator-level variables

A) .datain. B) .datain..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the partition filter.

Parameters:

dataInName - : Datain name

type - : for action type - pig, MR or hive

ph3_coord_dataOutPartitionValue

public static java.lang.String ph3_coord_dataOutPartitionValue(java.lang.String dataOutName,
                                               java.lang.String partitionName)

Used to specify the HCat partition's value defining output for workflow job.

Look for two evaluator-level variables

A) .dataout. B) .dataout..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the partition value.

Parameters:

dataOutName - : Dataout name

partitionName - : Specific partition name whose value is wanted

ph3_coord_dataOutPartitions

public static java.lang.String ph3_coord_dataOutPartitions(java.lang.String dataOutName)

Used to specify the entire HCat partition defining output for workflow job.

Look for two evaluator-level variables

A) .dataout. B) .dataout..unresolved

A defines the data-out HCat URI.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the partition.

Parameters:

dataOutName - : DataOut name

ph3_coord_dataInPartitions

public static java.lang.String ph3_coord_dataInPartitions(java.lang.String dataInName,
                                          java.lang.String type)

Used to specify the entire HCat partition defining input for workflow job.

Look for two evaluator-level variables

A) .datain. B) .datain..unresolved

A defines the data-in HCat URI.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the partition.

Parameters:

dataInName - : DataIn name

type - : for action type: hive-export

ph3_coord_dataInPartitionMin

public static java.lang.String ph3_coord_dataInPartitionMin(java.lang.String dataInName,
                                            java.lang.String partitionName)

Used to specify the MAXIMUM value of an HCat partition which is input dependency for workflow job.

Look for two evaluator-level variables

A) .datain. B) .datain..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the max partition value.

Parameters:

dataInName - : Datain name

partitionName - : Specific partition name whose MAX value is wanted

ph3_coord_dataInPartitionMax

public static java.lang.String ph3_coord_dataInPartitionMax(java.lang.String dataInName,
                                            java.lang.String partitionName)

Used to specify the MINIMUM value of an HCat partition which is input dependency for workflow job.

Look for two evaluator-level variables

A) .datain. B) .datain..unresolved

A defines the current list of HCat URIs.

B defines whether there are any unresolved EL-function (i.e latest)

If there are something unresolved, this function will echo back the original function

otherwise it sends the min partition value.

Parameters:

dataInName - : Datain name

partitionName - : Specific partition name whose MIN value is wanted