org.apache.oozie.dependency.hcat

Interface HCatDependencyCache

All Known Implementing Classes:

EhcacheHCatDependencyCache, SimpleHCatDependencyCache

public interface HCatDependencyCache

Method Summary

Methods

Modifier and Type	Method and Description
void	addMissingDependency(org.apache.oozie.util.HCatURI hcatURI, java.lang.String actionID) Add a missing partition dependency and the actionID waiting on it
void	destroy() Destroy the cache
java.util.Collection<java.lang.String>	getAvailableDependencyURIs(java.lang.String actionID) Get a list of available dependency URIs for a actionID
java.util.Collection<java.lang.String>	getWaitingActions(org.apache.oozie.util.HCatURI hcatURI) Get the list of actionIDs waiting for a partition
void	init(org.apache.hadoop.conf.Configuration conf) Initialize the cache with configuration
java.util.Collection<java.lang.String>	markDependencyAvailable(java.lang.String server, java.lang.String db, java.lang.String table, java.util.Map<java.lang.String,java.lang.String> partitions) Mark a partition dependency as available
boolean	removeAvailableDependencyURIs(java.lang.String actionID, java.util.Collection<java.lang.String> dependencyURIs) Remove the list of available dependency URIs for a actionID once the missing dependencies are processed.
void	removeCoordActionWithDependenciesAvailable(java.lang.String coordAction) Remove coordAction when all dependencies met
boolean	removeMissingDependency(org.apache.oozie.util.HCatURI hcatURI, java.lang.String actionID) Remove a missing partition dependency associated with a actionID
void	removeNonWaitingCoordActions(java.util.Set<java.lang.String> coordActions) Purge stale actions

Method Detail

init

void init(org.apache.hadoop.conf.Configuration conf)

Initialize the cache with configuration

Parameters:

conf - configuration

addMissingDependency

void addMissingDependency(org.apache.oozie.util.HCatURI hcatURI,
                        java.lang.String actionID)

Add a missing partition dependency and the actionID waiting on it

Parameters:

hcatURI - dependency URI

actionID - ID of action which is waiting for the dependency

removeMissingDependency

boolean removeMissingDependency(org.apache.oozie.util.HCatURI hcatURI,
                              java.lang.String actionID)

Remove a missing partition dependency associated with a actionID

Parameters:

hcatURI - dependency URI

actionID - ID of action which is waiting for the dependency

Returns:

true if successful, else false

getWaitingActions

java.util.Collection<java.lang.String> getWaitingActions(org.apache.oozie.util.HCatURI hcatURI)

Get the list of actionIDs waiting for a partition

Parameters:

hcatURI - dependency URI

Returns:

list of actionIDs

markDependencyAvailable

java.util.Collection<java.lang.String> markDependencyAvailable(java.lang.String server,
                                                             java.lang.String db,
                                                             java.lang.String table,
                                                             java.util.Map<java.lang.String,java.lang.String> partitions)

Mark a partition dependency as available

Parameters:

server - host:port of the server

db - name of the database

table - name of the table

partitions - list of available partitions

Returns:

list of actionIDs for which the dependency is now available

getAvailableDependencyURIs

java.util.Collection<java.lang.String> getAvailableDependencyURIs(java.lang.String actionID)

Get a list of available dependency URIs for a actionID

Parameters:

actionID - action id

Returns:

list of available dependency URIs

removeAvailableDependencyURIs

boolean removeAvailableDependencyURIs(java.lang.String actionID,
                                    java.util.Collection<java.lang.String> dependencyURIs)

Remove the list of available dependency URIs for a actionID once the missing dependencies are processed.

Parameters:

actionID - action id

dependencyURIs - set of dependency URIs

Returns:

true if successful, else false

destroy

void destroy()

Destroy the cache

removeNonWaitingCoordActions

void removeNonWaitingCoordActions(java.util.Set<java.lang.String> coordActions)

Purge stale actions

removeCoordActionWithDependenciesAvailable

void removeCoordActionWithDependenciesAvailable(java.lang.String coordAction)

Remove coordAction when all dependencies met