org.apache.oozie.dependency.hcat

Class SimpleHCatDependencyCache

java.lang.Object

org.apache.oozie.dependency.hcat.SimpleHCatDependencyCache

All Implemented Interfaces:

HCatDependencyCache

public class SimpleHCatDependencyCache
extends Object
implements HCatDependencyCache

Field Summary

Fields

Modifier and Type	Field and Description
static String	USE_CANONICAL_HOSTNAME

Constructor Summary

Constructors

Constructor and Description
SimpleHCatDependencyCache()

Method Summary

Modifier and Type	Method and Description
void	addMissingDependency(HCatURI hcatURI, String actionID) Add a missing partition dependency and the actionID waiting on it
String	canonicalizeHostname(String name)
static String	canonicalizeHostname(String name, boolean useCanonicalHostName)
void	destroy() Destroy the cache
Collection<String>	getAvailableDependencyURIs(String actionID) Get a list of available dependency URIs for a actionID
Collection<String>	getWaitingActions(HCatURI hcatURI) Get the list of actionIDs waiting for a partition
void	init(org.apache.hadoop.conf.Configuration conf) Initialize the cache with configuration
Collection<String>	markDependencyAvailable(String server, String db, String table, Map<String,String> partitions) Mark a partition dependency as available
boolean	removeAvailableDependencyURIs(String actionID, Collection<String> dependencyURIs) Remove the list of available dependency URIs for a actionID once the missing dependencies are processed.
void	removeCoordActionWithDependenciesAvailable(String coordAction) Remove coordAction when all dependencies met
boolean	removeMissingDependency(HCatURI hcatURI, String actionID) Remove a missing partition dependency associated with a actionID
void	removeNonWaitingCoordActions(Set<String> coordActions) Purge stale actions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

USE_CANONICAL_HOSTNAME

public static final String USE_CANONICAL_HOSTNAME

See Also:

Constant Field Values

Constructor Detail

SimpleHCatDependencyCache

public SimpleHCatDependencyCache()

Method Detail

init

public void init(org.apache.hadoop.conf.Configuration conf)

Description copied from interface: HCatDependencyCache

Initialize the cache with configuration

Specified by:

init in interface HCatDependencyCache

Parameters:

conf - configuration

addMissingDependency

public void addMissingDependency(HCatURI hcatURI,
                                 String actionID)

Description copied from interface: HCatDependencyCache

Add a missing partition dependency and the actionID waiting on it

Specified by:

addMissingDependency in interface HCatDependencyCache

Parameters:

hcatURI - dependency URI

actionID - ID of action which is waiting for the dependency

removeMissingDependency

public boolean removeMissingDependency(HCatURI hcatURI,
                                       String actionID)

Description copied from interface: HCatDependencyCache

Remove a missing partition dependency associated with a actionID

Specified by:

removeMissingDependency in interface HCatDependencyCache

Parameters:

hcatURI - dependency URI

actionID - ID of action which is waiting for the dependency

Returns:

true if successful, else false

getWaitingActions

public Collection<String> getWaitingActions(HCatURI hcatURI)

Description copied from interface: HCatDependencyCache

Get the list of actionIDs waiting for a partition

Specified by:

getWaitingActions in interface HCatDependencyCache

Parameters:

hcatURI - dependency URI

Returns:

list of actionIDs

markDependencyAvailable

public Collection<String> markDependencyAvailable(String server,
                                                  String db,
                                                  String table,
                                                  Map<String,String> partitions)

Description copied from interface: HCatDependencyCache

Mark a partition dependency as available

Specified by:

markDependencyAvailable in interface HCatDependencyCache

Parameters:

server - host:port of the server

db - name of the database

table - name of the table

partitions - list of available partitions

Returns:

list of actionIDs for which the dependency is now available

getAvailableDependencyURIs

public Collection<String> getAvailableDependencyURIs(String actionID)

Description copied from interface: HCatDependencyCache

Get a list of available dependency URIs for a actionID

Specified by:

getAvailableDependencyURIs in interface HCatDependencyCache

Parameters:

actionID - action id

Returns:

list of available dependency URIs

removeAvailableDependencyURIs

public boolean removeAvailableDependencyURIs(String actionID,
                                             Collection<String> dependencyURIs)

Description copied from interface: HCatDependencyCache

Remove the list of available dependency URIs for a actionID once the missing dependencies are processed.

Specified by:

removeAvailableDependencyURIs in interface HCatDependencyCache

Parameters:

actionID - action id

dependencyURIs - set of dependency URIs

Returns:

true if successful, else false

destroy

public void destroy()

Description copied from interface: HCatDependencyCache

Destroy the cache

Specified by:

destroy in interface HCatDependencyCache

removeNonWaitingCoordActions

public void removeNonWaitingCoordActions(Set<String> coordActions)

Description copied from interface: HCatDependencyCache

Purge stale actions

Specified by:

removeNonWaitingCoordActions in interface HCatDependencyCache

Parameters:

coordActions - the actions to purge

removeCoordActionWithDependenciesAvailable

public void removeCoordActionWithDependenciesAvailable(String coordAction)

Description copied from interface: HCatDependencyCache

Remove coordAction when all dependencies met

Specified by:

removeCoordActionWithDependenciesAvailable in interface HCatDependencyCache

Parameters:

coordAction - the actions to remove

canonicalizeHostname

public String canonicalizeHostname(String name)

canonicalizeHostname

public static String canonicalizeHostname(String name,
                                          boolean useCanonicalHostName)