org.opentripplanner.analyst.cluster

Class AnalystWorker

java.lang.Object

org.opentripplanner.analyst.cluster.AnalystWorker

All Implemented Interfaces:

Runnable

public class AnalystWorker
extends Object
implements Runnable

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AnalystWorker.WorkType

Field Summary

Fields

Modifier and Type	Field and Description
boolean	autoShutdown should this worker shut down automatically
int	dryRunFailureRate If this value is non-negative, the worker will not actually do any work.
static String	machineId worker ID - just a random ID so we can differentiate machines used for computation.
static int	POLL_TIMEOUT
static Random	random
static int	SINGLE_POINT_KEEPALIVE How long (minimum, in milliseconds) should this worker stay alive after receiving a single point request?
static String	WORKER_ID_HEADER

Constructor Summary

Constructors

Constructor and Description
AnalystWorker(Properties config)

Method Summary

Modifier and Type	Method and Description
void	deleteRequest(AnalystClusterRequest clusterRequest) Tell the broker that the given message has been successfully processed by a worker (HTTP DELETE).
void	finishPriorityTask(AnalystClusterRequest clusterRequest, Object result) Signal the broker that the given high-priority task is completed, providing a result.
String	getInstanceType() Get the AWS instance type if applicable
List<AnalystClusterRequest>	getSomeWork(AnalystWorker.WorkType type)
static void	main(String[] args) Requires a worker configuration, which is a Java Properties file with the following attributes.
void	run() This is the main worker event loop which fetches tasks from a broker and schedules them for execution.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

machineId

public static final String machineId

worker ID - just a random ID so we can differentiate machines used for computation. Useful to isolate the logs from a particular machine, as well as to evaluate any variation in performance coming from variation in the performance of the underlying VMs. This needs to be static so the logger can access it; see the static member class WorkerIdDefiner. A side effect is that only one worker can run in a given JVM. It also needs to be defined before the logger is defined, so that it is initialized before the logger is.

WORKER_ID_HEADER

public static final String WORKER_ID_HEADER

See Also:

Constant Field Values

POLL_TIMEOUT

public static final int POLL_TIMEOUT

See Also:

Constant Field Values

dryRunFailureRate

public int dryRunFailureRate

If this value is non-negative, the worker will not actually do any work. It will just report all tasks as completed immediately, but will fail to do so on the given percentage of tasks. This is used in testing task re-delivery and overall broker sanity.

SINGLE_POINT_KEEPALIVE

public static final int SINGLE_POINT_KEEPALIVE

How long (minimum, in milliseconds) should this worker stay alive after receiving a single point request?

See Also:

Constant Field Values

autoShutdown

public final boolean autoShutdown

should this worker shut down automatically

random

public static final Random random

Constructor Detail

AnalystWorker

public AnalystWorker(Properties config)

Method Detail

run

public void run()

This is the main worker event loop which fetches tasks from a broker and schedules them for execution. It maintains a small local queue on the worker so that it doesn't idle while fetching new tasks.

Specified by:

run in interface Runnable

getSomeWork

public List<AnalystClusterRequest> getSomeWork(AnalystWorker.WorkType type)

finishPriorityTask

public void finishPriorityTask(AnalystClusterRequest clusterRequest,
                               Object result)

Signal the broker that the given high-priority task is completed, providing a result.

deleteRequest

public void deleteRequest(AnalystClusterRequest clusterRequest)

Tell the broker that the given message has been successfully processed by a worker (HTTP DELETE).

getInstanceType

public String getInstanceType()

Get the AWS instance type if applicable

main

public static void main(String[] args)

Requires a worker configuration, which is a Java Properties file with the following attributes. broker-address address of the broker, without protocol or port broker port port broker is running on, default 80. graphs-bucket S3 bucket in which graphs are stored. pointsets-bucket S3 bucket in which pointsets are stored auto-shutdown Should this worker shut down its machine if it is idle (e.g. on throwaway cloud instances) statistics-queue SQS queue to which to send statistics (optional) initial-graph-id The graph ID for this worker to start on