AWS Batch launcher class

AWS Batch launcher R6 class

Details

See crew_launcher_aws_batch().

IAM policies

In order for the AWS Batch crew plugin to function properly, your IAM policy needs permission to perform the SubmitJob and TerminateJob AWS Batch API calls. For more information on AWS policies and permissions, please visit https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies.html.

AWS arguments

The AWS Batch controller and launcher accept many arguments which start with "aws_batch_". These arguments are AWS-Batch-specific parameters forwarded directly to the submit_job() method for the Batch client in the paws.compute R package

For a full description of each argument, including its meaning and format, please visit https://www.paws-r-sdk.com/docs/batch_submit_job/. The upstream API documentation is at https://docs.aws.amazon.com/batch/latest/APIReference/API_SubmitJob.html and the analogous CLI documentation is at https://docs.aws.amazon.com/cli/latest/reference/batch/submit-job.html.

The actual argument names may vary slightly, depending on which : for example, the aws_batch_job_definition argument of the crew AWS Batch launcher/controller corresponds to the jobDefinition argument of the web API and paws.compute::batch()$submit_job(), and both correspond to the --job-definition argument of the CLI.

Verbosity

Control verbosity with the paws.log_level global option in R. Set to 0 for minimum verbosity and 3 for maximum verbosity.

See also

Other plugin_aws_batch: crew_controller_aws_batch(), crew_launcher_aws_batch()

Super class

crew::crew_class_launcher -> crew_class_launcher_aws_batch

Active bindings

options_aws_batch

See crew_launcher_aws_batch().

Methods

Public methods

• crew_class_launcher_aws_batch$new()

• crew_class_launcher_aws_batch$validate()

• crew_class_launcher_aws_batch$launch_workers()

Inherited methods

• crew::crew_class_launcher$call()
• crew::crew_class_launcher$crashes()
• crew::crew_class_launcher$launch()
• crew::crew_class_launcher$launch_worker()
• crew::crew_class_launcher$poll()
• crew::crew_class_launcher$scale()
• crew::crew_class_launcher$set_name()
• crew::crew_class_launcher$settings()
• crew::crew_class_launcher$start()
• crew::crew_class_launcher$terminate()
• crew::crew_class_launcher$terminate_workers()

---

Method new()

Abstract launcher constructor.

Usage

crew_class_launcher_aws_batch$new(
  name = NULL,
  workers = NULL,
  seconds_interval = NULL,
  seconds_timeout = NULL,
  seconds_launch = NULL,
  seconds_idle = NULL,
  seconds_wall = NULL,
  tasks_max = NULL,
  tasks_timers = NULL,
  reset_globals = NULL,
  reset_packages = NULL,
  reset_options = NULL,
  garbage_collection = NULL,
  tls = NULL,
  processes = NULL,
  r_arguments = NULL,
  options_metrics = NULL,
  options_aws_batch = NULL
)

Arguments

name

See crew_launcher_aws_batch().

workers

See crew_launcher_aws_batch().

seconds_interval

See crew_launcher_aws_batch().

seconds_timeout

See crew_launcher_aws_batch().

seconds_launch

See crew_launcher_aws_batch().

seconds_idle

See crew_launcher_aws_batch().

seconds_wall

See crew_launcher_aws_batch().

tasks_max

See crew_launcher_aws_batch().

tasks_timers

See crew_launcher_aws_batch().

reset_globals

Deprecated. See crew_launcher_aws_batch().

reset_packages

Deprecated. See crew_launcher_aws_batch().

reset_options

Deprecated. See crew_launcher_aws_batch().

garbage_collection

Deprecated. See crew_launcher_aws_batch().

tls

See crew_launcher_aws_batch().

processes

See crew_launcher_aws_batch().

r_arguments

See crew_launcher_aws_batch().

options_metrics

See crew_launcher_aws_batch().

options_aws_batch

See crew_launcher_aws_batch().

Returns

An abstract launcher object.

---

Method validate()

Validate the launcher.

Usage

crew_class_launcher_aws_batch$validate()

Returns

NULL (invisibly). Throws an error if a field is invalid.

---

Method launch_workers()

Launch a local process worker which will dial into a socket.

Usage

crew_class_launcher_aws_batch$launch_workers(call, n)

Arguments

call

Character string, a namespaced call to crew::crew_worker() which will run in the worker and accept tasks.

n

Integer of length 1, number of workers to launch in the array job for the current round of auto-scaling.

Details

The call argument is R code that will run to initiate the worker.

Returns

A handle object to allow the termination of the worker later on.