Skip to contents

A future backend for running parallel R workloads on AWS ECS

Usage

StarburstBackend(
  workers = 10,
  cpu = 4,
  memory = "8GB",
  region = NULL,
  timeout = 3600,
  launch_type = "EC2",
  instance_type = "c6a.large",
  use_spot = FALSE,
  warm_pool_timeout = 600,
  ...
)

Arguments

workers

Number of parallel workers

cpu

vCPUs per worker (1, 2, 4, 8, or 16)

memory

Memory per worker (supports GB notation, e.g., "8GB")

region

AWS region (default: from config or "us-east-1")

timeout

Maximum runtime in seconds (default: 3600)

launch_type

"EC2" or "FARGATE" (default: "EC2")

instance_type

EC2 instance type (e.g., "c6a.large")

use_spot

Use spot instances (default: FALSE)

warm_pool_timeout

Seconds to keep the EC2 pool warm after the plan ends (default: 600)

...

Additional arguments

Value

A StarburstBackend object

Details

You do not normally call this constructor yourself: plan(starburst, ...) creates the backend for you (see plan.starburst, whose defaults are the ones users see). It is exported as an extension point for code that builds on the future backend API.

See also