staRburst Future Backend — plan.starburst • starburst

A future backend for running parallel R workloads on AWS Fargate

Usage

# S3 method for class 'starburst'
plan(
  strategy,
  workers = 10,
  cpu = 4,
  memory = "8GB",
  region = NULL,
  timeout = 3600,
  auto_quota_request = interactive(),
  launch_type = "FARGATE",
  instance_type = "c7g.xlarge",
  use_spot = FALSE,
  warm_pool_timeout = 3600,
  detached = FALSE,
  ...
)

Arguments

strategy: The starburst strategy marker (ignored, for S3 dispatch)
workers: Number of parallel workers
cpu: vCPUs per worker (1, 2, 4, 8, or 16)
memory: Memory per worker (supports GB notation, e.g., "8GB")
region: AWS region (default: from config or "us-east-1")
timeout: Maximum runtime in seconds (default: 3600)
auto_quota_request: Automatically request quota increases (default: interactive())
launch_type: Launch type: FARGATE or EC2 (default: FARGATE)
instance_type: EC2 instance type when using EC2 launch type (default: c7g.xlarge)
use_spot: Use EC2 Spot instances for cost savings (default: FALSE)
warm_pool_timeout: Timeout for warm pool in seconds (default: 3600)
detached: Use detached session mode (deprecated, use starburst_session instead)
...: Additional arguments passed to future backend

Value

A future plan object

Examples

if (FALSE) { # \dontrun{
library(furrr)
plan(starburst, workers = 50)
results <- future_map(1:1000, expensive_function)
} # }