pw workers create

Pre-provision a compute worker

Synopsis

The pw workers create command submits a scheduler job that pre-provisions a compute worker, so sessions can start on it without waiting in the queue. Start a session on it with pw session create --worker.

The cluster can be given as pw://user/cluster, pw://cluster or cluster, where an omitted user defaults to your username.

Pass --environment to schedule the worker onto an environment, which determines the partition and validates --param values against the environment's schema. Run pw environments get to see which parameters an environment accepts.

Scheduling is queued, so the command returns as soon as the job is submitted. Use --wait to wait for the worker's job to run and its tunnel to connect.

pw workers create <cluster> [flags]

Examples

  pw workers create --environment gpu-large my-hpc
  
  # Request two nodes for a longer wall time
  pw workers create --environment gpu-large --param numNodes=2 --param walltime=04:00:00 my-hpc
  
  # Pre-provision on a partition directly, without an environment
  pw workers create --partition gpu my-hpc
  
  # Wait for the worker to be ready
  pw workers create --environment gpu-large --wait my-hpc

Options

      --environment string   Environment to schedule the worker onto, by name or ID
  -h, --help                 help for create
      --param stringArray    Scheduling parameter as key=value (repeatable)
      --partition string     Scheduler partition to use when no environment is given
      --wait                 Wait for the worker to connect before exiting

Options inherited from parent commands

      --context string         The context to use. Overrides PW_CONTEXT environment variable and current context from config.
      --platform-host string   The Parallel Works ACTIVATE platform host to use. Overrides PW_PLATFORM_HOST environment variable and the current context's server.
  -v, --verbose                Enable verbose logging

pw workers create