Running Workflows
About Jobs
There are two ways you can submit jobs to a cluster: by using workflows or through any terminal or command-line interface. For the command-line interface option, please see Submitting Jobs via Slurm.
After you’ve started a cluster, navigate to the Workflows page and select the workflow you’d like to use. If you haven’t added any workflows, you can select one from the Marketplace.
When you click the name of your workflow, you'll be taken to the workflow's Runs tab. Click Execute Workflow.
The Execute page is where you enter the inputs used in the workflow.
In the Workflow Settings section, enter any necessary parameters. The example workflow pictured has only two test parameters, but your selected workflow may have more or fewer options.
In the Workflow Host section, select the running resource the job should be submitted to. In this example, we ran our workflow on AWS Cluster. Depending on the workflow, this section may also let you pick a partition, Slurm account, or PBS queue.
Click Execute.
You’ll be taken back to the workflow's Runs tab, where you can monitor your workflow's progress.
Each run shows its status and Runtime. Workflows that create larger or more complex jobs will show Running for longer periods of time before showing Completed.
Click a run, then click one of its steps, to open the log module with that step's output.
In this example, we ran a simple bash script that returns the running resource's hostname, so the log module displayed the following output:
Starting test workflow at Wed Jan 25 17:12:21 UTC 2023
INPUT ARGUMENTS:
Running on the following computer: pw-user-demo
This is a NO-OP workflow - nothing got launched remotely.
Done!
In addition to your workflow's output, logs also include start times and messages for job submissions, job completions, and job errors if any occur.
If you have the Workflow Runs widget on your Dashboard, it will also reflect your job's status.
From the Workflow Runs widget, you can click a run's number to open that run.
About Workflow Parameters
The example workflow used here has only two parameters meant for testing purposes. Many workflows on ACTIVATE have additional parameters, especially those that execute multiple or more complex tasks. If you need help with setting parameters, you can reach out to your admin or to us at any time.