Michael McQuade

Enhancements and Features​

Organization specified default sidebars​

Organizations can now define a default sidebar for new users. Users that have not customized their sidebar will automatically use the organization's default settings. If the organization does not specify a customized sidebar then all sidebar items will be visible by default.

Optional dns server​

Adds an optional DNS service to platform deployments which can resolve slurm cluster hostnames if needed

Add cli list for cluster, app, workflow, and session​

Add Email and Notify Allocation Alerts options to organization settings​

Added Cost Alert notification type and user preferences.

Snapshots show provisioned earlier than expected​

Add floating ip option to compute nodes​

Add floating ip association option to openstack compute nodes

Documentation Changes​

• Merge apps and workflows pages

Enhancements and Features​

Update openstack cluster definition page​

Added cluster cost estimation for openstack

Admin-only debug mode for cloud clusters​

Platform administrators can now toggle Debug Mode in cluster Advanced Settings section.

When turned on, users can ssh into the node without waiting for it to be ready using ssh root@<nodeip>. Can be done from the user workspace or user's personal computer (if public key is added in the platform). Node clean up will not happen if there is any error in provisioning.

Bug Fixes​

• Sidebar not always highlighting active item
• Apps shared to marketplace were not labeled as apps

Documentation Changes​

• Customizing the platform
• Improved API docs

Bug Fixes​

• Updated workflow yaml not reflected with page navigation
• Alphabetize IP address options
• Sessions started on shared clusters not working
• Icon not showing for sessions started from github workflow
• Root snapshots not in image list

Enhancements and Features​

Allow editing widget names on home page​

You can now edit widget names on home page. Click Customize and you will now see an edit icon next to the widgets name.

Bug Fixes​

• Creating a session with the same name as previous session results in wrong ports
• Sessions print wrong json field names to log

Enhancements and Features​

Added icons to sessions list​

Sessions that were created by workflows will now show the workflow icon next to the session

Remove resource monitor home page widget​

The resource monitor module has been removed from the front page. In order to not disturb saved layouts you will need to manually remove the module where the resource monitor was previously.

Add apps panel to home page​

You can now edit the workflow home page widget to change which workflow type to show. The default home page widgets have been updated to include the Favorite Apps and the Sessions widgets. Users that have modified their home page will not receive the new layout, and can instead add these widgets by choosing "Customize" from the top right of the home page.

Bug Fixes​

• Real time usage not counted for determining if cost dashboard should show
• Workflow sessions with slug have extra slash appended
• Cannot choose group when creating storage

Enhancements and Features​

Nfs list, attach-storage commands​

• Adds pw nfs ls command to the cli
  • This lists all of the nfs storages on a user's account
• Adds pw cluster attach-storage command to the cli
  • Required Flags: --cluster-uri, --storage-uri, --mount-point
  • This will attach the given storage to the given cluster at the given mountpoint
  • Does the same action as attaching the storage on the cluster definition page
  • The user will be able to see the attached storage on the cluster definition page after running the command sucessfully

nfs ls and cluster attach-storage commands​

You can now use the new pw nfs ls and pw cluster attach-storage commands from an authenticated cluster session.

Sessions home page module​

Sessions are now available as a home page module which can be added using the customize button on the home page.

Bug Fixes​

• Justify sidebar settings to the right

Enhancements and Features​

Add customizable sidebar​

Users can now customize the items that appear on their sidebar. In a future update, organizations will also be able to customize the default sidebars for users in their organization.

Azure OpenAI service available in feature preview​

Can now provision Azure OpenAI resources from within the platform and directly chat via the UI.

Bug Fixes​

• Custom thumbnails not showing
• Cannot expand logs
• Text overlaps on add resource page

Bug Fixes​

• Marketplace workflows get stuck on loading
• Uploaded thumbnails not showing
• Workflow input substitution not working on session properties

Enhancements and Features​

Promote apps/sessions to GA​

Apps and sessions are now generally available.

Apps provide a layer on top of workflows which make additional interfaces available for workflow developers to make interactive experiences easier. Sessions expose ports on compute resources to the browser so users can run interactive apps on their computing resources and access them directly via ACTIVATE.

Read our documentation for apps and sessions to learn more.

Bug Fixes​

• Long logs line numbers overlap logs

Documentation Changes​

• Add apps and sessions

Enhancements and Features​

Show running workflow steps while session is pending​

On a session's page, current running workflow steps will be shown while the session is pending.

Change default layout for home page​

We've updated the default layout of the home page. If you have not customized your home page, you will automatically be moved to the new default layout which shows:

• favorite workflows
• recent workflow runs
• favorite compute resources

To customize your layout, use the customize button at the top right of the home page. Note that users with a custom layout are not affected by this change.

Bug Fixes​

• Marketplace workflows with dots in name can now create sessions
• External auth UI doesn't fit compactly
• Saving cluster configuration gives an error if storage is attached
• Controller ip substituted incorrectly in workflow inputs
• Clusters can share one static ip address
• Whitespace not showing correctly in changelogs
• Ephemeral storage provision status does not update when persistent storage also attached
• Api key and token generation has slightly different UI

Documentation Changes​

• Document unique naming system

Enhancements and Features​

Update controller configuration for Amazon Linux support​

Support bootstrapping clusters that use the Amazon Linux 2 image

Bug Fixes​

• Unify border style
• Button is invisible on cloud platform

Enhancements and Features​

Allow adding images through platform​

Platform level slurm cluster images can be managed through the admin panel.

Allow setting default session names​

You can now set default session names on workflows:

session:
  mySession:
    prompt-for-name:
      default: "defaultname"

Allow job environment variables on workflows​

Allows setting environment variables on a job level. Environment variables set at a step level will override the environment variables set at a job level.

jobs:
  main:
    env:
      foo: "bar"
    steps:
      - run: echo ${foo} # bar
      - run: echo ${foo} # baz
         env: 
          foo: "baz" # will override env variable set on job level

Stop workflow run on session stop​

Stopping a session will now also stop the workflow run that started the session and any sessions associated with the workflow run.

Improve workflow update-session logs​

Logs and input validation for updating session has been improved.

Bug Fixes​

• Move health check below controller node configuration in provision status
• Cannot delete some old storage sessions
• Sessions not deleting after cancelling workflow run
• Cleanup step running when step is skipped due to if being false
• Show message about user workspace starting on workflows page

Enhancements and Features​

Support client_secret_basic token endpoint auth method​

There is now a dropdown on the OIDC auth method to allow choosing either client_secret_basic or client_secret_post. These auth methods are used for the platform to authenticate to the token endpoint after a successful OIDC user authentication.

Organization admins now can specify scopes for oidc​

Scopes can now be specified when adding or updating an OIDC auth method in organization settings.

Bug Fixes​

• Azure NetApp Files does not work on newly provisioned infrastructures
• Root disk snapshots times out before finishing
• Escape oidc redirect uris
• Validate group names meet constraints
• Random crash on home page
• Workflow inputs.sh has wrong format when using objects
• Workflow cleanup steps not running after canceling
• Workflow sessions not found if contains url params

Other Changes​

• Add docs section to changelogs

Enhancements and Features​

Add health check and storage logs into provision status UI​

• Health check is now moved into provision status list.
• Health check and ephemeral storage failure now also displays a View logs button to see the details of what happened.

Support manually providing oidc endpoints or using issuer to discover​

OIDC endpoints can now be manually provided instead of using the issuer to discover them. This makes the OIDC authentication method more flexible for cases where applications do not have a proper well-known endpoint or the well-known endpoint is behind a firewall but the other endpoints are not.

This update also has slight visual enhancements to the auth method page, with the "configure" button being changed to a link.

Support new provision status UX for Azure NetApp Files​

The new provisioning experience is live for Azure NetApp files.

Bug Fixes​

• Oidc edit page always clears userinfo endpoint
• Incorrect authentication endpoint used in oidc authentication
• Skip building libnss_cache and config nsswitch.conf when present in image

Other Changes​

• Add Sharing a Snapshot to Working With Disk Snapshots

Enhancements and Features​

Allow choosing export when hammerspace has multiple shares​

Adds an input box when attaching filesystems only for Hammerspace. This input allows users to define the export path the cluster will use to mount the hammerspace file share from.

Additional workflow features​

You can now specify remoteHost and slug when updating a session.

      - uses: parallelworks/update-session
        with:
          slug: 'string' // (optional) appends this slug to the session url
          remoteHost: 'string' // (optional) host to forward session to from the target, defaults to "localhost"
          ... other inputs

You can now also specify if the session will use TLS.

sessions:
  mySession: 
    useTLS: true // (optional) Will use https when connecting to session, should only be turned on if the app requires https.

Enhancements and Features​

Improve provision status UI for hammerspace​

Changes the Hammerspace provision status UI to only show the main components getting created, Anvil, DSX, DataNodes. Also adds deletion statuses.

Bug Fixes​

• Cost page crashes
• Remove extra padding on kubernetes pages
• Resource names should not be automatically capitalized
• Parallel workflow jobs not running
• Cannot create oidc auth method in another organization

Other Changes​

• Add quick connect instructions to logging in to controller page

Enhancements and Features​

Add provision status support for hammerspace​

• Add Provision Status UI for Hammerspace
• Fixes issue where the Hammerspace could not be deleted if it didn't have provision status

Bug Fixes​

• Double clicking add terminal maximizes terminal

Enhancements and Features​

Deletion records are now appended to provision records​

When a resource supports the new provisioning experience, you will now see the deletion records directly below the provisioning records in the provisioning status panel.

When provisioning Azure storage accounts, if a name was unavailable the provisioning would silently fail. You will now receive an error that the name is already in use in these cases. This update also fixes other minor issues and typographical problems with the new provisioning UI.

Bug Fixes​

• Non-bash shells cannot run commands
• Azure bucket "collecting variables" step spins forever

Enhancements and Features​

Provision status ui enhancements​

• Provision status UI now displays details of ansible bootstrap task that failed
• Ephemeral lustre filesystem and persistent disk attachment now also displayed, including error if any.

Add failed node to cluster data return endpoint​

Failed nodes are now also returned in cluster data. This is useful for workflow that need to know nodes provision status to make decision instead of waiting for slurm to time out

New provisioning UX promoted to GA​

The new provisioning experience is now generally available for our next-generation cloud clusters and most cloud storage options.

Promote next-gen cloud clusters to general availability​

Next-generation cloud clusters are now generally available. With this update, previous generation clusters will be marked with the text "Legacy".

Workspace mount tooltips​

Workspace mount points now have tooltips for substitutions

Bug Fixes​

• Org vars not populating on workflows

Enhancements and Features​

Ultra disk configuration for hammerspace​

Added inputs on Hammerspace configuration form that show up when selecting UltraSSD_LRS disks. These options are for configuring the IOPS and Mbps Throughput for all disks within the Hammerspace deployment.

Apps feature preview is now available​

All users can now enable the "apps" feature preview from the feature preview menu.

Bug Fixes​

• Run bootstrap when using azure os snapshot
• Some azure instance types cannot start slurm
• Unmount localdisk on hammerspace
• Correct options in fstab for hammerspace

Enhancements and Features​

Dependency graph summary info​

Adds a summary box above the workflow dependency graph

Cli can use tokens to authenticate with PW_API_KEY env variable​

Can use PW_API_KEY environment variable with tokens to authenticate

Identify-platform command​

Adds a command pw auth identify-platform to the CLI to help identify which platform host the CLI is configured to run commands against.

Make azure cluster nodes provisioning more stable​

Make nodes provisioning more stable for azure

Improved changelogs​

Introduced a new structure for the changelogs, where changes are categorized into three sections: Enhancements and Features, Bug Fixes, and Other Changes.

Bug Fixes​

• Cost page crashing
• Compute nodes retry-provision always fails
• Ansible packages installation sometimes fails
• Azure regular image id doesnt work
• Attached disk is not working properly in v2 clusters definition
• Cannot type number that is less than minimum into input
• Filesystem attachment form doesnt work properly when cluster is on