Michael McQuade

Enhancements and Features​

Refreshed tabbed UI on storage pages​

We've refreshed the layout slightly on the storage pages to align them with the rest of the interface throughout ACTIVATE.

Bug Fixes​

• prompt-for-name workflow session field does not trigger prompt

Enhancements and Features​

Copy azure snapshot to another region​

Users can now copy Azure snapshots to another region from within ACTIVATE.

Autofill defaults when clicking add workspace mounts​

We now autofill default values when adding a workspace mount to make it easier to understand what values to use for each input box.

Bug Fixes​

• Legacy cluster resource account dropdown not populating correctly
• Add oidc icon to login providers
• Incorrect zone shown when creating new Azure cluster
• Workflow graph reset button is black
• Forking a remote workflow does not fork the latest version
• Workflow run page intermittently crashes
• Using snapshots for azure compute nodes
• Sparse checkout not showing
• Connecting to multiple existing clusters with "autoreconnect" can take a long time
• Daily scale down not running if set to more than 1 day

Documentation Changes​

• Sorted aws s3 policies
• Add docs for multizone

Bug Fixes​

• Can't select google capacity reservation

Enhancements and Features​

Can open terminal in new tab​

You can now open the terminal in a new window that doesn't show the rest of the ACTIVATE UI frame.

Can navigate inbox with keyboard​

You can now navigate the inbox page with your keyboard up and down arrows as well as use the backspace button for deleting messages.

Bug Fixes​

• Storages cannot be shared to all groups
• Kubernetes target on home page sessions widget goes to 404
• Tabs wrapping incorrectly on small window sizes
• Snapshots filter does not work

Enhancements and Features​

Apps are now determined based on YAML definition​

Local Apps are now determined based on if the app property is found inside of the workflow YAML definition.

You can make a workflow show up on the apps list by simply adding the following to any workflow definition:

app:

Copy AWS snapshots to another region​

Users can now copy AWS snapshots to another region from within ACTIVATE.

Retroactively assign reservation cost to groups​

After capacity reservations are added or updated from the organization settings, the reservation's past cost data will also be assigned to the newly designated group.

Custom AI chat providers​

You can now connect any OpenAI-compatible API directly to the ACTIVATE interface using your own authentication tokens.

This lets you chat with models from your chosen provider while keeping full control over your usage and data. Chat history is saved securely within our platform, so you can easily continue previous conversations or reference them later.

Support includes in strings​

Workflows can now check if a value includes a string with the following syntax

 ${{ inputs.name includes 'foo' }}

Bug Fixes​

• Connecting to an existing cluster immediately after saving uses previous configuration
• Potential deletion of incorrect route53 records
• Shortcuts not centered
• Some text fields don't have borders

Enhancements and Features​

Allow multizone on aws partitions​

MultiZone option has been added to partition settings when configuring an AWS cluster. This will allow provisioning compute nodes in multiple zones in the case that there is not enough capacity in one zone.

Impersonate users from organization users list​

Platform admins can now impersonate users from the organization users list, in addition to the platform users list.

Bug Fixes​

• Can not update user in another org as platform admin
• Password field overlaps other fields on bulk import

Bug Fixes​

• Token/apikey displayed vertically instead of horziontally

Bug Fixes​

• Show message when home page widgets need to be configured
• Long workflow names overlap other workflows
• Cluster connection string not vertically centered
• Cost dashboard dropdowns not showing value
• Workflows on home page widget not all the same size
• Storage cannot be saved from properties page
• Can't change group on cost dashboard
• Some whitelabeling styles are missing

Documentation Changes​

• Move ML Workspace docs to top level
• Add note about ML Workspace availability

Bug Fixes​

• Creating a workflow always adds one empty tag
• Apps without saved configurations cannot be run

Enhancements and Features​

Home page cluster list enhancements​

The cluster list home page widget has been enhanced to have four modes:

• my
• shared
• all
• single

Setting clusters to my mimics the old behavior where only your own clusters are shown in the list. shared is only other user's clusters which have been shared with a group you're in. all is every cluster you have access to (both my and shared). single always shows a single cluster.

Conditional workflow jobs​

You can now use the if field at the job level to completely skip the job and all of its steps.

Enhancements and Features​

Add kubernetes clusters widget to homepage​

You can now add a kubernetes widget to your home page, listing all available kubernetes clusters.

Kubernetes workloads widget​

Kubernetes workload widgets can now be added to the home page. This lets you see the workloads for a chosen cluster/namespace combination from the home page. Additionally, we've slightly adjusted the styles of the clusters widget so one cluster exactly fits a 2x1 widget.

Apps now shown in workflow list​

Apps are really just workflows with some added features to make them easier to use. Before, if you wanted to see the workflow behind an app, you had to go to the apps page and look for the "Go to workflow" option. Now, we've made it easier. You can find the app's workflow right in the main workflow list, too.

Bug Fixes​

• Cannot renew proxy certificates
• Skip job if all of its steps are skipped
• Clusters could be named with invalid characters in some cases

Enhancements and Features​

Kubernetes cost management plugin provisioning status UI​

You can now track the deployment progress of the kubernetes cost management plugin via the UI.

Bug Fixes​

• AWS compute nodes mounting EFS filesystems were not mounting with same-zone mount points
• Footer overlaps login panel on some screen sizes
• Cli bucket ls command not working

Enhancements and Features​

Custom kubernetes icons​

You can now specify an icon for kubernetes clusters

Bug Fixes​

• Widgets cannot be added to home page when it has empty layout
• No link to org login page when platform only has password login
• Cluster config page group field does not autoselect

Bug Fixes​

• Display name is unset when saving legacy cluster

Enhancements and Features​

Allow multizone partitions on Google clusters​

MultiZone option has been added to partition settings when configuring a cluster. This will allow creation of compute nodes across multiple zones. This can be useful if trying to use an instance with high demand or low capacity in certain zones. Note that If nodes are created across zones there will be additional data charges when transferring data between nodes in different zones.

AWS Sagemaker integration​

AWS Sagemaker is now available in feature preview under the machine learning section

Bug Fixes​

• Cannot update "Keep Container Alive" and "No seat" options on users
• Workflow page shows undefined while loading
• Using certain dropdowns on workflows caused page to crash
• Workflows and apps show warning when user workspace is not running
• Sessions widget scrollbar isn't at bottom of widget
• Dropdowns with long text not shrinking correctly
• Deleting a partition from json viewer causes page to fail
• Dropdown autoselect not working when using categories
• Legacy clusters without display names cannot be saved

Bug Fixes​

• Cluster definition not saving when tags, display name or description left empty

Enhancements and Features​

Add support for AWS region eu-west-3​

Organizations can now create infrastructure in eu-west-3 (France).

Support env at job and global level​

In workflows, environment variables can now be defined at the global, job, and step levels. Previously, they could only be set at the step level. Precedence is hierarchical: the closer the variable is defined to the step, the higher its priority.

AI Chat message streaming​

AI Chat messages are now streamed to provide a more responsive experience.

Bug Fixes​

• Workflow list doesn't show loading workspace when workspace is down
• Kubernetes clusters do not display MIG configuration
• Clusters with deleted groups cannot be destroyed
• No breadcrumbs on cluster sessions page
• Clicking inside tooltip selects other checkbox on organization settings page
• Cannot duplicate remote workflows

Enhancements and Features​

Savable app configurations​

Now you can select a configuration from the app launcher to launch an app with a predefined set of inputs.

Target tags are a new concept which correspond to the tags on computing resources, marking a compute resource as compatible with a given app configuration.

Configurations can be saved by filling out the workflow form and saving it as a configuration, or can be provided by the workflow developer as built-in configuration. This is done in the "Build" tab of a workflow by editing the yaml. These built-in configurations can be selected from dropdown and are also shown in the configurations tab, just like manually saved configurations.

Allow org member to get group allocation used​

Organization members can now user teams endpoint to get their group's allocation used

Display helm charts​

Can now see the helm charts deployed into the selected namespace for the Kubernetes cluster

Helm chart details and rollback​

You can now see the details for helm charts installed in your kubernetes clusters. Additionally, you can rollback helm revisions directly from the ACTIVATE interface.

Bug Fixes​

• Disconnected workspace message on terminal disappears too quickly
• Attach session slug to subdomain
• Underscores in subdomain cause problems for some workflows
• Prevent trying to start existing cluster if user workspace is down
• UseTLS not working in sessions with custom domains
• Gray section is showed when clicking follow on log viewer
• Unable to start cluster is user workspace is down
• Sessions table has link to workflow on shared sessions
• Pressing back after logging in brings you back to the login page
• Missing zones on AWS eu-north-1 region
• User workspace terminal intermittently disconnects

Documentation Changes​

• Update base infra docs for AWS explaining networking modes

Enhancements and Features​

AI Chat conversation history​

Conversations with AI Chat providers are now saved, so you can continue previous chats at a later time.

AWS public IP networking mode​

This introduces a new networking mode when provisioning organizational base infrastructure. This provides compute nodes with their own public IP addresses. This is useful in cases where you want egress charges to be billed to the same group as a cluster instead of being absorbed as an organizational cost. The security group that is attached to compute nodes will block inbound access from internet but will allow traffic from other compute nodes.

Bug Fixes​

• No groups on kube or nfs commands, add alias for kube (k8s, kubernetes)
• Cannot edit kubernetes cluster
• Scrollbar missing on logs viewer, line numbers sometimes cut off

Bug Fixes​

• Aws efs and fsx provision fails when there are no private subnets in base infrastructure

Enhancements and Features​

Add gpu filter to instance selector​

Users can now filter instances by whether or not they have a GPU

Add billing alerts​

Admin user can now subscribe to billing alerts

Support nvidia.com/gpu in kubernetes resource quotas​

Organization administrators can now define resource quotas for GPU resources labeled with nvidia.com/gpu

List pods on workload details page​

On the details page for a workload, there will be a list of all the pods associated to that workload with links to the individual pod details page.

Allow resources to be provisioned in eu-central-1 region on aws​

Organization admins can now provision base infrastructure in the eu-central-1 region on AWS.

Ability to see the logs for pods​

Users can now monitor and download logs for actively running Kubernetes pods

Bug Fixes​

• Tooltips are hidden under text box for kubernetes cluster creation page
• Ephemeral storage has off status in attached storage panel
• Extend Azure Managed Lustre timeout to 60 minutes
• Cannot provision azure managed lustre before moving the size slider

Documentation Changes​

• Add instructions to create a manual session
• Add blog post for Q1 of 2025

Enhancements and Features​

Add architecture and networking feature filter to instance selector​

You can now filter instances by architecture and networking feature on instances list when selecting an instance for a cluster.

Ability to share resource with any group within organization​

We've found that the sharing feature had limited usefulness because previously you had to be a member of both groups to share a resource. Now, you will be able to share with any group inside of the same organization, regardless of your personal group membership.

Bug Fixes​

• Cannot create netapp ontap storages due to name validation failure

Bug Fixes​

• Remove redundant line in usage alert template
• Storages could not be started unless legacy and current providers are enabled

Bug Fixes​

• Can't scroll quick connect when you have many clusters
• Removed escape sequences showing up on terminals after using interactive program like vim
• User notifications settings by default are misleading
• Logs from older sessions of clusters that share the same name can appear in newer cluster sessions
• Compute resource job monitor shows jobs no longer in the queue

Bug Fixes​

• Log viewer expand does not work on provision status modal
• Bootstrap can fail if link command fails
• Remove inconsistent session number padding
• Instance selector has double scrollbar
• Marketplace descriptions can overflow their container
• Existing cluster save while connected needs confirmation
• Tooltips sometimes under textboxes and improve kubernetes error messages

Enhancements and Features​

Node detail page​

A new Nodes tab has been added on a clusters information page. This tab will list all current pending, active, and failed nodes. Clicking on a node from the list will show details for that node.

Add windows support to CLI​

You can now install the PW CLI on Windows.

Bug Fixes​

• Rerunning a workflow run would not populate inputs
• Workflow display name is not used in running notification

Documentation Changes​

• Add a page for Creating OS Snapshots

Enhancements and Features​

Add display name to storage creation page​

User can now input display name in storage creation page

Add ability for popover drawers to be resized​

• Added resize handle to JSON tab for v3 clusters

Bug Fixes​

• Cannot add/remove ssh private keys for existing clusters

Documentation Changes​

• Merge Buckets pages into one page

Enhancements and Features​

Cluster UI updates now generally available​

Cluster pages have been refreshed to provide more useful information on a details page, and make editing more user-friendly.

Kubernetes quotas​

The platform can now track resource allocation usage (currently supporting CPU and memory) and enforce resource quotas for Kubernetes

Support encrypted AWS disks​

You can now create AWS Disks that will be encrypted with a AWS managed KMS Key. Any snapshots created from the disk will also be encrypted as well as any disks created from an encrypted snapshot.

Bug Fixes​

• Platform domain is not automatically set for new organizations
• Number type parameters in env variables prevent workflow execution
• Session links are not always automatically authenticated

Bug Fixes​

• Typo on admin/groups page
• Storage deletion time is missing
• Kube/config file is not updated after making changes to the configuration on the platform
• Clicking workflow runs ID does not navigate to the correct workflow run page

Enhancements and Features​

Allow adding storage from storage panel​

You can now attach storages from the Storage panel on a compute resource's information page while the compute resource is running. Previously, you could only attach a storage from the configuration page.

Bug Fixes​

• Login successful message shows on mfa screen
• When destroying cluster notification says "stopping"
• Remove unused state column from admin groups list
• Resolved minor issues with Kubernetes provider

Enhancements and Features​

Integrate sessions with Kubernetes provider​

Users can now create sessions with the Kubernetes provider, supporting pods, services, and deployments

View provision status from cluster list page​

Cluster provision status can now be opened from cluster list page

Add autoselect option to workflow input forms​

You can now add the autoselect property to a dropdown field when building a workflow. This will make it so the first option is automatically selected.

Bug Fixes​

• On-prem clusters intermittently fail to disconnect
• Workflow with subdomain does not work for marketplace workflow
• Storage deletion logs are missing for some types
• Connecting to an existing cluster which shares home directory with another cluster causes disconnect
• Workflows do not populate default values when running as app
• Workspace mounts shown incorrectly on cluster details page
• Existing cluster reconnect notification did not show correct error

Documentation Changes​

• Update Starting & Stopping Clusters

Enhancements and Features​

Add reason for cluster automated delete request​

Cluster automated delete request now has reason displayed

Add impersonated by to provision status record​

Admin users now can see Impersonated By on resource provision and destroy records

Bug Fixes​

• Add session button disappears
• Responsive search bar on smaller resolutions
• Attached storages panel doesn't include filesystems

Enhancements and Features​

Subdomains for sessions​

Users can now use a custom subdomain when creating a session

Command to list kubernetes clusters available​

The command pw kube ls is now available to list available kubernetes clusters. In addition to basic listing, it also supports output format flags -o json and -o table.

Manually create link type sessions​

You can now manually create sessions of the "link" type. Link sessions are simply links to other applications or services from within the platform. In the past, a workflow would've created these in case a session is managed outside of the ACTIVATE platform.

Provision status enhancement for clusters​

Added more details to cluster provision status records. You can now click on individual provision status lines to see more details.

Can now stop cluster controllers​

When attempting to shut down a cluster you will now be given the option to stop the controller. While stopped, costs will be reduced to only the cluster's storage. When you try to start a stopped cluster, you will be prompted to restart the cluster.

Allow existing clusters to reconnect​

Auto Reconnect option has been added to existing cluster options. If enabled we will try to automatically connect to the remote vm. You must first connect manually by pressing the power button.

Bug Fixes​

• Snapshot name not showing if name is too long
• Unknown error when sharing manual sessions
• Cost estimate table showing empty values
• Cluster image dropdown doesn't filter out failed snapshots
• Unable to update cluster definition when editing via json view
• Can't update azure cluster with controller in NAT mode
• Extra recipients in allocation thresholds are optional
• Delete configuration tooltip says turn off instead of destroy

Documentation Changes​

• Additional updates for new cluster UI
• Remove Dashboard page from the user guide
• Aws ec2 permission is missing register image policy

Enhancements and Features​

Add password to workflow schema​

Workflows now have a password field which can be used by workflow developers to hide text as its being entered.

Cluster provisioning failures will show a banner​

If a cluster fails to provision, a red banner will be shown at the top of the page indicating that the cluster should be destroyed.

Workflow run page improvements​

You can now cancel a workflow run and view running sessions from a workflow's Run page

Bug Fixes​

• Orphan alerts should not be sent for cross platforms
• Auto close toasts, limit to 3 toasts on screen at once
• Cannot select old sessions in provision status viewer
• Tooltip hide under the toggle after recursive renders

Enhancements and Features​

Image dropdown now shows required disk size​

We now show the required disk size you will need to use an image in the image selection dropdown.

Snapshot disks that were configured inline​

You can now create snapshots from disks that were configured inline in the cluster configuration page. You may do so from the clusters "Sessions" page in the attached storages table.

Show workload metrics on kubernetes workload pages​

You can now see CPU usage, Memory Usage, and Storage usage for kubernetes workloads (statefulsets, deployments, etc). These are viewable from the workload pages. These metrics show combined usage for all pods managed by that resource. We will have individual pod metrics in an upcoming release.

Platform administrators receive deletion failure alerts​

Platform administrators will now receive an alert whenever the platform detects that a resource deletion might not have been processed correctly.

Ability to edit YAML directly from kubernetes definition​

You can now edit Kubernetes resources by modifying them directly on the YAML editor.

Azure AI chat in public preview​

You can now provision and chat with OpenAI models on Azure. To enable this feature preview, use the feature preview menu.

Cloud cluster observability​

Cloud clusters will now have CPU, Memory, and Root Disk charts at the top of the cluster details page.

Bug Fixes​

• Load from market place clears out some fields
• Disable snapshot button while request is pending
• Snapshot names not showing on cluster details page
• Publish from action bar does not work
• Cannot snapshot disks provisioned on clusters using auto zone selection
• Connect via ssh button not disabled while cluster starting
• Not found if clicking edit from jobs page
• Cost dashboard print not working
• Cannot start shared cluster with admin/write access
• Azure managed lustre is not marked as ready
• Some secrets don't show eye icon
• Search bar crashes with some special characters
• Disabled menu items have incorrect styling
• Broken link to docs on new workflow
• Can't start google nodes of a3 family
• Traffic light does not turn off when there is no requested nodes
• Unable to make snapshot of snapshot
• Intermittent google key creation failures
• Use attempts for gaia delete jobs instead of expireTime to avoid context deadline exceed
• Creation page now just says name instead of resource name
• Provision status stucks at collecting variables and delete requested when rabbitmq connection fails
• Various session bug fixes

Documentation Changes​

• Update user guide with new cluster configuration layout
• Add information about user defaults
• Add new Managing Orgs pages

Enhancements and Features​

Existing provider now has password support​

In addition to keyboard-interactive, the existing cluster provider can now support older password ssh connections

Improved information display for kubernetes​

Kubernetes workload pages now use a more readable format to show relevant information.

Bug Fixes​

• Capacity reservation table moves around on refresh
• Various marketplace/workflow bugs
• Allow clicking outside the HPC Connect modal to close it after connection
• Node runtime is incorrect when it has been more than 1 day

Bug Fixes​

• Openstack doesn't have "Latest" image option
• Cannot create azure ip address
• Traffic light can crash compute module when debugging nodes provisioning
• Recreating a cluster with the same name as a previously deleted one retained the configuration of the deleted cluster.
• PW CLI not authenticated inside of workflows

Documentation Changes​

• Add video walkthrough to Navigating the Platform

Enhancements and Features​

Storage runtime alerts​

You can now receive runtime alerts for storage. You may choose to turn on/off runtime alert in storage's properties tab. This will send you a notification after your storage has been running longer than the interval specified. You can configure if you receive the notifications via the platform inbox or via email through your account settings.

Bug Fixes​

• Prepend parallelworks: to groups prefix in kubernetes

Enhancements and Features​

Allow setting latest image​

Admins can now set the latest image directly from the admin panel

Update bootstrap scripts while cluster is running​

Users can now update cluster bootstrap script and its toggles (controller/compute) while cluster is running

Kubernetes available in feature preview​

Organizations can now add kubernetes clusters and share them with specific groups. Users in those groups will be able to use the pw CLI to add a context to their local kubeconfig, allowing users to run kubectl commands. Kubernetes resources are now visible in the platform for users that have access to the cluster.

Bug Fixes​

• Fields not pre-populated when editing capacity reservations
• /etc/profile.d/pw.sh variables are not quoted
• Azure ML workspace fails to provision due to incorrect domain
• Traffic light doesnt display correctly for next gen clusters

Enhancements and Features​

AWS OS Snapshots​

You can now snapshot AWS root disks and then boot your cluster using that snapshot.

OS Snapshots generally available​

OS Snapshots are now a generally available feature. You can create a snapshot by going to your cluster, and selecting create snapshot next to the root disk. After doing so, you can choose that snapshot as the image to use when starting a cluster. This is a direct replacement for the old scripted method of creating OS images via the account settings page. We will be removing that method of creating snapshots in an upcoming release.

Bug Fixes​

• Remove description placeholder for on demand capacity reservations
• Failed to share message should be failed to publish
• Marketplace apps not showing display name on apps page

Enhancements and Features​

Capacity Reservation description field​

You can now set descriptions on Capacity Reservations

Ability to manually create sessions​

You can now manually create sessions without having to start a workflow. Try this out by clicking the Add session button on the Sessions page.

Bug Fixes​

• Netapp ontap cannot be deleted
• Move optional session options to advanced
• Start ssh connection button is not full width
• Workflow executing message shows even if theres a validation error
• Azure ML studio is only soft deleted
• No confirmation on marketplace item deletion
• Space in reservation id causes node provision failure
• Remote workflows cannot be forked from marketplace

Enhancements and Features​

Azure on-demand capacity reservations billing​

Azure on-demand capacity reservations reservations are now billed to the group added in the organization settings page

Bug Fixes​

• Remove session tags for sessionless cloud infrastructure
• Path being removed from shells

Bug Fixes​

• Cli version not set on mac os
• Marketplace search hides headers with no results
• Automatically stop user workspace when user deleted
• Provisioned snapshot names are longer than necessary
• AI Chat is returned from API with storages
• Show error if AI Chat API credentials are not working

Bug Fixes​

• Partitions dropdown not populating

Enhancements and Features​

Add custom nfs configuration to cluster attached storages​

You can now specify custom NFS mounts via the cluster configuration form. This applies to cloud clusters and OpenStack clusters.

Bug Fixes​

• Ai chat does not skip searching buckets when no bucket attached
• Provisioned snapshot never marked ready
• Detach custom nfs fails on validation
• Cluster definition shows inline disk options when selecting persistent disk
• Validate ontap name is provided and flatten API structure
• Ebs and efs cost estimation does not reflect throughput and provisioned iops
• Group shutdown fails

Bug Fixes​

• Marketplace fork from add page redirects to incorrect page

Enhancements and Features​

Allow tracking of compute node egress cost on azure​

Use Load Balancer as Nat Gateway option has been added to azure infrastructures. This will make it so a load balancer is created with each cluster and all egress traffic from partitions will go through the load balancer allowing tracking of egress cost.

Azure ML Workspace feature preview publicly available​

The Azure ML Workspace feature preview has been made publicly available. To try this feature out, enable it from the feature preview section.

Add Support for Azure and Google capacity reservations​

Capacity reservations are now supported on Azure and Google Cloud. Organization administrators can now specify which CSP the capacity reservation is for when adding the capacity reservation. On the cluster edit form, the input field for capacity reservations has been changed to a dropdown.

Bug Fixes​

• Search bar doesn't show on 404 page
• Prevent search from opening by hotkey when in a text box

Enhancements and Features​

NetApp ONTAP support​

We now support managing NetApp ONTAP volumes directly from the ACTIVATE platform. These volumes can also be mounted to OpenStack clusters which have network access to the NFS exports provided by the ONTAP service.

Show which cluster a session is targeting​

You can now see which cluster a session is targeting from the Sessions widget and from the Sessions page.

Search bar supports storage​

Storage items now appear in the platform search

Show csp id on image list​

The admin panel platform image list now shows the CSP's unique identifier for the image.

Bug Fixes​

• Deleting organization does not properly delete users
• Uppercase workflow fields were not allowed

Enhancements and Features​

OpenStack generally available​

OpenStack clusters are now generally available to create via the Parallel Works ACTIVATE platform.

Bug Fixes​

• Storage list not updating after deleting a storage

Enhancements and Features​

Organizations can reset custom sidebar settings to platform defaults​

Organizations can now reset the organization-wide default sidebar settings to the platform defaults by using the radio button available on the user defaults page.

Bug Fixes​

• Search bar links to cli docs are incorrect

Enhancements and Features​

Search bar​

You can now search the platform and documentation via a new search bar at the top of the UI. Open this with cmd + k on Mac OS or ctrl + k on Windows.

Allow using AWS and Google cluster controllers as nat instances​

Use Controllers as NAT Gateways option has been added on AWS/Google infrastructure configurations. Enabling this option will make it so all traffic from compute nodes are proxied through the controller. All compute nodes will share the same IP as the controller node. This will enable tracking egress costs from compute nodes.

Provision public IP addresses on Azure​

You can now provision public IP addresses on Azure independently of other compute resources. After provisioning a public IP it can then be assigned to a compute cluster controller node.

Ai chat provision status​

Improved provisioning status logs shown when creating an AI Chat resource

Bug Fixes​

• Crashes when extra email is not found as platform user
• Aws snapshots show provisioned before actually ready
• Platform image with space and parenthesis could not be deleted
• Better error messages on aws disk provisioning error
• Page crashes if feature previews not loaded in time
• Able to save google and azure lustre without selecting instance type

Enhancements and Features​

Organization specified default sidebars​

Organizations can now define a default sidebar for new users. Users that have not customized their sidebar will automatically use the organization's default settings. If the organization does not specify a customized sidebar then all sidebar items will be visible by default.

Optional dns server​

Adds an optional DNS service to platform deployments which can resolve slurm cluster hostnames if needed

Add cli list for cluster, app, workflow, and session​

Add Email and Notify Allocation Alerts options to organization settings​

Added Cost Alert notification type and user preferences.

OpenStack clusters can assign floating ip to compute nodes​

Bug Fixes​

• Snapshots show provisioned earlier than expected

Documentation Changes​

• Merge apps and workflows pages

Enhancements and Features​

Update openstack cluster definition page​

Added cluster cost estimation for openstack

Admin-only debug mode for cloud clusters​

Platform administrators can now toggle Debug Mode in cluster Advanced Settings section.

When turned on, users can ssh into the node without waiting for it to be ready using ssh root@<nodeip>. Can be done from the user workspace or user's personal computer (if public key is added in the platform). Node clean up will not happen if there is any error in provisioning.

Bug Fixes​

• Sidebar not always highlighting active item
• Apps shared to marketplace were not labeled as apps

Documentation Changes​

• Customizing the platform
• Improved API docs

Bug Fixes​

• Updated workflow yaml not reflected with page navigation
• Alphabetize IP address options
• Sessions started on shared clusters not working
• Icon not showing for sessions started from github workflow
• Root snapshots not in image list

Enhancements and Features​

Allow editing widget names on home page​

You can now edit widget names on home page. Click Customize and you will now see an edit icon next to the widgets name.

Bug Fixes​

• Creating a session with the same name as previous session results in wrong ports
• Sessions print wrong json field names to log

Enhancements and Features​

Added icons to sessions list​

Sessions that were created by workflows will now show the workflow icon next to the session

Remove resource monitor home page widget​

The resource monitor module has been removed from the front page. In order to not disturb saved layouts you will need to manually remove the module where the resource monitor was previously.

Add apps panel to home page​

You can now edit the workflow home page widget to change which workflow type to show. The default home page widgets have been updated to include the Favorite Apps and the Sessions widgets. Users that have modified their home page will not receive the new layout, and can instead add these widgets by choosing "Customize" from the top right of the home page.

Bug Fixes​

• Real time usage not counted for determining if cost dashboard should show
• Workflow sessions with slug have extra slash appended
• Cannot choose group when creating storage

Enhancements and Features​

Nfs list, attach-storage commands​

• Adds pw nfs ls command to the cli
  • This lists all of the nfs storages on a user's account
• Adds pw cluster attach-storage command to the cli
  • Required Flags: --cluster-uri, --storage-uri, --mount-point
  • This will attach the given storage to the given cluster at the given mountpoint
  • Does the same action as attaching the storage on the cluster definition page
  • The user will be able to see the attached storage on the cluster definition page after running the command sucessfully

nfs ls and cluster attach-storage commands​

You can now use the new pw nfs ls and pw cluster attach-storage commands from an authenticated cluster session.

Sessions home page module​

Sessions are now available as a home page module which can be added using the customize button on the home page.

Bug Fixes​

• Justify sidebar settings to the right

Enhancements and Features​

Add customizable sidebar​

Users can now customize the items that appear on their sidebar. In a future update, organizations will also be able to customize the default sidebars for users in their organization.

Azure OpenAI service available in feature preview​

Can now provision Azure OpenAI resources from within the platform and directly chat via the UI.

Bug Fixes​

• Custom thumbnails not showing
• Cannot expand logs
• Text overlaps on add resource page

Bug Fixes​

• Marketplace workflows get stuck on loading
• Uploaded thumbnails not showing
• Workflow input substitution not working on session properties

Enhancements and Features​

Promote apps/sessions to GA​

Apps and sessions are now generally available.

Apps provide a layer on top of workflows which make additional interfaces available for workflow developers to make interactive experiences easier. Sessions expose ports on compute resources to the browser so users can run interactive apps on their computing resources and access them directly via ACTIVATE.

Read our documentation for apps and sessions to learn more.

Bug Fixes​

• Long logs line numbers overlap logs

Documentation Changes​

• Add apps and sessions

Enhancements and Features​

Show running workflow steps while session is pending​

On a session's page, current running workflow steps will be shown while the session is pending.

Change default layout for home page​

We've updated the default layout of the home page. If you have not customized your home page, you will automatically be moved to the new default layout which shows:

• favorite workflows
• recent workflow runs
• favorite compute resources

To customize your layout, use the customize button at the top right of the home page. Note that users with a custom layout are not affected by this change.

Bug Fixes​

• Marketplace workflows with dots in name can now create sessions
• External auth UI doesn't fit compactly
• Saving cluster configuration gives an error if storage is attached
• Controller ip substituted incorrectly in workflow inputs
• Clusters can share one static ip address
• Whitespace not showing correctly in changelogs
• Ephemeral storage provision status does not update when persistent storage also attached
• Api key and token generation has slightly different UI

Documentation Changes​

• Document unique naming system

Enhancements and Features​

Update controller configuration for Amazon Linux support​

Support bootstrapping clusters that use the Amazon Linux 2 image

Bug Fixes​

• Unify border style
• Button is invisible on cloud platform

Enhancements and Features​

Allow adding images through platform​

Platform level slurm cluster images can be managed through the admin panel.

Allow setting default session names​

You can now set default session names on workflows:

session:
  mySession:
    prompt-for-name:
      default: "defaultname"

Allow job environment variables on workflows​

Allows setting environment variables on a job level. Environment variables set at a step level will override the environment variables set at a job level.

jobs:
  main:
    env:
      foo: "bar"
    steps:
      - run: echo ${foo} # bar
      - run: echo ${foo} # baz
         env: 
          foo: "baz" # will override env variable set on job level

Stop workflow run on session stop​

Stopping a session will now also stop the workflow run that started the session and any sessions associated with the workflow run.

Improve workflow update-session logs​

Logs and input validation for updating session has been improved.

Bug Fixes​

• Move health check below controller node configuration in provision status
• Cannot delete some old storage sessions
• Sessions not deleting after cancelling workflow run
• Cleanup step running when step is skipped due to if being false
• Show message about user workspace starting on workflows page

Enhancements and Features​

Support client_secret_basic token endpoint auth method​

There is now a dropdown on the OIDC auth method to allow choosing either client_secret_basic or client_secret_post. These auth methods are used for the platform to authenticate to the token endpoint after a successful OIDC user authentication.

Organization admins now can specify scopes for oidc​

Scopes can now be specified when adding or updating an OIDC auth method in organization settings.

Bug Fixes​

• Azure NetApp Files does not work on newly provisioned infrastructures
• Root disk snapshots times out before finishing
• Escape oidc redirect uris
• Validate group names meet constraints
• Random crash on home page
• Workflow inputs.sh has wrong format when using objects
• Workflow cleanup steps not running after canceling
• Workflow sessions not found if contains url params

Other Changes​

• Add docs section to changelogs

Enhancements and Features​

Add health check and storage logs into provision status UI​

• Health check is now moved into provision status list.
• Health check and ephemeral storage failure now also displays a View logs button to see the details of what happened.

Support manually providing oidc endpoints or using issuer to discover​

OIDC endpoints can now be manually provided instead of using the issuer to discover them. This makes the OIDC authentication method more flexible for cases where applications do not have a proper well-known endpoint or the well-known endpoint is behind a firewall but the other endpoints are not.

This update also has slight visual enhancements to the auth method page, with the "configure" button being changed to a link.

Support new provision status UX for Azure NetApp Files​

The new provisioning experience is live for Azure NetApp files.

Bug Fixes​

• Oidc edit page always clears userinfo endpoint
• Incorrect authentication endpoint used in oidc authentication
• Skip building libnss_cache and config nsswitch.conf when present in image

Other Changes​

• Add Sharing a Snapshot to Working With Disk Snapshots

Enhancements and Features​

Allow choosing export when hammerspace has multiple shares​

Adds an input box when attaching filesystems only for Hammerspace. This input allows users to define the export path the cluster will use to mount the hammerspace file share from.

Additional workflow features​

You can now specify remoteHost and slug when updating a session.

      - uses: parallelworks/update-session
        with:
          slug: 'string' // (optional) appends this slug to the session url
          remoteHost: 'string' // (optional) host to forward session to from the target, defaults to "localhost"
          ... other inputs

You can now also specify if the session will use TLS.

sessions:
  mySession: 
    useTLS: true // (optional) Will use https when connecting to session, should only be turned on if the app requires https.

Enhancements and Features​

Improve provision status UI for hammerspace​

Changes the Hammerspace provision status UI to only show the main components getting created, Anvil, DSX, DataNodes. Also adds deletion statuses.

Bug Fixes​

• Cost page crashes
• Remove extra padding on kubernetes pages
• Resource names should not be automatically capitalized
• Parallel workflow jobs not running
• Cannot create oidc auth method in another organization

Other Changes​

• Add quick connect instructions to logging in to controller page

Enhancements and Features​

Add provision status support for hammerspace​

• Add Provision Status UI for Hammerspace
• Fixes issue where the Hammerspace could not be deleted if it didn't have provision status

Bug Fixes​

• Double clicking add terminal maximizes terminal

Enhancements and Features​

Deletion records are now appended to provision records​

When a resource supports the new provisioning experience, you will now see the deletion records directly below the provisioning records in the provisioning status panel.

When provisioning Azure storage accounts, if a name was unavailable the provisioning would silently fail. You will now receive an error that the name is already in use in these cases. This update also fixes other minor issues and typographical problems with the new provisioning UI.

Bug Fixes​

• Non-bash shells cannot run commands
• Azure bucket "collecting variables" step spins forever

Enhancements and Features​

Provision status ui enhancements​

• Provision status UI now displays details of ansible bootstrap task that failed
• Ephemeral lustre filesystem and persistent disk attachment now also displayed, including error if any.

Add failed node to cluster data return endpoint​

Failed nodes are now also returned in cluster data. This is useful for workflow that need to know nodes provision status to make decision instead of waiting for slurm to time out

New provisioning UX promoted to GA​

The new provisioning experience is now generally available for our next-generation cloud clusters and most cloud storage options.

Promote next-gen cloud clusters to general availability​

Next-generation cloud clusters are now generally available. With this update, previous generation clusters will be marked with the text "Legacy".

Workspace mount tooltips​

Workspace mount points now have tooltips for substitutions

Bug Fixes​

• Org vars not populating on workflows

Enhancements and Features​

Ultra disk configuration for hammerspace​

Added inputs on Hammerspace configuration form that show up when selecting UltraSSD_LRS disks. These options are for configuring the IOPS and Mbps Throughput for all disks within the Hammerspace deployment.

Apps feature preview is now available​

All users can now enable the "apps" feature preview from the feature preview menu.

Bug Fixes​

• Run bootstrap when using azure os snapshot
• Some azure instance types cannot start slurm
• Unmount localdisk on hammerspace
• Correct options in fstab for hammerspace

Enhancements and Features​

Dependency graph summary info​

Adds a summary box above the workflow dependency graph

Cli can use tokens to authenticate with PW_API_KEY env variable​

Can use PW_API_KEY environment variable with tokens to authenticate

Identify-platform command​

Adds a command pw auth identify-platform to the CLI to help identify which platform host the CLI is configured to run commands against.

Make azure cluster nodes provisioning more stable​

Make nodes provisioning more stable for azure

Improved changelogs​

Introduced a new structure for the changelogs, where changes are categorized into three sections: Enhancements and Features, Bug Fixes, and Other Changes.

Bug Fixes​

• Cost page crashing
• Compute nodes retry-provision always fails
• Ansible packages installation sometimes fails
• Azure regular image id doesnt work
• Attached disk is not working properly in v2 clusters definition
• Cannot type number that is less than minimum into input
• Filesystem attachment form doesnt work properly when cluster is on