Update openmpi to a version that works on other systems #53

harshula · 2025-03-03T23:53:22Z

Leonardo and Setonix had issues with openmpi 4.0.2 when building ACCESS-OM2.
Update ifort to a recent version that is available on other systems.

🚀 The latest prerelease access-esm1p6/pr53-13 at ffeef04 is here: #53 (comment) 🚀

github-actions · 2025-03-03T23:54:15Z

🚀 Deploying access-esm1.6 dev_2024.12.0 as prerelease pr53-1 with commit 85dcdad

Details and usage instructions

This access-esm1.6 model will be deployed as:

dev_2024.12.0 as a Release (when merged).
pr53-1 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-1

where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-1 environment.

🛠️ Using: spack 0.22, spack-packages 2024.12.0, spack-config 2025.02.1

Details

It will be deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version 2024.12.0
access-nri/spack-config version 2025.02.1

If this is not what was expected, commit changes to config/versions.json.

harshula · 2025-03-04T00:07:51Z

Some of the following SPRs need to be modified:

packages/mom5/package.py
47-    with when("@access-esm1.5:access-esm1.6"):
48-        depends_on("[email protected]:4.7.4")
49-        depends_on("[email protected]:4.5.2")
50-        # Depend on "openmpi".
51:        depends_on("[email protected]:4.1.0")

packages/cice4/package.py
21-    version("access-esm1.5", branch="access-esm1.5")
22-
23-    depends_on("[email protected]:4.5.2")
24-    # Depend on "openmpi".
25:    depends_on("[email protected]:4.1.0")

packages/gcom/package.py
26-    # For the default MPI version for NCI, see (e.g.)
27-    # https://code.metoffice.gov.uk/trac/gcom/browser/main/trunk/rose-stem/site/nci/suite.rc
28-    # For cherry picking virtual dependencies, see
29-    # https://github.com/spack/spack/releases/tag/v0.21.0 Feature 4
30:    depends_on("[email protected]:", when="+mpi^[virtuals=mpi] openmpi", type=("build", "link", "run"))

packages/oasis3-mct/package.py
30-    with when("@access-esm1.5"):
31-        depends_on("[email protected]:1.10.11")
32-        depends_on("[email protected]:4.5.2")
33-        # Depend on "openmpi".
34:        depends_on("[email protected]:4.1.0")

packages/um7/package.py
27-
28-    depends_on("fcm", type="build")
29-    depends_on("dummygrib", type=("build", "link"))
30-    depends_on("[email protected]+mpi", type=("build", "link"))
31:    depends_on("[email protected]:4.1.0", type=("build", "run"))

harshula · 2025-03-04T05:38:17Z

Had a good chat with @penguian & @blimlim ! We have a plan on how to update the SPRs and verify that it doesn't have any negative consequences on ACCESS-ESM1.5 builds.

harshula · 2025-03-04T05:56:01Z

We should merge this PR as soon as the SPRs are fixed. The output should be bitwise reproducible.

access-hive-bot · 2025-03-04T06:06:20Z

This pull request has been mentioned on ACCESS Hive Community Forum. There might be relevant details there:

https://forum.access-hive.org.au/t/csiro-access-nri-standup-minutes/3789/26

access-hive-bot · 2025-03-04T06:13:58Z

This pull request has been mentioned on ACCESS Hive Community Forum. There might be relevant details there:

https://forum.access-hive.org.au/t/access-esm1-6-development/3114/130

harshula · 2025-03-04T12:31:27Z

An ACCESS-ESM1.5 Pre-release build (ACCESS-NRI/ACCESS-ESM1.5#28) is ready for testing to ensure that the modifications to the SPRs do not change the behaviour of ACCESS-ESM1.5.

github-actions · 2025-03-04T23:54:03Z

🚀 Deploying access-esm1.6 dev_2024.12.0 as prerelease pr53-2 with commit c620542

Details and usage instructions

This access-esm1.6 model will be deployed as:

dev_2024.12.0 as a Release (when merged).
pr53-2 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-2

where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-2 environment.

🛠️ Using: spack 0.22, spack-packages remove-versions-from-esm-dependencies, spack-config 2025.02.1

Details

It will be deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.1

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2025-03-05T12:40:56Z

🚀 Deploying access-esm1.6 dev_2024.12.0 as prerelease pr53-3 with commit 3e6ba57

Details and usage instructions

This access-esm1.6 model will be deployed as:

dev_2024.12.0 as a Release (when merged).
pr53-3 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-3

where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-3 environment.

🛠️ Using: spack 0.22, spack-packages remove-versions-from-esm-dependencies, spack-config 2025.02.1

Details

It will be deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.1

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2025-03-05T12:54:31Z

🚀 Deploying access-esm1.6 dev_2024.12.0 as prerelease pr53-4 with commit 9048ede

Details and usage instructions

This access-esm1.6 model will be deployed as:

dev_2024.12.0 as a Release (when merged).
pr53-4 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-4

where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-4 environment.

🛠️ Using: spack 0.22, spack-packages remove-versions-from-esm-dependencies, spack-config 2025.02.1

Details

It will be deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.1

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2025-03-05T13:04:38Z

🚀 Deploying access-esm1.6 dev_2024.12.0 as prerelease pr53-4 with commit 588be46

Details and usage instructions

This access-esm1.6 model will be deployed as:

dev_2024.12.0 as a Release (when merged).
pr53-4 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-4

where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-4 environment.

🛠️ Using: spack 0.22, spack-packages remove-versions-from-esm-dependencies, spack-config 2025.02.1

Details

It will be deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.1

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2025-03-05T14:22:42Z

🚀 Deploying access-esm1.6 dev_2024.12.0 as prerelease pr53-5 with commit 565e140

Details and usage instructions

This access-esm1.6 model will be deployed as:

dev_2024.12.0 as a Release (when merged).
pr53-5 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-5

where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-5 environment.

🛠️ Using: spack 0.22, spack-packages remove-versions-from-esm-dependencies, spack-config 2025.02.1

Details

It will be deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.1

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2025-03-06T02:28:06Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-6 with commit fb654c6

🖥️ `Gadi` Deployment ❌

access-hive-bot · 2025-03-06T02:40:38Z

This pull request has been mentioned on ACCESS Hive Community Forum. There might be relevant details there:

https://forum.access-hive.org.au/t/access-esm1-6-development/3114/135

github-actions · 2025-03-06T02:55:52Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-6 with commit fb8b2d9

🖥️ `Gadi` Deployment ✔️

Usage Instructions

This access-esm1.6 model will be deployed to Gadi as:

dev_2024.12.0 as a Release (when merged).
pr53-6 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-6

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-6 environment.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

github-actions · 2025-03-09T01:55:40Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-7 with commit 1dfa5db

🖥️ `Gadi` Deployment ✔️

Usage Instructions

This access-esm1.6 model will be deployed to Gadi as:

dev_2024.12.0 as a Release (when merged).
pr53-7 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-7

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-7 environment.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.2

If the above was not what was expected, commit changes to config/versions.json in this PR.

github-actions · 2025-03-09T02:06:02Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-8 with commit 452b57e

🖥️ `Gadi` Deployment ✔️

Usage Instructions

This access-esm1.6 model will be deployed to Gadi as:

dev_2024.12.0 as a Release (when merged).
pr53-8 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-8

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-8 environment.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.2

If the above was not what was expected, commit changes to config/versions.json in this PR.

github-actions · 2025-03-09T03:03:33Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-10 with commit dc32a84

🖥️ `Gadi` Deployment ❌

github-actions · 2025-03-09T03:08:09Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-9 with commit ab94b38

🖥️ `Gadi` Deployment ✔️

Usage Instructions

This access-esm1.6 model will be deployed to Gadi as:

dev_2024.12.0 as a Release (when merged).
pr53-9 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-9

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-9 environment.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.2

If the above was not what was expected, commit changes to config/versions.json in this PR.

github-actions · 2025-03-09T03:44:39Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-10 with commit 0958e46

🖥️ `Gadi` Deployment ✔️

Usage Instructions

This access-esm1.6 model will be deployed to Gadi as:

dev_2024.12.0 as a Release (when merged).
pr53-10 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-10

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-10 environment.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.2

If the above was not what was expected, commit changes to config/versions.json in this PR.

github-actions · 2025-03-09T04:04:20Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-11 with commit d5dfa9c

🖥️ `Gadi` Deployment ❌

github-actions · 2025-03-09T04:06:20Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-11 with commit 7b283d8

🖥️ `Gadi` Deployment ❌

github-actions · 2025-03-09T04:33:36Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-11 with commit 15b588c

🖥️ `Gadi` Deployment ✔️

Usage Instructions

This access-esm1.6 model will be deployed to Gadi as:

dev_2024.12.0 as a Release (when merged).
pr53-11 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-11

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-11 environment.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version remove-versions-from-esm-dependencies
access-nri/spack-config version 2025.02.2

If the above was not what was expected, commit changes to config/versions.json in this PR.

blimlim · 2025-03-10T23:15:53Z

Note's on the change to spack-packages: "spack-packages": "remove-versions-from-esm-dependencies"
I've run ESM1.5 for 40 years using the build from PR28-1, which included this change.

After 40 years, the model output was identical to the output from the previously released ESM1.5 executables.

github-actions · 2025-03-11T03:00:03Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-12 with commit c3d6b40

🖥️ `Gadi` Deployment ✔️

Usage Instructions

This access-esm1.6 model will be deployed to Gadi as:

dev_2024.12.0 as a Release (when merged).
pr53-12 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-esm1p6/pr53-12

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-esm1p6-pr53-12 environment.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version 2025.03.002
access-nri/spack-config version 2025.02.2

If the above was not what was expected, commit changes to config/versions.json in this PR.

* Leonardo and Setonix had issues with openmpi 4.0.2 when building ACCESS-OM2. * Update ifort to a recent version that is available on other systems.

github-actions · 2025-03-12T00:04:19Z

🚀 Attempted to deploy access-esm1p6 Prerelease pr53-13 with commit ffeef04

🖥️ `Gadi` Deployment ❌

harshula self-assigned this Mar 3, 2025

harshula had a problem deploying to Gadi Prerelease March 3, 2025 23:54 — with GitHub Actions Failure

harshula had a problem deploying to Gadi Prerelease March 4, 2025 23:54 — with GitHub Actions Failure

harshula temporarily deployed to Gadi Prerelease March 5, 2025 12:40 — with GitHub Actions Inactive

harshula force-pushed the update-openmpi-ifort branch 2 times, most recently from 1be7d33 to 9048ede Compare March 5, 2025 12:53

harshula force-pushed the update-openmpi-ifort branch from 9048ede to 588be46 Compare March 5, 2025 13:03

harshula had a problem deploying to Gadi Prerelease March 5, 2025 13:50 — with GitHub Actions Failure

harshula temporarily deployed to Gadi Prerelease March 5, 2025 14:22 — with GitHub Actions Inactive

CodeGat force-pushed the update-openmpi-ifort branch from 565e140 to fb654c6 Compare March 6, 2025 02:26

harshula force-pushed the update-openmpi-ifort branch from fb654c6 to fb8b2d9 Compare March 6, 2025 02:50

harshula temporarily deployed to Gadi Prerelease March 6, 2025 02:51 — with GitHub Actions Inactive

harshula temporarily deployed to Gadi Prerelease March 9, 2025 01:02 — with GitHub Actions Inactive

harshula temporarily deployed to Gadi Prerelease March 9, 2025 01:59 — with GitHub Actions Inactive

harshula force-pushed the update-openmpi-ifort branch from 452b57e to ab94b38 Compare March 9, 2025 02:52

harshula temporarily deployed to Gadi Prerelease March 9, 2025 02:53 — with GitHub Actions Inactive

harshula force-pushed the update-openmpi-ifort branch from dc32a84 to 0958e46 Compare March 9, 2025 03:39

harshula temporarily deployed to Gadi Prerelease March 9, 2025 03:40 — with GitHub Actions Inactive

harshula force-pushed the update-openmpi-ifort branch from 0958e46 to d5dfa9c Compare March 9, 2025 04:03

harshula force-pushed the update-openmpi-ifort branch from d5dfa9c to 7b283d8 Compare March 9, 2025 04:05

harshula force-pushed the update-openmpi-ifort branch from 7b283d8 to 15b588c Compare March 9, 2025 04:08

harshula temporarily deployed to Gadi Prerelease March 9, 2025 04:08 — with GitHub Actions Inactive

harshula force-pushed the update-openmpi-ifort branch from 15b588c to c3d6b40 Compare March 11, 2025 01:48

harshula temporarily deployed to Gadi Prerelease March 11, 2025 01:49 — with GitHub Actions Inactive

harshula added 2 commits March 12, 2025 10:41

Update openmpi to a version that works on other systems

ceb073a

* Leonardo and Setonix had issues with openmpi 4.0.2 when building ACCESS-OM2. * Update ifort to a recent version that is available on other systems.

support [email protected]

ffeef04

harshula force-pushed the update-openmpi-ifort branch from c3d6b40 to ffeef04 Compare March 11, 2025 23:44

harshula had a problem deploying to Gadi Prerelease March 11, 2025 23:44 — with GitHub Actions Error

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update openmpi to a version that works on other systems #53

Update openmpi to a version that works on other systems #53

harshula commented Mar 3, 2025 •

edited by github-actions bot

Loading

github-actions bot commented Mar 3, 2025

harshula commented Mar 4, 2025

harshula commented Mar 4, 2025

harshula commented Mar 4, 2025

access-hive-bot commented Mar 4, 2025

access-hive-bot commented Mar 4, 2025

harshula commented Mar 4, 2025

github-actions bot commented Mar 4, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 6, 2025

access-hive-bot commented Mar 6, 2025

github-actions bot commented Mar 6, 2025

github-actions bot commented Mar 9, 2025

github-actions bot commented Mar 9, 2025

github-actions bot commented Mar 9, 2025

github-actions bot commented Mar 9, 2025

github-actions bot commented Mar 9, 2025

github-actions bot commented Mar 9, 2025

github-actions bot commented Mar 9, 2025

github-actions bot commented Mar 9, 2025

blimlim commented Mar 10, 2025

github-actions bot commented Mar 11, 2025

github-actions bot commented Mar 12, 2025

Update openmpi to a version that works on other systems #53

Are you sure you want to change the base?

Update openmpi to a version that works on other systems #53

Conversation

harshula commented Mar 3, 2025 • edited by github-actions bot Loading

github-actions bot commented Mar 3, 2025

harshula commented Mar 4, 2025

harshula commented Mar 4, 2025

harshula commented Mar 4, 2025

access-hive-bot commented Mar 4, 2025

access-hive-bot commented Mar 4, 2025

harshula commented Mar 4, 2025

github-actions bot commented Mar 4, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 5, 2025

github-actions bot commented Mar 6, 2025

🖥️ Gadi Deployment ❌

access-hive-bot commented Mar 6, 2025

github-actions bot commented Mar 6, 2025

🖥️ Gadi Deployment ✔️

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ✔️

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ✔️

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ❌

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ✔️

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ✔️

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ❌

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ❌

github-actions bot commented Mar 9, 2025

🖥️ Gadi Deployment ✔️

blimlim commented Mar 10, 2025

github-actions bot commented Mar 11, 2025

🖥️ Gadi Deployment ✔️

github-actions bot commented Mar 12, 2025

🖥️ Gadi Deployment ❌

harshula commented Mar 3, 2025 •

edited by github-actions bot

Loading

🖥️ `Gadi` Deployment ❌

🖥️ `Gadi` Deployment ✔️

🖥️ `Gadi` Deployment ✔️

🖥️ `Gadi` Deployment ✔️

🖥️ `Gadi` Deployment ❌

🖥️ `Gadi` Deployment ✔️

🖥️ `Gadi` Deployment ✔️

🖥️ `Gadi` Deployment ❌

🖥️ `Gadi` Deployment ❌

🖥️ `Gadi` Deployment ✔️

🖥️ `Gadi` Deployment ✔️

🖥️ `Gadi` Deployment ❌