Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Debugging non-reproducibility of ACCESS-NRI 0.3.1 -> 0.4.0 #47

Closed
wants to merge 7 commits into from

Conversation

dougiesquire
Copy link
Collaborator

@dougiesquire dougiesquire commented Feb 13, 2025

This is a PR to debug and document where we lost reproducibility when we updated from 0.3.1 to 0.4.0. The context is that our repro tests had a bug and was effectively always reporting reproducible runs. We thus updated components from 0.3.1 to 0.4.0 under the impression that the updates were not answer-changing when in fact they are.

Companion PR to ACCESS-NRI/access-om3-configs#173. See also COSIMA/access-om3#266


🚀 The latest prerelease access-om3/pr47-11 at 9382009 is here: #47 (comment) 🚀

Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-4 with commit 7c5e785

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-4 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-4

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-4 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-5 with commit 3b9af3e

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-5 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-5

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-5 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-6 with commit c7b673d

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-6 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-6

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-6 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

Copy link

github-actions bot commented Feb 13, 2025

🚀 Attempted to deploy access-om3 Prerelease pr47-7 with commit 06046a0

🖥️ Gadi Deployment ❌

This was a failure due to timeouts while trying to obtain locks, so just redeployed below

Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-8 with commit 06046a0

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-8 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-8

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-8 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

…versions used in 0.4.0

Unfortunately, the new versions of CMEPS/CDEPS require updating ESMF and the old versions don't work with the updated ESMF. This makes it very difficult to test just updating ESMF
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-9 with commit 3de4fe9

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-9 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-9

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-9 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-10 with commit ce6d7c1

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-10 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-10

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-10 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-11 with commit 9382009

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-11 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-11

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-11 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.02.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

@dougiesquire
Copy link
Collaborator Author

Closing as this has served its purpose.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant