Skip to content

{2023.06}[2023a,grace] Further apps from EB 4.9.0 2023a easystack #991

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Apr 3, 2025
Merged

{2023.06}[2023a,grace] Further apps from EB 4.9.0 2023a easystack #991

merged 4 commits into from
Apr 3, 2025

Conversation

TopRichard
Copy link
Collaborator

@TopRichard TopRichard commented Mar 31, 2025 •
edited
Loading

The easyconfigs(Z3/4.12.2-GCCcore-12.3.0.eb , OpenJPEG-2.5.0-GCCcore-12.3.0.eb) added to eessi-2023.06-eb-4.9.4-2023a.yml are already dependencies of other built software packages, keeping them to stay in sync with building the new stack for Sapphire Rapids

Packages added:

ATK/2.38.0-GCCcore-12.3.0
at-spi2-atk/2.38.0-GCCcore-12.3.0
at-spi2-core/2.49.91-GCCcore-12.3.0
BeautifulSoup/4.12.2-GCCcore-12.3.0
bokeh/3.2.2-foss-2023a
cppy/1.2.1-GCCcore-12.3.0
dask/2023.9.2-foss-2023a
Gdk-Pixbuf/2.42.10-GCCcore-12.3.0
Ghostscript/10.01.2-GCCcore-12.3.0
GTK3/3.24.37-GCCcore-12.3.0
ImageMagick/7.1.1-15-GCCcore-12.3.0
JupyterLab/4.0.5-GCCcore-12.3.0
JupyterNotebook/7.0.2-GCCcore-12.3.0
jupyter-server/2.7.2-GCCcore-12.3.0
libepoxy/1.5.10-GCCcore-12.3.0
matplotlib/3.7.2-gfbf-2023a
maturin/1.1.0-GCCcore-12.3.0
meson-python/0.13.2-GCCcore-12.3.0
Pillow-SIMD/9.5.0-GCCcore-12.3.0
PLY/3.11-GCCcore-12.3.0
PyOpenGL/3.1.7-GCCcore-12.3.0
PyQt5/5.15.10-GCCcore-12.3.0
PyQt-builder/1.15.4-GCCcore-12.3.0
PyTorch/2.1.2-foss-2023a
PyZMQ/25.1.1-GCCcore-12.3.0
Qhull/2020.2-GCCcore-12.3.0
SIP/6.8.1-GCCcore-12.3.0
Tkinter/3.11.3-GCCcore-12.3.0
tornado/6.3.2-GCCcore-12.3.0
Wayland/1.22.0-GCCcore-12.3.0
Z3/4.12.2-GCCcore-12.3.0

@TopRichard TopRichard added 2023.06-software.eessi.io 2023.06 version of software.eessi.io grace NVIDIA Grace CPU labels Mar 31, 2025
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Mar 31, 2025

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/sapphirerapids, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-software, eessi.io-2023.06-compat

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Mar 31, 2025

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi.io-2023.06-compat, eessi.io-2023.06-software

@eessi-bot-trz42
Copy link

Instance trz42-GH200-jr is configured to build for:

  • architectures: aarch64/nvidia/grace
  • repositories: eessi.io-2023.06-software

@eessi-bot-toprichard
Copy link

Instance rt-Grace-jr is configured to build for:

  • architectures: aarch64/nvidia/grace
  • repositories: eessi.io-2023.06-software

@TopRichard
Copy link
Collaborator Author

bot: build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Mar 31, 2025 •
edited
Loading

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

    • no jobs were submitted

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Mar 31, 2025 •
edited
Loading

Updates by the bot instance eessi-bot-mc-azure (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

    • no jobs were submitted

@eessi-bot-toprichard
Copy link

eessi-bot-toprichard bot commented Mar 31, 2025 •
edited
Loading

Updates by the bot instance rt-Grace-jr (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

@eessi-bot-trz42
Copy link

Updates by the bot instance trz42-GH200-jr (click for details)
  • account TopRichard has NO permission to send commands to the bot

@eessi-bot-toprichard
Copy link

eessi-bot-toprichard bot commented Mar 31, 2025 •
edited
Loading

New job on instance rt-Grace-jr for CPU micro-architecture aarch64-nvidia-grace for repository eessi.io-2023.06-software in job dir /p/project1/ceasybuilders/bot-rt/jobs/2025.03/pr_991/13548058

date job status comment
Mar 31 13:06:48 UTC 2025 submitted job id 13548058 awaits release by job manager
Mar 31 13:07:32 UTC 2025 released job awaits launch by Slurm scheduler
Mar 31 13:08:36 UTC 2025 running job 13548058 is running
Mar 31 15:16:28 UTC 2025 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job13548058.result does not exist in job directory, or parsing it failed.
  • No artefacts were found/reported.
Mar 31 15:16:28 UTC 2025 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job13548058.test does not exist in job directory, or parsing it failed.

@TopRichard TopRichard mentioned this pull request Mar 31, 2025
Open
3 tasks
@TopRichard
Copy link
Collaborator Author

Job canceled manually after being inactive for some time, the build job will be re-triggered to see if the same behavior will be noticed

@TopRichard
Copy link
Collaborator Author

bot: build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Mar 31, 2025 •
edited
Loading

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

    • no jobs were submitted

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Mar 31, 2025 •
edited
Loading

Updates by the bot instance eessi-bot-mc-azure (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

    • no jobs were submitted

@eessi-bot-toprichard
Copy link

eessi-bot-toprichard bot commented Mar 31, 2025 •
edited
Loading

Updates by the bot instance rt-Grace-jr (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

@eessi-bot-trz42
Copy link

Updates by the bot instance trz42-GH200-jr (click for details)
  • account TopRichard has NO permission to send commands to the bot

@eessi-bot-toprichard
Copy link

eessi-bot-toprichard bot commented Mar 31, 2025 •
edited
Loading

New job on instance rt-Grace-jr for CPU micro-architecture aarch64-nvidia-grace for repository eessi.io-2023.06-software in job dir /p/project1/ceasybuilders/bot-rt/jobs/2025.03/pr_991/13548442

date job status comment
Mar 31 15:19:44 UTC 2025 submitted job id 13548442 awaits release by job manager
Mar 31 15:20:32 UTC 2025 released job awaits launch by Slurm scheduler
Mar 31 15:21:36 UTC 2025 running job 13548442 is running
Mar 31 15:44:16 UTC 2025 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job13548442.result does not exist in job directory, or parsing it failed.
  • No artefacts were found/reported.
Mar 31 15:44:16 UTC 2025 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job13548442.test does not exist in job directory, or parsing it failed.

ocaisa
ocaisa reviewed Mar 31, 2025
View reviewed changes
easystacks/software.eessi.io/2023.06/grace/eessi-2023.06-eb-4.9.4-2023a.yml
- dask-2023.9.2-foss-2023a.eb
- JupyterNotebook-7.0.2-GCCcore-12.3.0.eb
- ImageMagick-7.1.1-15-GCCcore-12.3.0.eb
- Z3-4.12.2-GCCcore-12.3.0.eb
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are these ordered properly? I just checked and Z3 is a direct dependency of PyTorch since 4.9.1. It doesn't matter really it is just an observation.

Copy link
Collaborator Author

@TopRichard TopRichard Mar 31, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Following steps done in : https://github.com/EESSI/software-layer/blob/2023.06-software.eessi.io/easystacks/software.eessi.io/2023.06/sapphirerapids/eessi-2023.06-eb-4.9.0-2023a.yml

We can also remove it.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So does that mean the file name is wrong and it should be 4.9.0?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are using EB 4.9.4 all the way, and moving in order starting from the oldest EB versions

@TopRichard
Copy link
Collaborator Author

Job canceled manually after being inactive for some time

Merge branch '2023.06-software.eessi.io' of ssh://github.com/EESSI/so…
b095f82 
…ftware-layer into eessi-2023.06-grace-remaining-apps-from-EB-4.9.0-easystack
@TopRichard
Copy link
Collaborator Author

bot: build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 1, 2025 •
edited
Loading

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

    • no jobs were submitted

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 1, 2025 •
edited
Loading

Updates by the bot instance eessi-bot-mc-azure (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

    • no jobs were submitted

@eessi-bot-toprichard
Copy link

eessi-bot-toprichard bot commented Apr 1, 2025 •
edited
Loading

Updates by the bot instance rt-Grace-jr (click for details)

  • received bot command build inst:rt-Grace-jr arch:aarch64/nvidia/grace repo:eessi.io-2023.06-software from TopRichard

    • expanded format: build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software

  • handling command build instance:rt-Grace-jr architecture:aarch64/nvidia/grace repository:eessi.io-2023.06-software resulted in:

@eessi-bot-trz42
Copy link

Updates by the bot instance trz42-GH200-jr (click for details)
  • account TopRichard has NO permission to send commands to the bot

@eessi-bot-toprichard
Copy link

eessi-bot-toprichard bot commented Apr 1, 2025 •
edited
Loading

New job on instance rt-Grace-jr for CPU micro-architecture aarch64-nvidia-grace for repository eessi.io-2023.06-software in job dir /p/project1/ceasybuilders/bot-rt/jobs/2025.04/pr_991/13548829

date job status comment
Apr 01 13:23:47 UTC 2025 submitted job id 13548829 awaits release by job manager
Apr 01 13:24:42 UTC 2025 released job awaits launch by Slurm scheduler
Apr 01 13:25:45 UTC 2025 running job 13548829 is running
Apr 01 13:49:31 UTC 2025 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job13548829.result does not exist in job directory, or parsing it failed.
  • No artefacts were found/reported.
Apr 01 13:49:31 UTC 2025 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job13548829.test does not exist in job directory, or parsing it failed.

@trz42
Copy link
Collaborator

trz42 commented Apr 2, 2025

The build process for Highway-1.0.4-GCCcore-12.3.0 fails; it would be better to split into smaller PRs

Might be worth to double check why and for what Highway is built here. It was a dependency of some R (?) package (before summer 2024), but later (after summer 2024) we figured out that it wasn't needed as a dependency and hence the dependency to it was removed.

trz42
trz42 approved these changes Apr 2, 2025
View reviewed changes
Copy link
Collaborator

@trz42 trz42 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@trz42 trz42 added ready-to-deploy Mark a PR as ready to deploy and removed ready-to-review labels Apr 2, 2025
@TopRichard TopRichard added bot:deploy Ask bot to deploy missing software installations to EESSI and removed ready-to-deploy Mark a PR as ready to deploy labels Apr 2, 2025
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, which has no permission to trigger the action

1 similar comment
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, which has no permission to trigger the action

@eessi-bot-surf
Copy link

eessi-bot-surf bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, but this person does not have permission to trigger deployments

@TopRichard TopRichard added bot:deploy Ask bot to deploy missing software installations to EESSI and removed bot:deploy Ask bot to deploy missing software installations to EESSI labels Apr 2, 2025
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, which has no permission to trigger the action

1 similar comment
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, which has no permission to trigger the action

@eessi-bot-surf
Copy link

eessi-bot-surf bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, but this person does not have permission to trigger deployments

1 similar comment
@eessi-bot-trz42
Copy link

Label bot:deploy has been set by user TopRichard, but this person does not have permission to trigger deployments

@TopRichard TopRichard added bot:deploy Ask bot to deploy missing software installations to EESSI and removed bot:deploy Ask bot to deploy missing software installations to EESSI labels Apr 2, 2025
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, which has no permission to trigger the action

1 similar comment
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, which has no permission to trigger the action

@eessi-bot-surf
Copy link

eessi-bot-surf bot commented Apr 2, 2025

Label bot:deploy has been set by user TopRichard, but this person does not have permission to trigger deployments

1 similar comment
@eessi-bot-trz42
Copy link

Label bot:deploy has been set by user TopRichard, but this person does not have permission to trigger deployments

@TopRichard
Copy link
Collaborator Author

bot:deploy label has been re-set after restarting the bot instance

@TopRichard
Copy link
Collaborator Author

Tarball ingested, accessible

@TopRichard TopRichard merged commit d346db5 into EESSI:2023.06-software.eessi.io Apr 3, 2025
49 of 59 checks passed
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 3, 2025

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.04.03

1 similar comment
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Apr 3, 2025

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.04.03

@eessi-bot-toprichard
Copy link

PR merged! Moved ['/p/project1/ceasybuilders/bot-rt/jobs/2025.03/pr_991/13548442', '/p/project1/ceasybuilders/bot-rt/jobs/2025.03/pr_991/13548058', '/p/project1/ceasybuilders/bot-rt/jobs/2025.04/pr_991/13548829', '/p/project1/ceasybuilders/bot-rt/jobs/2025.04/pr_991/13548958', '/p/project1/ceasybuilders/bot-rt/jobs/2025.04/pr_991/13549000', '/p/project1/ceasybuilders/bot-rt/jobs/2025.04/pr_991/13550723', '/p/project1/ceasybuilders/bot-rt/jobs/2025.04/pr_991/13549245'] to /p/project1/ceasybuilders/bot-rt/trash_bin/EESSI/software-layer/2025.04.03

@TopRichard TopRichard mentioned this pull request Apr 3, 2025
Merged
@trz42 trz42 mentioned this pull request Apr 20, 2025
Open
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ocaisa ocaisa ocaisa left review comments

@trz42 trz42 trz42 approved these changes

Assignees
No one assigned
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io bot:deploy Ask bot to deploy missing software installations to EESSI grace NVIDIA Grace CPU
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@TopRichard @trz42 @ocaisa