Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new tier1 platform Blueback & fix for multiple cray-libsci versions on Narwhal #1527

Draft
wants to merge 12 commits into
base: develop
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 5 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions configs/sites/tier1/blueback/compilers.gcc-direct.tmp
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
compilers::
- compiler:
spec: gcc@=13.3.0
paths:
cc: /usr/bin/gcc
cxx: /usr/bin/g++
f77: /usr/bin/gfortran
fc: /usr/bin/gfortran
flags: {}
operating_system: sles15
target: x86_64
modules:
- PrgEnv-gnu/8.5.0
- gcc-native/13.2
- cray-libsci/24.07.0
- libfabric/1.20.1
environment:
prepend_path:
LD_LIBRARY_PATH: '/opt/cray/libfabric/1.20.1/lib64:/opt/cray/pe/libsci/24.07.0/GNU/12.3/x86_64/lib'
set:
CONFIG_SITE: ''
CRAY_CPU_TARGET: x86-genoa
extra_rpaths: []
67 changes: 67 additions & 0 deletions configs/sites/tier1/blueback/compilers.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
compilers::
- compiler:
spec: gcc@=13.3.0
paths:
cc: cc
cxx: CC
f77: ftn
fc: ftn
flags: {}
operating_system: sles15
target: x86_64
modules:
- PrgEnv-gnu/8.5.0
- gcc-native/13.2
- cray-libsci/24.07.0
- libfabric/1.20.1
environment:
prepend_path:
LD_LIBRARY_PATH: '/opt/cray/libfabric/1.20.1/lib64:/opt/cray/pe/libsci/24.07.0/GNU/12.3/x86_64/lib'
set:
CONFIG_SITE: ''
CRAY_CPU_TARGET: x86-genoa
extra_rpaths: []
- compiler:
spec: oneapi@=2024.2.1
paths:
cc: cc
cxx: CC
f77: ftn
fc: ftn
flags: {}
operating_system: sles15
target: x86_64
modules:
- PrgEnv-intel/8.5.0
- intel-oneapi/2024.2
- cray-libsci/24.07.0
- libfabric/1.20.1
environment:
prepend_path:
LD_LIBRARY_PATH: '/opt/cray/libfabric/1.20.1/lib64:/opt/cray/pe/libsci/24.07.0/INTEL/2023.2/x86_64/lib'
set:
CONFIG_SITE: ''
CRAY_CPU_TARGET: x86-genoa
extra_rpaths: []
#- compiler:
# spec: oneapi@=2025.0.4
# paths:
# cc: cc
# cxx: CC
# f77: ftn
# fc: ftn
# flags: {}
# operating_system: sles15
# target: x86_64
# modules:
# - PrgEnv-intel/8.5.0
# - intel-oneapi/2025.0
# - cray-libsci/24.07.0
# - libfabric/1.20.1
# environment:
# prepend_path:
# LD_LIBRARY_PATH: '/opt/cray/libfabric/1.20.1/lib64:/opt/cray/pe/libsci/24.07.0/INTEL/2023.2/x86_64/lib'
# set:
# CONFIG_SITE: ''
# CRAY_CPU_TARGET: x86-genoa
# extra_rpaths: []
2 changes: 2 additions & 0 deletions configs/sites/tier1/blueback/config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
config:
build_jobs: 8
3 changes: 3 additions & 0 deletions configs/sites/tier1/blueback/mirrors.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
mirrors:
local-source: file:///p/cwfs/projects/NEPTUNE/spack-stack/source-cache
local-binary: file:///p/cwfs/projects/NEPTUNE/spack-stack/build-cache
7 changes: 7 additions & 0 deletions configs/sites/tier1/blueback/modules.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
modules:
default:
enable::
- tcl
tcl:
include:
- python
139 changes: 139 additions & 0 deletions configs/sites/tier1/blueback/packages.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,139 @@
packages:

# Modification of common packages
# Use system zlib instead of spack-built zlib-ng
all:
providers:
zlib-api:: [zlib]
zlib-api:
buildable: False
zlib:
buildable: False
externals:
- spec: [email protected]
prefix: /usr

# All other packages listed alphabetically
autoconf:
externals:
- spec: [email protected]
prefix: /usr
automake:
externals:
- spec: [email protected]
prefix: /usr
binutils:
externals:
- spec: [email protected]~gold+headers
prefix: /usr
bison:
externals:
- spec: [email protected]
prefix: /usr
cmake:
externals:
- spec: [email protected]
prefix: /usr
coreutils:
externals:
- spec: [email protected]
prefix: /usr
cvs:
externals:
- spec: [email protected]
prefix: /usr
#curl:
# externals:
# - spec: [email protected]+gssapi+ldap+nghttp2
# prefix: /usr
diffutils:
externals:
- spec: [email protected]
prefix: /usr
findutils:
externals:
- spec: [email protected]
prefix: /usr
flex:
externals:
- spec: [email protected]+lex
prefix: /usr
gawk:
externals:
- spec: [email protected]
prefix: /usr
gettext:
externals:
- spec: [email protected]
prefix: /usr
git:
externals:
- spec: [email protected]+tcltk
prefix: /usr
# NOT YET AVAILABLE git-lfs:
# NOT YET AVAILABLE externals:
# NOT YET AVAILABLE - spec: [email protected]
# NOT YET AVAILABLE prefix: /usr
gmake:
externals:
- spec: [email protected]
prefix: /usr
grep:
externals:
- spec: [email protected]
prefix: /usr
groff:
externals:
- spec: [email protected]
prefix: /usr
libtool:
externals:
- spec: [email protected]
prefix: /usr
m4:
externals:
- spec: [email protected]
prefix: /usr
openssh:
externals:
- spec: [email protected]
prefix: /usr
#openssl:
# externals:
# - spec: [email protected]
# prefix: /usr
perl:
externals:
- spec: [email protected]~cpanm+opcode+open+shared+threads
prefix: /usr
pkg-config:
externals:
- spec: [email protected]
prefix: /usr
# MISSING qt:
# buildable: False
# externals:
# - spec: [email protected]
# prefix: /p/app/projects/NEPTUNE/spack-stack/qt-5.15.2/5.15.2/gcc_64
# modules:
# - qt/5.15.2
sed:
externals:
- spec: [email protected]
prefix: /usr
subversion:
externals:
- spec: [email protected]
prefix: /usr
tar:
externals:
- spec: [email protected]
prefix: /usr
texinfo:
externals:
- spec: [email protected]
prefix: /usr
wget:
externals:
- spec: [email protected]
prefix: /usr
13 changes: 13 additions & 0 deletions configs/sites/tier1/blueback/packages_gcc.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
packages:
all:
compiler:: [[email protected]]
providers:
mpi:: [[email protected]]
mpi:
buildable: False
cray-mpich:
externals:
- spec: [email protected]%[email protected] ~wrappers
modules:
- cray-mpich/8.1.30
- craype-network-ofi
43 changes: 43 additions & 0 deletions configs/sites/tier1/blueback/packages_oneapi.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
packages:
all:
compiler:: [[email protected],[email protected]]
providers:
mpi:: [[email protected]]
mpi:
buildable: False
cray-mpich:
externals:
- spec: [email protected]%[email protected] ~wrappers
modules:
- cray-mpich/8.1.30
- craype-network-ofi
intel-oneapi-mkl:
externals:
- spec: [email protected]%[email protected]
prefix: /p/app/intel/oneapi-combined
intel-oneapi-tbb:
externals:
- spec: [email protected]%[email protected]
prefix: /p/app/intel/oneapi-combined
intel-oneapi-runtime:
externals:
- spec: [email protected]%[email protected]
prefix: /p/app/intel/oneapi-combined
#cray-mpich:
# externals:
# - spec: [email protected]%[email protected] +wrappers
# modules:
# - cray-mpich/8.1.30
# - craype-network-ofi
#intel-oneapi-mkl:
# externals:
# - spec: [email protected]%[email protected]
# prefix: /p/app/intel/oneapi-combined
#intel-oneapi-tbb:
# externals:
# - spec: [email protected]%[email protected]
# prefix: /p/app/intel/oneapi-combined
#intel-oneapi-runtime:
# externals:
# - spec: [email protected]%[email protected]
# prefix: /p/app/intel/oneapi-combined
6 changes: 4 additions & 2 deletions configs/sites/tier1/narwhal/compilers.gcc-direct.tmp
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,8 @@ compilers::
cxx: /opt/cray/pe/gcc/10.3.0/snos/bin/g++
f77: /opt/cray/pe/gcc/10.3.0/snos/bin/gfortran
fc: /opt/cray/pe/gcc/10.3.0/snos/bin/gfortran
flags: {}
flags:
ldflags: -L /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
operating_system: sles15
modules:
- PrgEnv-gnu/8.4.0
Expand All @@ -19,4 +20,5 @@ compilers::
LD_LIBRARY_PATH: '/opt/cray/libfabric/1.12.1.2.2.1/lib64:/opt/cray/pe/libsci/23.05.1.4/GNU/10.3/x86_64/lib'
set:
CRAYPE_LINK_TYPE: 'dynamic'
extra_rpaths: []
extra_rpaths:
- /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
18 changes: 12 additions & 6 deletions configs/sites/tier1/narwhal/compilers.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,8 @@ compilers::
cxx: CC
f77: ftn
fc: ftn
flags: {}
flags:
ldflags: -L /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
operating_system: sles15
modules:
- PrgEnv-intel/8.4.0
Expand All @@ -20,15 +21,17 @@ compilers::
LD_LIBRARY_PATH: '/opt/cray/libfabric/1.12.1.2.2.1/lib64:/opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib:/opt/cray/pe/gcc/10.3.0/snos/lib:/opt/cray/pe/gcc/10.3.0/snos/lib64'
set:
CRAYPE_LINK_TYPE: 'dynamic'
extra_rpaths: []
extra_rpaths:
- /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
- compiler:
spec: [email protected]
paths:
cc: cc
cxx: CC
f77: ftn
fc: ftn
flags: {}
flags:
ldflags: -L /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
operating_system: sles15
modules:
- PrgEnv-intel/8.4.0
Expand All @@ -44,7 +47,8 @@ compilers::
CPATH: '/opt/intel/oneapi_2024.2.0.634/compiler/2024.2/opt/compiler/include/intel64'
set:
CRAYPE_LINK_TYPE: 'dynamic'
extra_rpaths: []
extra_rpaths:
- /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
- compiler:
spec: [email protected]
paths:
Expand All @@ -58,7 +62,8 @@ compilers::
#cxx: /opt/cray/pe/gcc/10.3.0/snos/bin/g++
#f77: /opt/cray/pe/gcc/10.3.0/snos/bin/gfortran
#fc: /opt/cray/pe/gcc/10.3.0/snos/bin/gfortran
flags: {}
flags:
ldflags: -L /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
operating_system: sles15
modules:
- PrgEnv-gnu/8.4.0
Expand All @@ -70,4 +75,5 @@ compilers::
LD_LIBRARY_PATH: '/opt/cray/libfabric/1.12.1.2.2.1/lib64:/opt/cray/pe/libsci/23.05.1.4/GNU/10.3/x86_64/lib'
set:
CRAYPE_LINK_TYPE: 'dynamic'
extra_rpaths: []
extra_rpaths:
- /opt/cray/pe/libsci/23.05.1.4/INTEL/2022.2/x86_64/lib
6 changes: 0 additions & 6 deletions doc/source/KnownIssues.rst
Original file line number Diff line number Diff line change
Expand Up @@ -71,12 +71,6 @@ UW (Univ. of Wisconsin) S4
icpc: error #10106: Fatal error in /home/opt/intel/oneapi/2022.1/compiler/2022.0.1/linux/bin/intel64/../../bin/intel64/mcpcom, terminated by kill signal
...

==============================
NAVY HPCMP Narwhal
==============================

1. On Narwhal (like on any other Cray), the spack build environment depends on the currently loaded modules. It is therefore necessary to build separate environments for different compilers while having the correct modules for that setup loaded.

==============================
macOS
==============================
Expand Down
Loading
Loading