Skip to content

Commit 132a2c4

Browse files
KateFriedman-NOAAKateFriedman-NOAA
authored
GFSv16.3.21 - WAFS removal from GFS (#3281)
The WAFS is now a separate package in operations and is no longer a part of the GFS. Also included in this package are the following unrelated updates: 1. improvements to the enkfgdas_update job resource and environment settings 2. a fix for the syndat_getjtbul code when parsing 3-character storm names Refs #2591
1 parent 47454d7 commit 132a2c4

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

48 files changed

+123
-1739
lines changed

‎Externals.cfg

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -42,12 +42,5 @@ repo_url = https://github.com/NOAA-EMC/EMC_verif-global.git
4242
protocol = git
4343
required = True
4444

45-
[EMC_gfs_wafs]
46-
tag = gfs_wafs.v6.3.3
47-
local_path = sorc/gfs_wafs.fd
48-
repo_url = https://github.com/NOAA-EMC/EMC_gfs_wafs.git
49-
protocol = git
50-
required = False
51-
5245
[externals_description]
5346
schema_version = 1.0.0

‎docs/Release_Notes.md

Lines changed: 96 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -1,21 +1,21 @@
1-
GFS V16.3.20 RELEASE NOTES
1+
GFS V16.3.21 RELEASE NOTES
22

33
-------
44
PRELUDE
55
-------
66

7-
Annual CO2 fix file update for 2025. Additionally, the GSI is updated to turn on assimilation of PlanetiQ GPS Radio Occultation (GPS-RO) data.
7+
The WAFS is separated from the GFS and is now its own package in production as WAFS.v7.0.1. A code update for syndat_getjtbul is also included.
88

99
IMPLEMENTATION INSTRUCTIONS
1010
---------------------------
1111

12-
The NOAA VLab and the NOAA-EMC and NCAR organization spaces on GitHub are used to manage the GFS code. The SPA(s) handling the GFS implementation need to have permissions to clone VLab Gerrit repositories and the private NCAR UPP_GTG repository. All NOAA-EMC organization repositories are publicly readable and do not require access permissions. Please proceed with the following steps to install the package on WCOSS2:
12+
The NOAA VLab and the NOAA-EMC and NCAR organization spaces on GitHub are used to manage the GFS code. The SPA(s) handling the GFS implementation need to have permissions to clone VLab Gerrit repositories. All NOAA-EMC organization repositories on GitHub are publicly readable and do not require access permissions. Please proceed with the following steps to install the package on WCOSS2:
1313

1414
```bash
1515
cd $PACKAGEROOT
16-
mkdir gfs.v16.3.20
17-
cd gfs.v16.3.20
18-
git clone -b EMC-v16.3.20 https://github.com/NOAA-EMC/global-workflow.git .
16+
mkdir gfs.v16.3.21
17+
cd gfs.v16.3.21
18+
git clone -b EMC-v16.3.21 https://github.com/NOAA-EMC/global-workflow.git .
1919
cd sorc
2020
./checkout.sh -o
2121
```
@@ -29,7 +29,6 @@ The checkout script extracts the following GFS components:
2929
| GSI | gfsda.v16.3.20 | [email protected] |
3030
| UFS_UTILS | ops-gfsv16.3.0 | [email protected] |
3131
| POST | upp_v8.3.0 | [email protected] |
32-
| WAFS | gfs_wafs.v6.3.3 | [email protected] |
3332

3433
To build all the GFS components, execute:
3534
```bash
@@ -50,78 +49,148 @@ cd ../ecf
5049
VERSION FILE CHANGES
5150
--------------------
5251

53-
* `versions/run.ver` - change `version=v16.3.20` and `gfs_ver=v16.3.20`
52+
* `versions/run.ver` - change `version=v16.3.21` and `gfs_ver=v16.3.21`
5453

5554
SORC CHANGES
5655
------------
5756

58-
* No changes from GFS v16.3.19
57+
The WAFS is no longer a submodule that is checked out within the GFS package.
58+
The `sorc/checkout.sh` and `Externals.cfg` checkout script no longer clone WAFS.
59+
The `sorc/build_all.sh` script no longer builds the WAFS code.
60+
The `sorc/build_gfs_wafs.sh` build script is deleted.
61+
The `sorc/link_fv3gfs.sh` script no longer links/copies WAFS files/execs.
62+
63+
Also included in this package is a fix to the syndat_getjtbul code to resolve a
64+
parsing problem with 3-character storm names.
5965

6066
JOBS CHANGES
6167
------------
6268

63-
* No changes from GFS v16.3.19
69+
All WAFS jobs are removed from the GFS ecFlow definition file, rocoto mesh, and `ush/ecflow/prod.yml`.
70+
Jobs removed:
71+
* `jgfs_atmos_wafs_gcip`
72+
* `jgfs_atmos_wafs_fFFF`
73+
* `jgfs_atmos_wafs_grib2`
74+
* `jgfs_atmos_wafs_grib2_0p25`
75+
* `jgfs_atmos_wafs_blending_0p25`
6476

6577
PARM/CONFIG CHANGES
6678
-------------------
6779

68-
* No changes from GFS v16.3.19
80+
The following config files are deleted:
81+
* `parm/config/config.wafs`
82+
* `parm/config/config.wafsblending`
83+
* `parm/config/config.wafsblending0p25`
84+
* `parm/config/config.wafsgcip`
85+
* `parm/config/config.wafsgrib2`
86+
* `parm/config/config.wafsgrib20p25`
87+
88+
* The `WAFSF` flag is removed from `parm/config/config.base.emc.dyn` and `parm/config/config.base.nco.static`.
89+
* All WAFS jobs are removed from platform env files, `parm/config/config.resources.emc.dyn`, and `parm/config/config.resources.nco.static`.
90+
* The WAFS jobs are removed from experiment setup.
91+
92+
WAFS output is removed from the following transfer list files:
93+
* `parm/product/transfer_gfs_1.list`
94+
* `parm/product/transfer_gfs_7.list`
6995

7096
SCRIPT CHANGES
7197
--------------
7298

73-
* No changes from GFS v16.3.19
99+
The following WAFS rocoto scripts are removed:
100+
* `jobs/rocoto/wafs.sh`
101+
* `jobs/rocoto/wafsblending.sh`
102+
* `jobs/rocoto/wafsblending0p25.sh`
103+
* `jobs/rocoto/wafsgcip.sh`
104+
* `jobs/rocoto/wafsgrib2.sh`
105+
* `jobs/rocoto/wafsgrib20p25.sh`
106+
107+
The following ecf scripts are removed from the GFS:
108+
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending.ecf`
109+
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf`
110+
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2.ecf`
111+
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2_0p25.ecf`
112+
* `ecf/scripts/gfs/atmos/post_processing/grib_wafs/jgfs_atmos_wafs_master.ecf`
113+
* `ecf/scripts/gfs/atmos/post_processing/jgfs_atmos_wafs_gcip.ecf`
114+
115+
The WAFS is removed from `ecf/setup_ecf_links.sh`.
116+
117+
The WAFS output is removed from archival (`ush/hpssarch_gen.sh`).
74118

75119
FIX CHANGES
76120
-----------
77121

78-
* New 2025 CO2 fix files are added.
79-
* Updated `global_convinfo.txt` file in GSI package
122+
* `fix/product/wafs_admin_msg` - removed
80123

81124
MODULE CHANGES
82125
--------------
83126

84-
* No changes from GFS v16.3.19
85-
86-
CHANGES TO FILE SIZES
87-
---------------------
88-
89-
* No changes of existing file sizes from GFS v16.3.19
127+
Modules needed by WAFS are removed from `modulefiles/module_base.wcoss_dell_p3`.
128+
129+
CHANGES TO FILE AND FILE SIZES
130+
------------------------------
131+
132+
The following files will no longer be produced within the GFS COM:
133+
* `gfs.tCCz.awf_0p25.fFFF.grib2` - renamed to `wafs.tCCz.awf.0p25.fFFF.grib2` in WAFSv7. Filesize is changed from 55M to 56M with 7 extra levels of aviation fields.
134+
* `gfs.tCCz.awf_grb45fFF.grib2` - renamed to `wafs.tCCz.awf_grid45.fFFF.grib2` in WAFSv7
135+
* `wmo/grib2.tCCz.awf_grbfFF.45` - renamed to `wmo/grib2.wafs.tCCz.awf_grid45.fFFF` in WAFSv7
136+
* `gfs.tCCz.wafs.0p25.anl` - renamed to `wafs.tCCz.0p25.anl.grib2` in WAFSv7
137+
* `gfs.tCCz.wafs.0p25.anl.idx`
138+
* `gfs.tCCz.wafs_0p25_unblended.fFFF.grib2` - renamed to `WAFS_0p25_unblended_YYYYMMDDHHfFFF.grib2` in WAFSv7
139+
* `gfs.tCCz.wafs_0p25_unblended.fFFF.grib2.idx`
140+
* `gfs.tCCz.wafs.grb2fFFF` - renamed to `wafs.tCCz.master.fFFF.grib2` in WAFSv7. Between forecast hours [006-048], filesize is changed from 929M to 936M with 7 extra levels of aviation fields; for f000, filesize increases from 949M to 956M with 7 extra levels of aviation fields. No size change for other forecast hours
141+
* `gfs.tCCz.wafs.grb2fFFF.idx`
142+
* `gfs.tCCz.wafs_grb45fFF.grib2` - renamed to `gfs.tCCz.wafs_grb45fFFF.grib2` in WAFSv7
143+
* `gfs.tCCz.wafs_grb45fFF.grib2.idx`
144+
* `wmo/grib2.tCCz.wafs_grbfFF.45` - renamed to `wmo/grib2.wafs.tCCz.awf_grid45.fFFF` in WAFSv7
145+
* `wmo/xtrn.wfsgfsCCFF[a/b].gfs_atmos_wafs_fFF_CC` - renamed to `wmo/xtrn.wfsgfsCCFF[a/b]` in WAFSv7
146+
* `gfs.tCCz.gcip.f00.grib2` - renamed to `wafs.tCCz.gcip.f000.grib2` in WAFSv7
147+
* `WAFS_0p25_blended_YYYYMMDDHHf[06-48].grib2` - renamed to `WAFS_0p25_blended_ YYYYMMDDHHfFFF.grib2` in WAFSv7
148+
149+
The following files will no longer be produced within the GFS COM
150+
and are being retired from the WAFS package, which will free 20G:
151+
* `gfs.tCCz.wafs_icao.grb2fFFF`
152+
* `gfs.tCCz.wafs_icao.grb2fFFF.idx`
153+
* `wafs.tCCz.master.fFFF.grib2` where FFF is from 001 to 005
154+
* `gfs.tCCz.control.wafsblending_0p25`
90155

91156
ENVIRONMENT AND RESOURCE CHANGES
92157
--------------------------------
93158

94-
* Memory increases to some jobs to resolve Cgroup memory warnings
159+
* Updates to improve the enkfgdas_update job runtime stability.
160+
* Run with `--cpu-bind core` instead of `--cpu-bind depth`
161+
* Change tasks to 280 and threads to 16
95162

96163
PRE-IMPLEMENTATION TESTING REQUIREMENTS
97164
---------------------------------------
98165

99166
* Which production jobs should be tested as part of this implementation?
100-
* Analysis
167+
* None
101168
* Does this change require a 30-day evaluation?
102169
* No
103170

104171
DISSEMINATION INFORMATION
105172
-------------------------
106173

107-
* No changes from GFS v16.3.19
174+
* No changes from GFS v16.3.20
108175

109176
HPSS ARCHIVE
110177
------------
111178

112-
* No changes from GFS v16.3.19
179+
* No changes from GFS v16.3.20
113180

114181
JOB DEPENDENCIES AND FLOW DIAGRAM
115182
---------------------------------
116183

117-
* No changes from GFS v16.3.19
184+
* Removal of WAFS jobs.
118185

119186
DOCUMENTATION
120187
-------------
121188

122-
* No changes from GFS v16.3.19
189+
* No changes from GFS v16.3.20
123190

124191
PREPARED BY
125192
-----------
126193
[email protected]
127-
[email protected]
194+
[email protected]
195+
[email protected]
196+
[email protected]

0 commit comments

Comments
 (0)