Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use consistent fixed prescribed ioda file names at the DA runtime #290

Open
wants to merge 4 commits into
base: develop
Choose a base branch
from
Open

use consistent fixed prescribed ioda file names at the DA runtime #290

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
c711c51
use consistent fixed prescribed ioda file names at the DA runtime
guoqing-noaa Feb 21, 2025
ee69095
remove 'set -x'
guoqing-noaa Feb 21, 2025
046c724
fix a typo:jdiag_atmos_npp.nc4 -> jdiag_atms_npp.nc4
guoqing-noaa Feb 21, 2025
1abf678
address the failed bufr2ioda test
guoqing-noaa Feb 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion rrfs-test/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -152,7 +152,7 @@ if(MPAS_DYCORE)
ARGS ${CMAKE_SOURCE_DIR}/rrfs-test/ush/iodaconv_comp_rrfs.sh
netcdf
"${CMAKE_BINARY_DIR}/bin/bufr2ioda.x ${case}.yaml"
data/obs/ioda_msonet.nc
data/obs/ioda_msonet_ctest.nc
ioda_msonet.nc
${IODA_CONV_COMP_TOL}
DEPENDS bufr2ioda.x )
Expand Down
15 changes: 14 additions & 1 deletion rrfs-test/scripts/link_fv3jedi_expr.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,20 @@ sed -e "s#@RDASApp@#${RDASApp}#" ${RDASApp}/rrfs-test/scripts/templates/fv3jedi_
cp ${RDASApp}/rrfs-test/ush/colormap.py .
cp ${RDASApp}/rrfs-test/ush/fv3jedi_increment_singleob.py .
cp ${RDASApp}/rrfs-test/ush/fv3jedi_increment_fulldom.py .
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data Data
rm -rf Data; mkdir Data
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data/* Data/
# link correct ioda files
rm -rf Data/obs; mkdir Data/obs
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data/obs/* Data/obs/ # keep this line for now to be backward compatible
for dcfile in Data/obs/ioda*dc.nc; do # link to DA runtime prescribed file names
dcfile=${dcfile##*obs/}
regfile="${dcfile%%_dc.nc}.nc"
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data/obs/${dcfile} Data/obs/${regfile}
done
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data/obs/amsua_n19_obs.2024052700_dc.nc Data/obs/ioda_amsua_n19.nc
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data/obs/atms_n20_obs_2024052700_dc.nc Data/obs/ioda_atms_n20.nc
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data/obs/atms_npp_obs_2024052700_dc.nc Data/obs/ioda_atms_npp.nc
#
ln -snf ${RDASApp}/fix/expr_data/${exprname}/DataFix DataFix
ln -snf ${RDASApp}/fix/expr_data/${exprname}/Data_static Data_static
ln -snf ${RDASApp}/fix/expr_data/${exprname}/INPUT INPUT
13 changes: 12 additions & 1 deletion rrfs-test/scripts/link_mpasjedi_expr.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,18 @@ ln -snf ${RDASApp}/fix/bumploc/${BUMPLOC} bumploc/${BUMPLOC}
ln -snf ${RDASApp}/fix/B_static/L55_20241204 B_static
ln -snf ${RDASApp}/fix/expr_data/${exprname}/bkg/mpasout.2024-05-27_00.00.00.nc .
ln -snf ${RDASApp}/fix/expr_data/${exprname}/invariant.nc invariant.nc
ln -snf ${RDASApp}/fix/expr_data/${exprname}/obs/* obs/
# link the correct ioda files
ln -snf ${RDASApp}/fix/expr_data/${exprname}/obs/* obs/ # keep this line for now to be backward compatible
ln -snf ${RDASApp}/fix/expr_data/${exprname}/obs/ioda_msonet.nc obs/ioda_msonet_ctest.nc
for dcfile in obs/ioda*dc.nc; do # link to DA runtime prescribed file names
dcfile=${dcfile##obs/}
regfile="${dcfile%%_dc.nc}.nc"
ln -snf ${RDASApp}/fix/expr_data/${exprname}/obs/${dcfile} obs/${regfile}
done
ln -snf ${RDASApp}/fix/expr_data/${exprname}/obs/amsua_n19_obs.2024052700_dc.nc obs/ioda_amsua_n19.nc
ln -snf ${RDASApp}/fix/expr_data/${exprname}/obs/atms_n20_obs_2024052700_dc.nc obs/ioda_atms_n20.nc
ln -snf ${RDASApp}/fix/expr_data/${exprname}/obs/atms_npp_obs_2024052700_dc.nc obs/ioda_atms_npp.nc
#
ln -snf ${RDASApp}/fix/expr_data/${exprname}/ens/* ens/
ln -snf ${RDASApp}/fix/crtm/2.4.0 crtm

2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/adpsfc_airTemperature_187.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_adpsfc.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/adpsfc_specificHumidity_187.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_adpsfc.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/adpsfc_stationPressure_187.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_adpsfc.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/adpsfc_winds_287.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_adpsfc.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/adpupa_airTemperature_120.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_adpupa.nc
obsgrouping:
group variables: ["stationIdentification"]
sort variable: "pressure"
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/adpupa_specificHumidity_120.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_adpupa.nc
obsgrouping:
group variables: ["stationIdentification"]
sort variable: "pressure"
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/adpupa_winds_220.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_adpupa.nc
obsgrouping:
group variables: ["stationIdentification"]
sort variable: "pressure"
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircar_airTemperature_133.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircar.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircar_specificHumidity_133.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircar.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircar_winds_233.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircar.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_airTemperature_130.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_airTemperature_131.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_airTemperature_134.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_airTemperature_135.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_specificHumidity_134.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_winds_230.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_winds_231.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_winds_234.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/aircft_winds_235.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_aircft.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/amsua_n19.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
obsdatain:
engine:
type: H5File
obsfile: data/obs/amsua_n19_obs.2024052700.nc
obsfile: data/obs/ioda_amsua_n19.nc
obsdataout:
engine:
type: H5File
Expand Down
4 changes: 2 additions & 2 deletions rrfs-test/validated_yamls/templates/obtype_config/atms_npp_qc_bc.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_atms_npp.nc
obsdataout:
engine:
type: H5File
obsfile: rass_atms_obs_2024052700.nc4
obsfile: jdiag_atms_npp.nc4
simulated variables: [brightnessTemperature]
observed variables: [brightnessTemperature]
channels: &atms_npp_channels 1-22
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/msonet_airTemperature_188.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_msonet.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/msonet_specificHumidity_188.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_msonet.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/msonet_stationPressure_188.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_msonet.nc
obsdataout:
engine:
type: H5File
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/msonet_winds_288.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_msonet.nc
obsdataout:
engine:
type: H5File
Expand Down
4 changes: 1 addition & 3 deletions rrfs-test/validated_yamls/templates/obtype_config/proflr_winds_227.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
#obsfile: "obsout/windprof_obs_2024052700.nc4"
#obsfile: "obsout/windprof_obs_2024052700_dc.nc4"
obsfile: data/obs/ioda_proflr.nc
obsgrouping:
group variables: ["stationIdentification"]
sort variable: "pressure"
Expand Down
3 changes: 1 addition & 2 deletions rrfs-test/validated_yamls/templates/obtype_config/rassda_airTemperature_126.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
#obsfile: "obsout/rass_tsen_obs_2024052700_dc.nc4"
obsfile: data/obs/ioda_rassda.nc
obsgrouping:
group variables: ["stationIdentification"]
sort variable: "pressure"
Expand Down
2 changes: 1 addition & 1 deletion rrfs-test/validated_yamls/templates/obtype_config/vadwnd_winds_224.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
obsdatain:
engine:
type: H5File
obsfile: "@OBSFILE@"
obsfile: data/obs/ioda_vadwnd.nc
obsgrouping:
group variables: ["stationIdentification"]
sort variable: "pressure"
Expand Down