Add updates for ozone and end-to-end results #827

emilyhcliu · 2023-12-30T17:24:45Z

GDAS assimilates two types of ozone:

Total Column Ozone
Profile Ozone

For the focus cycle: 2021080100Z, ozone data includes:

ompsnp npp (profile ozone)
ompstc npp (total ozone)
omi aura (total ozone)

This PR includes the following updates for the three ozone data above:

BUFR converters
ObsSpace YAML files
Validation result

Here is the updated QC flowchart for ozone:

…te obsfile for satwnd.abi_goes-16

…s/0.35.0

Two updates for GOES AMV 1. BUFR Converter: - remove wind direction and speed - change sensorZenithAngle to satelliteZenithAngle 2. UFO Filters: - change `sensorZenithAngle` to `satelliteZenithAngle` - add `linear obs operator` section The declaration of `linear obs operator" is necessary for GOES AMV since there is no linearized component for applying the 10-meter factor. The increments look reasonable: ``` 0: ---------------------------------------------------------------------------------------------------- 0: Increment print | number of fields = 8 | cube sphere face size: C768 0: eastward_wind | Min:-1.642335e-01 Max:+1.660654e-01 RMS:+2.746685e-04 0: northward_wind | Min:-2.120068e-01 Max:+1.663539e-01 RMS:+2.631295e-04 0: air_temperature | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: surface_pressure | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: specific_humidity | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: cloud_liquid_ice | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: cloud_liquid_water | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: ozone_mass_mixing_ratio | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: ---------------------------------------------------------------------------------------------------- ``` The UFO filter results vs. GSI -- looks good ![ufo_abi_goes-16_omf_windEastward_qc_time1](https://github.com/NOAA-EMC/GDASApp/assets/36091766/017aeabc-d6ca-4643-b037-16f46dde76a0) ![gsi_abi_goes-16_omf_windEastward_qc_time1](https://github.com/NOAA-EMC/GDASApp/assets/36091766/d99599a2-3f36-4ef6-aa2e-4611500b8c43)

Rather than each new ob type being manually added to the list, we can use `glob.glob` to get the list of available observation types.

Two updates for MetOp SCATWIND; one minor updates for GOES AMV 1. BUFR Converter: - remove wind direction and speed - add `stationElevation` as zero 2. UFO Filters: - add linear obs operator section The declaration of `linear obs operator" is necessary for GOES AMV since there is no linearized component for applying the 10-meter factor. - add `Gaussian Thinning` filter to thin data with 75 km box (equal box size, prefer data close to central of the box) 3. For GOES AMV YAML files, change output data extension from `nc4` to `nc` UFO vs. GSI O-F and QC comparison: O-F and data count passed look close ![ufo_ascat_metop-b_omf_windEastward_qc (1)](https://github.com/NOAA-EMC/GDASApp/assets/36091766/f234543e-e0b5-4c6e-add9-3c7365c0c469) ![gsi_ascat_metop-b_omf_windEastward_qc](https://github.com/NOAA-EMC/GDASApp/assets/36091766/37f4fba8-bd2a-4a54-b45e-4055e3ef3142) 3Dvar increments are reasonable with MetOp-B SCATWIND alone. ``` 0: ---------------------------------------------------------------------------------------------------- 0: Increment print | number of fields = 8 | cube sphere face size: C768 0: eastward_wind | Min:-1.741092e+00 Max:+1.712287e+00 RMS:+2.282584e-03 0: northward_wind | Min:-1.825957e+00 Max:+1.930385e+00 RMS:+2.496075e-03 0: air_temperature | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: surface_pressure | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: specific_humidity | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: cloud_liquid_ice | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: cloud_liquid_water | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: ozone_mass_mixing_ratio | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: ---------------------------------------------------------------------------------------------------- ``` 3DVar increments are also reasonable with MetOp-B + MetOp-A assimilated

…oda.x (#730) This PR allows for all obtypes to be processed in two loops. We still need to figure out a way to process these in parallel (somewhat).

Using python multiprocessing to generate obs in parallel. The current list of obs goes from 10+ minutes to completing in ~5.5 minutes.

@RussTreadon-NOAA

@RussTreadon-NOAA noted that `obs linear operator` should be `linear obs operator` in the GOES-17 satwind YAML. This fixes that.

This reduces runtime further to run everything in one parallel pool. Now, things complete in under 4 minutes (as of now).

Adding satwinds from the Advanced Himawari Imager (AHI) from Himawari-8 to GDASApp end-to-end testing new files include: parm/atm/obs/config/satwind_ahi_h8.yaml: QC filter YAML for AHI Himawari-8 satwinds parm/ioda/bufr2ioda/bufr2ioda_satwind_amv_ahi.json: JSON containing data format, sensor, and satellite information for AHI Himawari-8 satwinds ush/ioda/bufr2ioda/bufr2ioda_satwind_amv_ahi.py: bufr2ioda code for extracting AHI Himawari-8 satwinds from BUFR modified files include: ush/ioda/bufr2ioda/run_bufr2ioda.py: added `"satwind_amv_ahi"` to list `BUFR_py` See #741 for details on testing. JEDI/GSI comparisons look good with GSI thinning turned off, but there are large ob-count disparities both before and after QC when comparing GSI+thinning to JEDI+thinning. The tested `Gaussian Thinning` filter is included in the YAML but commented out with a note. --------- Co-authored-by: Brett Hoover <[email protected]> Co-authored-by: Cory Martin <[email protected]>

Instead of writing the filled out `.json` and `.yaml` files to `$COM_OBS`, we write them to `$DATA` so that they get purged unless `KEEPDATA="YES"`

Updating GNSSRO converter and adding the yaml file to GDASApp end-to-end testing based on [#712](#712). New file: parm/atm/obs/config/gnssro.yaml: Added QC filters in the YAML Updated files: parm/ioda/bufr2ioda/bufr2ioda_gnssro_bufr.json: Updated the satellite information ush/ioda/bufr2ioda/bufr2ioda_gnssro_bufr.py: Updated pccf, qfro, and satelliteAscending flag Refer to [issue #750](#750) for testing details. JEDI/GSI comparisons revealed a cutoff near obs=0.03 Rad due to super refraction 2. The number of observations after QC in JEDI is also inconsistent with GSI.

List of items to be added in this PR: - BUFR Converter: Add YAML for converting ATMS BUFR to IODA - The ObsValue is antenna temperature - Input BUFR is normal feel - Testing YAML: re-evaluation results due to update CRTM from v2.3.0 to v2.4.1-jedi.1 - atms_npp_noqc.yaml --- 100% replication - atms_npp.yaml --- 100 % replication - atms_n20_noqc.yaml --- 100 % replication - atms_n20.yaml --- ~ 1100% replication: two channel 7 observations difference - Config YAML: * add two read routine QC: data thinning and removal of data from scan edge - atms_npp.yaml - atms_n20.yaml - Paring PR in JCSDA UFO repository - This PR also has a [paring PR in JCSDA UFO repository](JCSDA-internal/ufo#3094). - It is OK to merge this one into GDASApp before the paring UFO PR - The related test data (obs and geoval files from GSI) for UFO Evaluation have been updated (due to CRTM-2.4.1 update) on ORION and HERA. Notes: - End-to-end testing completed without problem. - However, the filter results show one of the filters, 88-165 GHz scattering index check, tossed more data compared to GSI. - The excess screening from the 88-165 GHz scattering index check is under investigation and will be reported separately. - Please check comments below for validation results

…o-end testing (#764) Adding satwinds from the Spinning Enhanced Visible and InfraRed Imager (SEVIRI) from METEOSAT-8 to GDASApp end-to-end testing new files include: parm/atm/obs/config/satwind_seviri_m8.yaml: QC filter YAML for SEVIRI METEOSAT-8 satwinds parm/ioda/bufr2ioda/bufr2ioda_satwind_amv_seviri.json: JSON containing data format, sensor, and satellite information for SEVIRI METEOSAT-8 satwinds ush/ioda/bufr2ioda/bufr2ioda_satwind_amv_seviri.py: bufr2ioda code for extracting SEVIRI METEOSAT-8 satwinds from BUFR End-to-end testing results are provided in #758 - Note: Thinning filter is provided in YAML but turned off due to irreconcilable differences with GSI in testing. --------- Co-authored-by: Brett Hoover <[email protected]>

Small code-change to include SEVIRI/METEOSAT-11 satwinds in end-to-end validation. This uses the hook-ins already provided by the SEVIRI/METEOSAT-8 satwinds code that was merged in #764. New file: parm/atm/obs/config/satwind_seviri_m11.yaml - this is nearly a direct copy of parm/atm/obs/config/satwind_seviri_m8.yaml, since they utilize the same filters. Only the header information has changed. Modified file: parm/ioda/bufr2ioda/bufr2ioda_satwind_amv_seviri.json - METEOSAT-11 was added to the `satellite_info` group End-to-end testing looks very similar to what was seen for SEVIRI/METEOSAT-8 satwinds, detailed in #758. A brief run-down: (LW)IR winds are in QC agreement down to a 0.02% difference (cloud-top)WV winds are in QC agreement down to a 0.20% difference VIS winds differ by 4.5%, but there are only 22 accepted winds in GSI and 23 in JEDI, the difference is a single satwind All ob, HofX, and ob-minus-HofX differences look good Increment summary, from gdasatmanlrun.log: ``` 0: ---------------------------------------------------------------------------------------------------- 0: Increment print | number of fields = 8 | cube sphere face size: C768 0: eastward_wind | Min:-3.479765e-01 Max:+3.430433e-01 RMS:+4.990993e-04 0: northward_wind | Min:-4.226316e-01 Max:+3.376561e-01 RMS:+4.889429e-04 0: air_temperature | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: surface_pressure | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: specific_humidity | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: cloud_liquid_ice | Min:+0.000000e+00 Max:+1.618770e-20 RMS:+1.293217e-23 0: cloud_liquid_water | Min:+0.000000e+00 Max:+1.474788e-19 RMS:+2.167418e-22 0: ozone_mass_mixing_ratio | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00 0: ---------------------------------------------------------------------------------------------------- ``` Co-authored-by: Brett Hoover <[email protected]>

In [ previous PR](#757) for ATMS, the end-to-end testing was done without data thinning. And the excessive QC filtering in clear-sky areas, compared to GSI, was found. (See [plots](#757 (comment))) This PR includes two fixes for ATMS in the end-to-end testing and one new feature: 1. fix the excess QC filtering in clear-sky areas. ---> This has a paring [UFO PR #3122](JCSDA-internal/ufo#3122) 2. add data thinning 3. add the diagnostic flags (QC) --- **This can [reproduce QC flags](#768 (comment)) from GSI in UFO** **To test updates in this PR, please check out the UFO branch: [feature/satrad](https://github.com/JCSDA-internal/ufo/tree/feature/satrad) from JCSDA-internal in gdas-validation. This branch consolidates all proposed code changes to UFO for gdas validation: UFO PR #JCSDA-internal/ufo#3122 UFO PR #JCSDA-internal/ufo#3121 UFO PR #JCSDA-internal/ufo#3094 --------- Co-authored-by: Cory Martin <[email protected]>

This PR includes the following: 1. YAML name change - add sensor (ABI) to the filename of observation YAML for SATWIND from GOES platforms 2. YAML name change - add sensor (ASCAT) to the filename of observation YAML for SCATWIND from MetOp platforms 3. update the YAML name changes in the list for 3dvar 4. Add `CO2` in obs forward operator and add `linear obs operator` without CO2 for ATMS These changes have no impact on 3DVar results.

This PR includes the following updates for conventional surface pressure 1. Add observation YAML under configuration 2. Update observation YAML under testing 3. Add conv_ps to 3dvar obs list 4. Set window shift to true (time boundary is inclusive) 5. Validate 3dvar for surface (station) pressure (end-to-end) - [QC validation](#803 (comment)) - [Increments](#803 (comment)) See [PR #792 ](#792) for the BUFR converter work to convert the following surface pressure observation into IODA: - SFC - 181, 187 - SFCSHIP - 180, 183 - SONDE - 120 The related UFO evaluation (using GSI obs and geovals) results for surface pressure are documented [here](https://docs.google.com/presentation/d/1OvVMYOutxVyk0GE93Jzoh3hQVoj-dCgrwsVWDDlPT1s/edit?usp=sharing).

RussTreadon-NOAA · 2024-03-18T20:03:49Z

Please update feature/gdas-validation-ozone with the current head of GDASApp develop. It's 75 commits behind develop. Fortunately there are no conflicts so updating should go smoothly.

emilyhcliu · 2024-03-18T20:14:02Z

@RussTreadon-NOAA I am working on it.

RussTreadon-NOAA · 2024-03-18T22:17:36Z

@RussTreadon-NOAA I am working on it.

@emilyhcliu, turns out there are a few conflicts. I have a merged feature/gdas-validation-ozone ready to go. If it helps, I can push it to the authoritative repo. Just let me know.

emilyhcliu · 2024-03-19T01:49:15Z

@RussTreadon-NOAA I am working on it.

@emilyhcliu, turns out there are a few conflicts. I have a merged feature/gdas-validation-ozone ready to go. If it helps, I can push it to the authoritative repo. Just let me know.

@RussTreadon-NOAA Yes, that would be really helpful. I was just scratching my head and trying to figure out how to resolve the conflict caused by the file being removed from the development but modified in the HEAD.

CONFLICT (modify/delete): parm/atm/obs/config/conv_ps.yaml deleted in develop and modified in HEAD. Version HEAD of parm/atm/obs/config/conv_ps.yaml left in tree

Please go ahead and push your merged version for the branch. Many thanks....

RussTreadon-NOAA · 2024-03-19T15:33:54Z

NOTE: We no longer want to merge gdas-validation branches into feature/gdas-validation. We should merge gdas-validation branches into develop. feature/gdas-validation is no longer maintained. As of 3/19/2024 it is 75 commits behind the head of the authoritative develop.

RussTreadon-NOAA · 2024-03-19T15:38:18Z

@emilyhcliu , the authoritative develop has been merged into feature/gdas-validation-ozone. Done at adc025c. I can't promise that the merged ozone yaml templates in parm/atm/obs/config will work right out of the box.

RussTreadon-NOAA · 2024-03-19T15:43:55Z

As noted above, this PR needs to be closed and a new PR opened to merge feature/gdas-validaiton-ozone into develop.

As is, this PR merges 425 files into feature/gdas-validation. This reason for this is that feature/gdas-validation is 75 commits behind develop. A sample PR of feature/gdas-validation-ozone into develop only changes 15 files.

emilyhcliu · 2024-03-19T16:02:39Z

As noted above, this PR needs to be closed and a new PR opened to merge feature/gdas-validaiton-ozone into develop.

As is, this PR merges 425 files into feature/gdas-validation. This reason for this is that feature/gdas-validation is 75 commits behind develop. A sample PR of feature/gdas-validation-ozone into develop only changes 15 files.

@RussTreadon-NOAA Thanks for merging the develop into feature/gdas-validation-ozone. I changed the base from feature/gdas-validation to develop. The number of files changed drops to 15. I will keep this PR and validate the yaml files again with the merged branch.

emilyhcliu · 2024-03-19T17:39:54Z

After examining the merged files for ozone. Only ompstc yaml needs to remove the j2 file and then modify the original one for jinja template.
There are three types:

omi_aura
ompsnp_npp
ompstc_npp ---- remove ompstc8_npp.yaml.j2, update the ompstc_npp.yaml for jinja format, and rename to ompstc_npp.yaml.j2

Re-evaulate the end-to-end process for ozone with the latest JEDI-T2O/gdas-validation (PR #113)

emilyhcliu · 2024-03-19T17:44:40Z

First. Add the latest GSI QC flowchart for ozone

…ml.j2, modify ompstc_npp yaml for jinja format.

…ll lines

emilyhcliu · 2024-03-19T21:09:32Z

Re-validation:

ompsnp_npp --- comparable to previous results
ompstc_npp --- comparable to previous results
omi_aura --- comparable to previous results

Notes for ompsnp_npp. The obs error adjusted in gfs.v16.3.9 updates:

Author: RussTreadon-NOAA <[email protected]>
Date:   Tue Sep 12 14:58:49 2023 -0400

    gfs.v16.3.9 updates to global_convinfo.txt and global_ozinfo.txt (#10)
    
    * toggle usage flag to assimilate PlanetIQ GPSRO
    * toggle usage flag to assimilate NOAA-20 OMPS (Ozone Mapping and Profiler Suite)
    * adjust OMPS observation errors

The updated obs errors from gfs.v16.3.9 are also included in the yaml files for future update.

emilyhcliu · 2024-03-19T21:51:04Z

To-do list:

add updated obs errors for OMPSNP_NPP from gfs.v16.3.9 for future update.
add error handling for ozone converters.
Done!

…rpLay to ColumnRetrieval

emilyhcliu · 2024-03-20T23:14:38Z

Original Flowchart

Updated Flowchart (The order of thinning is changed)

Summary:

Error handlings are added in the ozone converters for missing input BUFR file or subsets
Adjust the order of data thinning in the stream of data filtering (the order impact results greatly)
The phase-1 test and end-to-end test results are checked with GSI. Results are comparable between GSI and JEDI (see previous comments in this PR for test results and plots below)
Two observation operators for retrieved ozone are tested - ColumnRetrieval (JCSDA developed) and AtmVertInterLay (EMC specific)
- Two forward operator results are comparable
- However, there are problems with the TL/AD model from AtmVertinterLay, which caused large increments in the end-to-end test (see increments below)
- JCSDA is going to remove AtmVertinterLay and only keep ColumnRetrieval in UFO (because ColumnRetrieval has more general and broader applications for tracers)
- Therefore, the ColumnRetrieval is used for our ozone assimilation.
- The converter, yaml files for testing (phase 1 test), and config (phase 2 end-to-end test) are ready!!

Here are the results of the increments from ColumnRetrieval:

0: ----------------------------------------------------------------------------------------------------
  0: Increment print | number of fields = 8 | cube sphere face size: C768
  0: eastward_wind                                | Min:-3.907985e-14 Max:+3.907985e-14 RMS:+5.241827e-17
  0: northward_wind                               | Min:-4.396483e-14 Max:+4.174439e-14 RMS:+5.732950e-17
  0: air_temperature                              | Min:-3.240075e-12 Max:+3.154810e-12 RMS:+1.119756e-15
  0: surface_pressure                             | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00
  0: specific_humidity                            | Min:-2.153242e-08 Max:+2.684943e-08 RMS:+8.244934e-12
  0: cloud_liquid_ice                             | Min:+0.000000e+00 Max:+1.618770e-20 RMS:+1.293217e-23
  0: cloud_liquid_water                           | Min:+0.000000e+00 Max:+1.474788e-19 RMS:+2.167418e-22
  0: ozone_mass_mixing_ratio                      | Min:-1.760182e-07 Max:+1.210675e-07 RMS:+8.044355e-10
  0: ----------------------------------------------------------------------------------------------------

Here are the increments from AtmVertinterLay: (large ozone increments)

0: ----------------------------------------------------------------------------------------------------
  0: Increment print | number of fields = 8 | cube sphere face size: C768
  0: eastward_wind                                | Min:-2.328804e-12 Max:+2.367884e-12 RMS:+3.127267e-15
  0: northward_wind                               | Min:-2.625011e-12 Max:+2.483347e-12 RMS:+3.413966e-15
  0: air_temperature                              | Min:-1.926708e-10 Max:+1.875833e-10 RMS:+6.634194e-14
  0: surface_pressure                             | Min:+0.000000e+00 Max:+0.000000e+00 RMS:+0.000000e+00
  0: specific_humidity                            | Min:-1.281455e-06 Max:+1.597886e-06 RMS:+4.893025e-10
  0: cloud_liquid_ice                             | Min:+0.000000e+00 Max:+1.618770e-20 RMS:+1.293217e-23
  0: cloud_liquid_water                           | Min:+0.000000e+00 Max:+1.474788e-19 RMS:+2.167418e-22
  0: ozone_mass_mixing_ratio                      | Min:-2.622343e-06 Max:+2.011652e+34 RMS:+6.550479e+32
  0: ----------------------------------------------------------------------------------------------------

tagging @CoryMartin-NOAA @RussTreadon-NOAA @ADCollard @azadeh-gh @xincjin-NOAA for review!!
Thanks a lot!

ADCollard

Looks good! Nice job. you deserve a raise!

RussTreadon-NOAA and others added 30 commits November 9, 2023 13:48

update prototype_3d observation list to process satwind_goes-16, upda…

9285f5f

…te obsfile for satwnd.abi_goes-16

Merge develop at 957a2fc into feature/gdas-validation

9189e6f

update GDAS/orion.lua to use spack-stack-1.5.1, bufr/12.0.1, and atla…

f5320c8

…s/0.35.0

Remove a double-declaired "obs post filters" in satwnd GOES YAMLs.

8c34966

Merge branch 'develop' into feature/gdas-validation

78fc82f

Make the python bufr2ioda driver more generic (#725)

dda513f

Rather than each new ob type being manually added to the list, we can use `glob.glob` to get the list of available observation types.

Merge branch 'develop' into feature/gdas-validation

d368a2a

Have the driver script process both python scripts and YAMLs + bufr2i…

5c305aa

…oda.x (#730) This PR allows for all obtypes to be processed in two loops. We still need to figure out a way to process these in parallel (somewhat).

Use parallel processing to speed up obs processing (#733)

9fc4d73

Using python multiprocessing to generate obs in parallel. The current list of obs goes from 10+ minutes to completing in ~5.5 minutes.

Fix YAML so minimization works for satwind G17 (#743)

0970ec8

@RussTreadon-NOAA noted that `obs linear operator` should be `linear obs operator` in the GOES-17 satwind YAML. This fixes that.

Consolidate parallel processing (#745)

ae22466

This reduces runtime further to run everything in one parallel pool. Now, things complete in under 4 minutes (as of now).

Merge branch 'develop' into feature/gdas-validation

59db885

Write the bufr2ioda config files in DATA (#748)

10f01db

Instead of writing the filled out `.json` and `.yaml` files to `$COM_OBS`, we write them to `$DATA` so that they get purged unless `KEEPDATA="YES"`

Merge branch 'develop' into feature/gdas-validation

771c959

Merge branch 'develop' into feature/gdas-validation

947b397

Update IASI YAML files for end-to-end testing (#769)

30ab4f9

Merge branch 'develop' into feature/gdas-validation

80e04d8

Merge branch 'develop' into feature/gdas-validation

c2d9edb

Add updates for ozone

6282fd0

fix coding norm errors

803348b

emilyhcliu changed the base branch from feature/gdas-validation to develop March 19, 2024 01:17

emilyhcliu changed the base branch from develop to feature/gdas-validation March 19, 2024 01:17

Merge branch 'develop' into feature/gdas-validation-ozone

adc025c

emilyhcliu changed the base branch from feature/gdas-validation to develop March 19, 2024 15:51

add missing hyphen to obs space for ozone jinja2 templates

b766783

emilyhcliu added 3 commits March 19, 2024 13:03

Remove old ompstc8_npp.yaml.j2, copy ompstc_npp.yaml to ompstc_npp.ya…

3038c3e

…ml.j2, modify ompstc_npp yaml for jinja format.

Add ompsnp_npp, ompstc_npp, and omi_aura to obs list.

c340ab2

Fix to adopt jinja template format - need 2 space from the left for a…

d81d0e5

…ll lines

emilyhcliu added 4 commits March 20, 2024 11:37

move ompstc8 to ompstc and add updated obs errors for ompsnp_npp

e80e85f

Add comments to benchmark value

980489c

Replace the observation operator for retrieved ozone from AtmVertInte…

13fbf34

…rpLay to ColumnRetrieval

Add error handling for missing file or subsets

c69187d

emilyhcliu requested a review from xincjin-NOAA March 20, 2024 23:22

ADCollard approved these changes Mar 21, 2024

View reviewed changes

azadeh-gh approved these changes Mar 21, 2024

View reviewed changes

CoryMartin-NOAA merged commit 78b9e88 into develop Mar 21, 2024
5 checks passed

CoryMartin-NOAA deleted the feature/gdas-validation-ozone branch March 21, 2024 18:41

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add updates for ozone and end-to-end results #827

Add updates for ozone and end-to-end results #827

emilyhcliu commented Dec 30, 2023 •

edited

Loading

RussTreadon-NOAA commented Mar 18, 2024

emilyhcliu commented Mar 18, 2024

RussTreadon-NOAA commented Mar 18, 2024

emilyhcliu commented Mar 19, 2024

RussTreadon-NOAA commented Mar 19, 2024

RussTreadon-NOAA commented Mar 19, 2024

RussTreadon-NOAA commented Mar 19, 2024

emilyhcliu commented Mar 19, 2024

emilyhcliu commented Mar 19, 2024 •

edited

Loading

emilyhcliu commented Mar 19, 2024

emilyhcliu commented Mar 19, 2024 •

edited

Loading

emilyhcliu commented Mar 19, 2024 •

edited

Loading

emilyhcliu commented Mar 20, 2024 •

edited

Loading

ADCollard left a comment

Add updates for ozone and end-to-end results #827

Add updates for ozone and end-to-end results #827

Conversation

emilyhcliu commented Dec 30, 2023 • edited Loading

RussTreadon-NOAA commented Mar 18, 2024

emilyhcliu commented Mar 18, 2024

RussTreadon-NOAA commented Mar 18, 2024

emilyhcliu commented Mar 19, 2024

RussTreadon-NOAA commented Mar 19, 2024

RussTreadon-NOAA commented Mar 19, 2024

RussTreadon-NOAA commented Mar 19, 2024

emilyhcliu commented Mar 19, 2024

emilyhcliu commented Mar 19, 2024 • edited Loading

emilyhcliu commented Mar 19, 2024

emilyhcliu commented Mar 19, 2024 • edited Loading

emilyhcliu commented Mar 19, 2024 • edited Loading

emilyhcliu commented Mar 20, 2024 • edited Loading

Original Flowchart

Updated Flowchart (The order of thinning is changed)

Summary:

ADCollard left a comment

Choose a reason for hiding this comment

emilyhcliu commented Dec 30, 2023 •

edited

Loading

emilyhcliu commented Mar 19, 2024 •

edited

Loading

emilyhcliu commented Mar 19, 2024 •

edited

Loading

emilyhcliu commented Mar 19, 2024 •

edited

Loading

emilyhcliu commented Mar 20, 2024 •

edited

Loading