GSI Ctests (regression tests)

To use ctest to run the regression tests:

1. Build and install control for the regression tests.

This is usually [NOAA-EMC/GSI develop], the head of the branch into which you want to merge:

• git clone --recursive https://github.com/NOAA-EMC/GSI.git
• rename directory GSI to develop
• compile the code: cd develop/ush and run ./build.sh

2. Build and install the head of the branch containing your changes.

This is the update for the regression tests. Please remember to include --recursive when you clone your fork containing the branch with your changes.

Your branch with your changes should be installed at the same directory level as your control. For example, if you install the branch with your changes in $DIR_ROOT, the control gsi.x and enkf.x need to be in $DIR_ROOT../develop/install/bin. Script ush/build.sh sets CONTROLPATH="$DIR_ROOT/../develop/install/bin". If your control gsi.x and enkf.x are in a different location, set CONTROLPATH to the appropriate path in ush/build.sh.

3. Run regression tests

cd into build in the working copy of the branch containing your changes and use the following ctest command to run the cases.

• ctest -N lists all available ctests. Currently 9 tests are available.
• To launch only the global tests, execute ctest -R global.
• To concurrently launch multiple tests , execute ctest -j X where X is the number of tests to concurrently run.

If not run under EMC account, need to set following three parameters in the head of regression/regression_var.sh:

• ptmp="Space to run regression cases"
• group="Your Group"
• accnt="Your Account"

4. check results:

Each ctest consists of four runs for the indicated configuration

1. high mpi task & thread count for update
2. low mpi task & thread count for update
3. high mpi task & thread count for control
4. low mpi task & thread count for control

Failed or Passed will be echoed to the screen as ctests complete. For example:

ctest -R rrfs_3denvar_glbens

Test project /scratch1/BMC/wrfruc/mhu/code/gsi/test3/GSI/build

`Start 7: rrfs_3denvar_glbens`

1/1 Test #7: rrfs_3denvar_glbens .............. Passed 546.88 sec

100% tests passed, 0 tests failed out of 1

Total Test time (real) = 546.89 sec

Once all ctests complete a summary report for each test will be written to the path specified by variable noscrub in regression/regression_var.sh

NOTES:

• At present NOAA-EMC/GSI regression tests are only available on Hera, Orion, and WCOSS2.

How to add a case to ctest

1. CMakeLists.txt

2. multi_regression.sh

3. regression_namelists.sh and regression_namelists_db.sh

4. regression_param.sh

5. regression_var.sh

6. Add run script for this new case, for example rrfs_3denvar_glbens.sh