Skip to content

GSI Ctests (regression tests)

Jump to bottom
Ming Hu edited this page Jan 10, 2023 · 42 revisions

To use ctest to run the regression tests:

1. Build and install control for the regression tests.

This is usually [NOAA-EMC/GSI develop], the head of the branch into which you want to merge:

2. Build and install the head of the branch containing your changes.

This is the update for the regression tests. The main GSI directory should parallel with control directory develop.

3. Run regression tests

cd into build in the working copy of the branch containing your changes and use the following ctest command to run the cases.

  • ctest -N lists all available ctests. Currently 9 tests are available.
  • To launch only the global tests, execute ctest -R global.
  • To concurrently launch multiple tests , execute ctest -j X where X is the number of tests to concurrently run.

If not run under EMC account, need to set following three parameters in the head of regression/regression_var.sh:

  • ptmp="Space to run regression cases"
  • group="Your Group"
  • accnt="Your Account"

4. check results:

Each ctest consists of four runs for the indicated configuration

  1. high mpi task & thread count for update
  2. low mpi task & thread count for update
  3. high mpi task & thread count for control
  4. low mpi task & thread count for control

Failed or Passed will be echoed to the screen as ctests complete. For example:

ctest -R rrfs_3denvar_glbens Test project /scratch1/BMC/wrfruc/mhu/code/gsi/test3/GSI/build Start 7: rrfs_3denvar_glbens 1/1 Test #7: rrfs_3denvar_glbens .............. Passed 546.88 sec

100% tests passed, 0 tests failed out of 1

Total Test time (real) = 546.89 sec

Once all ctests complete a summary report for each test will be written to the path specified by variable noscrub in regression/regression_var.sh

NOTES:

  • At present NOAA-EMC/GSI regression tests are only available on Hera, Orion, and WCOSS2.
Clone this wiki locally