Skip to content

GSI Ctests (regression tests)

Jump to bottom
Ming Hu edited this page Jan 10, 2023 · 42 revisions

To use ctest to run the regression tests:

1. Build and install control for the regression tests.

This is usually [NOAA-EMC/GSI develop], the head of the branch into which you want to merge:

2. Build and install the head of the branch containing your changes.

This is the update for the regression tests. The main GSI directory should parallel with control directory develop.

3. Run regression tests

cd into build in the working copy of the branch containing your changes. ctest -N lists all available ctests. Currently 13 tests are available. To launch only the global tests, execute ctest -R global. To concurrently launch multiple tests , execute ctest -j X where X is the number of tests to concurrently run. Note that tests on Hera and Orion use the debug queue. The debug queue has a limit of two concurrent jobs per user. If you wish to concurrently run more than 2 jobs on Hera or Orion, set queue in regression_var.sh to batch.

Each ctest consists of four runs for the indicated configuration

  1. high mpi task & thread count for update
  2. low mpi task & thread count for update
  3. high mpi task & thread count for control
  4. low mpi task & thread count for control

Failed or Passed will be echoed to the screen as ctests complete. Once all ctests complete a summary report for each test will be written to the path specified by variable noscrub in regression/regression_var.sh

NOTES:

  • At present NOAA-EMC/GSI global regression tests are only available on Hera, Orion, and WCOSS2. Regional regression tests are only available on Hera.
  • Regional regression tests are under review and will be updated at a later dat
Clone this wiki locally