Skip to content

Commit

Permalink
Merge pull request #220 from openclimatefix/docs/checks
Browse files Browse the repository at this point in the history
add which checks are in place in readme
  • Loading branch information
peterdudfield authored Feb 18, 2025
2 parents 1c946d2 + eed4aff commit ea86720
Showing 1 changed file with 33 additions and 0 deletions.
33 changes: 33 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,39 @@ Internal OCF application to run [PVNet](https://github.com/openclimatefix/PVNet)

The app supports multiple model versions being deployed to live environments and these can be ran with specific configurations which are set via environment variables.

## Validation Checks

We run a number of different validation checks on the data and the forecasts that are made.
These are in place to ensure quality forecasts are made and saved to the database.
If any of these checks fail, the forecast is stopped and an error is raised.
The API (and UI) will still load the most recent forecast made.

### Satellite data

We check
- Either the 5 minute or 15 minute satellite data is present. If both are not present, we raise an error.
- We check that there is less than a 15 minute gap in the satellite data. If the gap is larger than 15 minutes, an error is raised.
If the gap is less than 15 minutes, the data infilled with a limit.
- We check that there aren't more than 10% zeros in the satellite data, if there is, an error is raised.

### NWP data

TODO, these are current in https://github.com/openclimatefix/uk-pvnet-app/issues/196

### ML batch checks

Just before the batch data goes into the ML models, we check that
- All the NWP are not zeros. We raise an error if, for any nwp provider, all the NWP data is zero.
- TODO: https://github.com/openclimatefix/PVNet/issues/324

### Forecast checks

After the ML models have run, we check the following
- The forecast is not above 110% of the national capacity. An error is raised if any forecast value is above 110% of the national capacity.
- The forecast is not above 100 GW, any forecast value above 30 GW we get a warning but any forecast value above 100 GW we raise an error.
- If the forecast goes up and then down more than 500 MW we raise an error. A warning is made for 250 MW. This stops zig-zag forecasts.
- TODO: Check positive values in day: https://github.com/openclimatefix/uk-pvnet-app/issues/200

## Development

### Running tests locally
Expand Down

0 comments on commit ea86720

Please sign in to comment.