forked from awslabs/open-data-registry
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathaiwp.yaml
101 lines (89 loc) · 5.54 KB
/
aiwp.yaml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
Name: AI Weather Prediction (AIWP) Model Reforecasts
Description: |
<br/>
<br/>
This is an archive of pure AI-based weather prediction reforecasts produced collaboratively between the Cooperative Institute for Research in the Atmosphere [(CIRA)](https://www.cira.colostate.edu/) and the NOAA Global Systems Laboratory [(NOAA-GSL)](https://gsl.noaa.gov/).
<br/>
<br/>
Currently, [FourCastNetv2-small](https://arxiv.org/abs/2306.03838), [Pangu-Weather](https://www.nature.com/articles/s41586-023-06185-3), and [GraphCast](https://www.science.org/doi/10.1126/science.adi2336) are included, with more models to come. Each of these models has been initialized with both NOAA [GFS](https://www.emc.ncep.noaa.gov/emc/pages/numerical_forecast_systems/gfs.php) (directories with no extension) and ECMWF [IFS](https://www.ecmwf.int/en/forecasts/datasets/set-i) initial conditions (directories ending in "_IFS"). The datasets are updated with near-real-time data twice per day (00Z and 12Z initializations).
<br/>
<br/>
FourCastNetv2-small and Pangu-Weather are available from 10/2020 to present, while GraphCast is available from 01/2022 to present. These periods are selected to avoid overlap with training and fine-tuning periods for each model. Data may be missing and is not guaranteed to be available at any given time. If there is data missing that you require, please email [email protected].
<br/>
<br/>
For real-time visualizations, visit our [visualizations page](https://aiweather.cira.colostate.edu).
<br/>
<br/>
The directory structure is as follows\: <br/>
s3://noaa-oar-mlwp-data/MMMM_vNNN_III/YYYY/mmdd/MMMM_vNNN_III_YYYYmmddhh_fXXX_fYYY_ZZ.nc; where <br/>
MMMM = Four character model code (FOUR, PANG, or GRAP) <br/>
NNN = Three digit version number (currently 100 or 200) <br/>
YYYY = Four digit year <br/>
mm = Two digit month <br/>
dd = Two digit day <br/>
III = Three character initial condition system (GFS) <br/>
hh = Two digit initialization time (00, 06, 12, or 18) <br/>
XXX = Three digit first forecast hour of file (currently 000 for all files) <br/>
YYY = Three digit last forecast hour of file (currently 240 for all files) <br/>
ZZ = Two digit forecast step (currently 06 for all files)
<br/>
<br/>
Variables available by model\: <br/>
- FourCastNet v2-small:
- 10-m u wind component
- 10-m v wind component
- 100-m u wind component
- 100-m v wind component
- 2-m temperature
- Surface pressure
- Mean sea level pressure
- Total column integrated water vapor
- Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Relative humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Pangu-Weather:
- 10-m u wind component
- 10-m v wind component
- 2-m temperature
- Mean sea level pressure
- Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Specific humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- GraphCast Operational:
- 10-m u wind component
- 10-m v wind component
- 2-m temperature
- Mean sea level pressure
- Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Specific humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- Vertical velocity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
- 6-hr accumulated precipitation
Documentation: https://noaa-oar-mlwp-data.s3.amazonaws.com/README.txt
Contact: For questions regarding data availability, content, or quality, contact Dr. Jacob Radford ([email protected]). For any general questions regarding the NOAA Open Data Dissemination (NODD) Program, email the NODD Team at [email protected].
<br /> We also seek to identify case studies on how NOAA data is being used and will be featuring those stories in joint publications and in upcoming events. If you are interested in seeing your story highlighted, please share it with the NODD team by emailing [email protected]
ManagedBy: "Dr. Jacob Radford ([email protected])"
UpdateFrequency: 2 times a day, every 12 hours starting at midnight UTC
Collabs:
ASDI:
Tags:
- weather
Tags:
- environmental
- meteorological
- weather
License: Open Data. There are no restrictions on the use of this data.
Resources:
- Description: AIWP data
ARN: arn:aws:s3:::noaa-oar-mlwp-data
Region: us-east-1
Type: S3 Bucket
Explore:
- '[Browse Bucket](https://noaa-oar-mlwp-data.s3.amazonaws.com/index.html)'
Citation: 'Please cite our [BAMS paper](https://doi.org/10.1175/BAMS-D-24-0057.1)'