You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/docs/long-term-archive-storage/ceda-archive.md
+20-26Lines changed: 20 additions & 26 deletions
Original file line number
Diff line number
Diff line change
@@ -1,40 +1,35 @@
1
1
---
2
2
aliases: /article/3838-ceda-archive
3
-
description: CEDA Archive
3
+
description: Accessing the CEDA Archive from JASMIN
4
4
slug: ceda-archive
5
5
title: CEDA Archive
6
6
---
7
7
8
-
This article describes accessing the {{<link "ceda_archive">}}CEDA Archive{{</link>}} from JASMIN:
9
-
10
8
## Overview
11
9
12
-
The CEDA Archive provides direct access to thousands of atmospheric, climate
13
-
change and earth observation datasets. The Archive is directly accessible as a
10
+
The {{<link "ceda_archive">}}CEDA Archive{{</link>}} provides direct access to thousands of
11
+
atmospheric, climate change and earth observation datasets. The Archive is directly accessible as a
14
12
file system from the shared science machines on JASMIN.
15
13
16
14
It is a separate service run by the CEDA team - it is not a JASMIN service.
17
-
Therefore, many of the links in this document will take you to the [CEDA
18
-
Archive help documentation site](https://help.ceda.ac.uk) (as the information
15
+
Therefore, many of the links in this document will take you to the {{<link "ceda_helpdocs">}}CEDA Archive help documentation site{{</link>}} (as the information
19
16
relates to CEDA Archive services). This is separate from the JASMIN help
20
17
documentation site (which is specifically about JASMIN services).
21
18
22
19
## Register for a CEDA Account
23
20
24
21
First, you need a CEDA Archive account. If you do not have a CEDA account,
25
-
please [follow the steps in this CEDA help
26
-
document](https://help.ceda.ac.uk/article/39-ceda-account) to register as a
22
+
please {{<link "https://help.ceda.ac.uk/article/39-ceda-account">}}follow the steps in this CEDA help document{{</link>}} to register as a
27
23
new CEDA user. It also explains how you can reset your password if you have
28
-
forgotten it. When you have made a CEDA account, you will then need to use the CEDA portal to [link
29
-
it to your JASMIN account](https://help.ceda.ac.uk/article/5105-linking-your-jasmin-account).
24
+
forgotten it. When you have made a CEDA account, you will then need to use the CEDA portal to {{<link "https://help.ceda.ac.uk/article/5105-linking-your-jasmin-account">}}link it to your JASMIN account{{</link>}}.
30
25
31
26
The JASMIN Account Portal deals with the management of access to JASMIN
32
27
resources (e.g. compute and storage), whereas
33
-
[MyCEDA](https://services.ceda.ac.uk/cedasite/myceda/user/) (the CEDA Accounts
28
+
{{<link "https://services.ceda.ac.uk/cedasite/myceda/user/">}}MyCEDA{{</link>}} (the CEDA Accounts
34
29
Portal) deals with access to CEDA resources (e.g. access to datasets in the
35
30
archives). You will need both accounts linked in order to access CEDA Archive
36
31
data from JASMIN - you can check whether your accounts are linked from within
37
-
the [CEDA Accounts Portal](https://services-beta.ceda.ac.uk/account/jasmin/).
32
+
the {{<link "https://services-beta.ceda.ac.uk/account/jasmin/">}}CEDA Accounts Portal{{</link>}}.
38
33
39
34
## Accessing the CEDA Archive on JASMIN servers
40
35
@@ -45,8 +40,7 @@ The contents of the CEDA Archive are available on the file system under `/badc`
45
40
and `/neodc`. Note: do not access data via any symlinks that point to
46
41
`/datacentre/archvol*` - these are not permanent links and may change when data
47
42
are migrated to new storage. Please use the archive path names under `/badc` and
48
-
`/neodc`. Search the [CEDA data
49
-
catalogue](https://help.ceda.ac.uk/article/137-ceda-data-catalogue) for further
43
+
`/neodc`. Search the {{<link "https://help.ceda.ac.uk/article/137-ceda-data-catalogue">}}CEDA data catalogue{{</link>}} for further
50
44
details about data held in the archive.
51
45
52
46
Note: `/badc` is for atmospheric & climate model data, `/neodc` is for earth observation data - they
@@ -57,29 +51,29 @@ Most data on the Archive is open access - however, some datasets are
57
51
restricted. You can work this out by looking at the UNIX access groups the
58
52
data are within (see below). If your required datasets are restricted, access
59
53
to these can be obtained by applying for specific access via the data centre
60
-
(see [this article ](https://help.ceda.ac.uk/article/98-accessing-data)for more
54
+
(see {{<link "https://help.ceda.ac.uk/article/98-accessing-data">}}this article{{</link>}} for more
61
55
details). If direct access is not possible the data can be obtained via
62
-
[standard FTP and web-based](https://help.ceda.ac.uk/article/99-download-data-from-ceda-archives)
access methods to the CEDA Archive and transferred to a
64
58
suitable group workspace on JASMIN. As the data centres use the same JASMIN
65
59
infrastructure the transfer rates are high.
66
60
67
-
The [CEDA Data Catalogue](https://help.ceda.ac.uk/article/137-ceda-data-catalogue) is a useful tool to find and apply for access to datasets.
61
+
The {{<link "https://help.ceda.ac.uk/article/137-ceda-data-catalogue">}}CEDA Data Catalogue{{</link>}} is a useful tool to find and apply for access to datasets.
68
62
69
63
## Archive access groups
70
64
71
65
The UNIX access groups used within the CEDA Archive are listed below with
72
66
links to example datasets in the CEDA data catalogue for those wishing to use
73
67
them:
74
68
75
-
-`open` Available to any logged in JASMIN user with a linked CEDA user account. See a full list of available datasets [here](https://catalogue.ceda.ac.uk/?q=&results_per_page=20&sort_by=relevance&permission=restricted).
76
-
-`cmip5_research`restricted [CMIP3](https://catalogue.ceda.ac.uk/uuid/72afa18db5988d1be0066a26e09422df) and [CMIP5 ](https://catalogue.ceda.ac.uk/?q=wcrp+cmip5&record_types=Observation&sort_by=relevance)datasets
77
-
-`esacat1` Satellite data including [MERIS](https://catalogue.ceda.ac.uk/uuid/f26559a9daeae9e6740811d3b3113716), [MIPAS](https://catalogue.ceda.ac.uk/uuid/4a9da084adf4252752e5fe77a5cfd0a9) and [SCIAMACHY](https://catalogue.ceda.ac.uk/uuid/6877f4f100d22f750b44f4c3b7ada498).
78
-
-`ecmwf` Access to the [ECMWF Operational Datasets](https://catalogue.ceda.ac.uk/uuid/c46248046f6ce34fc7660a36d9b10a71).
79
-
-`eurosat` Satellite data including [IASI](https://catalogue.ceda.ac.uk/?q=iasi&record_types=ObservationCollection&sort_by=relevance), [AVHRR-3](https://catalogue.ceda.ac.uk/?q=avhrr+3&record_types=ObservationCollection&sort_by=relevance) and [GOME-2](https://catalogue.ceda.ac.uk/?q=gome+2&record_types=ObservationCollection&sort_by=relevance).
80
-
-`ukmo_wx ` Met Office observational dataset collections including [LIDARNET](https://catalogue.ceda.ac.uk/uuid/38a6e76871fca4c58d0f831e532bff41), [MIDAS](https://catalogue.ceda.ac.uk/uuid/220a65615218d5c9cc9e4785a3234bd0), [MetDB](https://catalogue.ceda.ac.uk/uuid/8ee156b6ed41b153e85dbf02a4134513) and [NIMROD](https://catalogue.ceda.ac.uk/uuid/82adec1f896af6169112d09cc1174499)
81
-
-`ukmo_clim` Climatology datasets from the Met Office, including [Central England Temperature](https://catalogue.ceda.ac.uk/uuid/a946415f9345f6da9bf4c475c19477b6)dataset collection, [HadISST](https://catalogue.ceda.ac.uk/?q=hadisst).
82
-
-`byacl` These data have specific restrictions on them meaning that they can't be accessed directly from JASMIN, but can be obtained via FTP andweb access.
69
+
-`open`- Available to any logged in JASMIN user with a linked CEDA user account. See a full list of available datasets {{<link "https://catalogue.ceda.ac.uk/?q=&results_per_page=20&sort_by=relevance&permission=restricted">}}here{{</link>}}.
70
+
-`cmip5_research`- Restricted {{<link "https://catalogue.ceda.ac.uk/uuid/72afa18db5988d1be0066a26e09422df">}}CMIP3{{</link>}} and {{<link "https://catalogue.ceda.ac.uk/?q=wcrp+cmip5&record_types=Observation&sort_by=relevance">}}CMIP5{{</link>}} datasets
71
+
-`esacat1`- Satellite data including {{<link "https://catalogue.ceda.ac.uk/uuid/f26559a9daeae9e6740811d3b3113716">}}MERIS{{</link>}}, {{<link "https://catalogue.ceda.ac.uk/uuid/4a9da084adf4252752e5fe77a5cfd0a9">}}MIPAS{{</link>}} and {{<link "https://catalogue.ceda.ac.uk/uuid/6877f4f100d22f750b44f4c3b7ada498">}}SCIAMACHY{{</link>}}.
72
+
-`ecmwf`- Access to the {{<link "https://catalogue.ceda.ac.uk/uuid/c46248046f6ce34fc7660a36d9b10a71">}}ECMWF Operational Datasets{{</link>}}.
73
+
-`eurosat`- Satellite data including {{<link "https://catalogue.ceda.ac.uk/?q=iasi&record_types=ObservationCollection&sort_by=relevance">}}IASI{{</link>}}, {{<link "https://catalogue.ceda.ac.uk/?q=avhrr+3&record_types=ObservationCollection&sort_by=relevance">}}AVHRR-3{{</link>}} and {{<link "https://catalogue.ceda.ac.uk/?q=gome+2&record_types=ObservationCollection&sort_by=relevance">}}GOME-2{{</link>}}.
74
+
-`ukmo_wx `- Met Office observational dataset collections including {{<link "https://catalogue.ceda.ac.uk/uuid/38a6e76871fca4c58d0f831e532bff41">}}LIDARNET{{</link>}}, {{<link "https://catalogue.ceda.ac.uk/uuid/220a65615218d5c9cc9e4785a3234bd0">}}MIDAS{{</link>}}, {{<link "https://catalogue.ceda.ac.uk/uuid/8ee156b6ed41b153e85dbf02a4134513">}}MetDB{{</link>}} and {{<link "https://catalogue.ceda.ac.uk/uuid/82adec1f896af6169112d09cc1174499">}}NIMROD{{</link>}}
75
+
-`ukmo_clim`- Climatology datasets from the Met Office, including {{<link "https://catalogue.ceda.ac.uk/uuid/a946415f9345f6da9bf4c475c19477b6">}}Central England Temperature{{</link>}} dataset collection, {{<link "https://catalogue.ceda.ac.uk/?q=hadisst">}}HadISST{{</link>}}.
76
+
-`byacl`- These data have specific restrictions on them meaning that they can't be accessed directly from JASMIN, but can be obtained via {{<link "https://help.ceda.ac.uk/article/4431-ceda-archive-web-download-and-services">}}web access{{</link>}}.
0 commit comments