Skip to content

Commit db99a41

Browse files
Merge pull request #107 from UCL-ARC/update-rdss
Update rdss connection info for Myriad and Kathleen
2 parents ed6726b + 20671a6 commit db99a41

File tree

1 file changed

+35
-6
lines changed

1 file changed

+35
-6
lines changed

mkdocs-project-dir/docs/Supplementary/Connecting_to_RDSS.md

Lines changed: 35 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -12,11 +12,11 @@ RDSS and the central UCL research computing platforms are presented below.
1212
Sections of the example code surrounded by angle brackets (\<\>) should
1313
be replaced by the information indicated (do not keep the angle brackets in).
1414

15-
## Between Myriad and RDSS
15+
## Between Myriad or Kathleen and RDSS
1616

1717
If you already have an account with the Research Data Storage Service, you can
18-
transfer data directly between Legion and Research Data Storage using
19-
the Secure Copy (`scp`) command.
18+
transfer data directly between Myriad or Kathleen and Research Data Storage using
19+
the Secure Copy (`scp`) command, copy (`cp`) command or `rsync` command.
2020

2121
### From RDS to Myriad
2222

@@ -35,15 +35,44 @@ running jobs) running the command:
3535
scp ssh.rd.ucl.ac.uk:~/data_file.tgz ~/Scratch/
3636
```
3737

38-
### From Myriad to RDSS
38+
### From Myriad or Kathleen to RDSS
3939

40-
From Myriad, send data to your project space on RDSS by running the
41-
command:
40+
The RDSS is mounted on the Myriad and Kathleen login nodes at `/rdss`. There are
41+
subdirectories `rd00`, `rd01` that contain projects with names beginning
42+
`ritd-ag-project-rd00` or `ritd-ag-project-rd01` and so on. You can use `cp` or local
43+
`rsync` commands to copy data between your RDSS space and your Myriad space.
44+
45+
Rsync is useful as rerunning it will not copy files that already exist in the
46+
destination - so it can be used to synchronise data and to continue if a transfer was
47+
interrupted partway through.
48+
49+
```
50+
# Use rsync archive mode (recursively copy directories, copy symlinks without resolving,
51+
# and preserve permissions, ownership and modification times) to copy the data directory
52+
# and everything in it from RDSS to Scratch.
53+
# --safe-links ignores any symbolic links that point outside the copied tree and
54+
# any symlinks that are absolute paths
55+
rsync --safe-links -r -a /rdss/rd00/ritd-ag-project-rd001/ritd-ag-project-rd0001-test/data ~/Scratch
56+
```
57+
58+
You can use the copy command. It has fewer options than rsync and is more suited for simpler
59+
and smaller copies.
60+
61+
```
62+
# Copy the data directory from RDSS to Scratch recursively and preserve permissions.
63+
cp -rp /rdss/rd00/ritd-ag-project-rd001/ritd-ag-project-rd0001-test/data ~/Scratch
64+
```
65+
66+
You can still use scp to do a remote copy to the RDSS ssh node and send data to your project
67+
space on RDSS by running the command:
4268

4369
```
4470
scp data_file.tgz [email protected]:<path_to_project_space>
4571
```
4672

73+
Note that the old Myriad transfer node `transfer02` is no longer accessible now that the login nodes
74+
can be used instead.
75+
4776
The RDSS support pages provide more
4877
information:
4978

0 commit comments

Comments
 (0)