Skip to content

Commit

Permalink
Merge pull request #209 from cedadev/new-nx4-and-slcs-gridftp-removal
Browse files Browse the repository at this point in the history
gridftp, hpxfer, nx, sci updates
  • Loading branch information
mjpritchard authored Feb 6, 2025
2 parents e7a43a3 + 7084b7c commit 49ac321
Show file tree
Hide file tree
Showing 14 changed files with 82 additions and 664 deletions.
1 change: 0 additions & 1 deletion content/docs/data-transfer/data-transfer-tools.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,6 @@ Tool | Info
{{<link "rsync-scp-sftp">}}sftp{{</link>}} | SSH FTP - works over SSH.
{{<link "bbcp">}}bbcp{{</link>}} | A command-line tool that allows the user to specify parallel transfer over multiple streams, using SSH authentication.
{{<link "gridftp-ssh-auth">}}GridFTP (over SSH){{</link>}} | An old but comprehensive data transfer tool. Highly configurable and able to transfer over multiple parallel streams. Used over SSH in this case. Superseded by {{<link "globus-transfers-with-jasmin">}}Globus{{</link>}}
{{<link "gridftp-cert-based-auth">}}GridFTP (certificate-based){{</link>}} | Legacy Gridftp using certificate-based authentication instead of SSH credentials. Efficient for moving large volumes and/or numbers of files, especially over long distances. Superseded by {{<link "globus-transfers-with-jasmin">}}Globus{{</link>}}
{{<link "ftp-and-lftp">}}FTP{{</link>}} | File Transfer Protocol. An aged transfer protocol suitable for small file transfers but limited.
{{<link "ftp-and-lftp">}}LFTP{{</link>}} | Parallel-capable FTP client.
wget, curl | Download tools for accessing resources over HTTP primarily. (see 3rd party documentation)
Expand Down
2 changes: 1 addition & 1 deletion content/docs/data-transfer/ftp-and-lftp.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ FTP can only be used as a client on JASMIN, to pull data from external FTP
servers to local storage on JASMIN, for example a Group Workspace or your home
directory. **There is no FTP server within JASMIN providing the ability to
upload files to these locations.** Please use an alternative, more secure
method instead. See other [Data Transfer Tools]({{% ref "data-transfer-tools" %}}) such as [scp/rsync/sftp]({{% ref "rsync-scp-sftp" %}}), [bbcp]({{% ref "bbcp" %}}) or GridFTP ([over SSH]({{% ref "gridftp-ssh-auth" %}}), [certificate-based]({{% ref "gridftp-cert-based-auth" %}}) or using [Globus Online]({{% ref "globus-transfers-with-jasmin"%}}))
method instead. See other [Data Transfer Tools]({{% ref "data-transfer-tools" %}}) such as [scp/rsync/sftp]({{% ref "rsync-scp-sftp" %}}), [bbcp]({{% ref "bbcp" %}}) or GridFTP ([over SSH]({{% ref "gridftp-ssh-auth" %}}) or using [Globus]({{% ref "globus-transfers-with-jasmin"%}}))

On the [transfer servers]({{% ref "transfer-servers" %}}), you can use one of
the installed FTP clients to download data from elsewhere. These are:
Expand Down
27 changes: 13 additions & 14 deletions content/docs/data-transfer/globus-transfers-with-jasmin.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,38 +2,37 @@
aliases:
- /article/5106-globus-transfers-with-jasmin
- /article/5008-data-transfer-tools-using-the-globus-web-interface
- gridftp-cert-based-auth
slug: globus-transfers-with-jasmin
collection: jasmin-documentation
description: Globus transfers with JASMIN
title: Globus transfers with JASMIN
---

This article describes how to do data transfers using JASMIN's **new** Globus
endpoint (now called a **collection** ), based on the most recent version of
[Globus Connect Server](https://www.globus.org/globus-connect-server).
This article describes how to do data transfers to and from JASMIN using {{<link "https://globus.org">}}Globus{{</link>}},
an online data transfer service designed specifically for moving large datasets
between research institutions.

JASMIN's old Globus endpoint, based on
the previous version of the Globus service, ceased operating on 18
December 2023 as support was discontinued by Globus. We have implemented a
new endpoint, based on Globus Connect Server v5.4, with equivalent (but better!)
functionality.
{{<alert type="info">}}
**Globus** now replaces the previous certificate-based **gridftp** service.

The new collection can be used as a drop-in replacement for the previous
endpoint, aside from a few differences in terminology, and a change to the
authentication process.
Although gridftp transfers are currently still possible (using the perhaps confusingly-named `globus-url-copy` client tool
still available on the
transfer servers), this now only works with [ssh authentication]({{% ref "gridftp-ssh-auth" %}}).
{{</alert>}}

## Main differences

There are some differences to how the new (v5) version of Globus works on JASMIN compared to previously:
JASMIN moved to a newer version of Globus in 2023, resulting in a few changes:

- Users now interact with a **collection**
- **Most users**: please use ["JASMIN Default Collection"](https://app.globus.org/file-manager/collections/a2f53b7f-1b4e-4dce-9b7c-349ae760fee0/overview) with ID `a2f53b7f-1b4e-4dce-9b7c-349ae760fee0`
- For **STFC users only** where the other collection (either {{<link "globus-connect-personal">}}GCP{{</link>}} or {{<link "https://www.globus.org/globus-connect-server">}}GCS{{</link>}}) is within STFC, an additional collection is provided ["JASMIN STFC Internal Collection"](https://app.globus.org/file-manager/collections/9efc947f-5212-4b5f-8c9d-47b93ae676b7/overview) and has ID `9efc947f-5212-4b5f-8c9d-47b93ae676b7`.
- You now use the JASMIN Accounts Portal to authenticate (using your JASMIN account credentials) via OpenID Connect (OIDC).
- You now use the JASMIN Accounts Portal to authenticate (using your JASMIN account credentials) via OpenID Connect (OIDC).
- During the authentication process, you are redirected to the JASMIN Accounts Portal to link your Globus identity with your JASMIN account.
- Consent needs to be granted at a number of points in the process to allow the Globus service to carry out actions on your behalf.
- The default lifetime of the authentication granted to your JASMIN account is now **30 days**. After this, you may need to refresh the consent for your "session".
- This service is now available to **all** users of JASMIN: you no longer need to hold the `hpxfer` access role.
- This service is now available to **all** users of JASMIN: you no longer need the `hpxfer` access role (now removed).

The following examples show you how to authenticate with the new JASMIN
Default Collection and list the contents of your home directory. As before,
Expand Down
255 changes: 0 additions & 255 deletions content/docs/data-transfer/gridftp-cert-based-auth.md

This file was deleted.

Loading

0 comments on commit 49ac321

Please sign in to comment.