JASMIN Help Site logo JASMIN Help Site logo
  • Docs 
  • Guides 
  • Training 
  • Discussions   

  •   Search this site  

Can't find what you're looking for?

Try our Google custom search, across all JASMIN sites

Docs
  • getting started
    • get started with jasmin
    • generate ssh key pair
    • get jasmin portal account
    • get login account
    • beginners training workshop
    • how to contact us about jasmin issues
    • jasmin status
    • jasmin training accounts
    • tips for new users
    • how to login
    • multiple account types
    • present ssh key
    • reconfirm email address
    • reset jasmin account password
    • ssh auth
    • storage
    • understanding new jasmin storage
    • update a jasmin account
  • interactive computing
    • interactive computing overview
    • check network details
    • login servers
    • login problems
    • graphical linux desktop access using nx
    • sci servers
    • tenancy sci analysis vms
    • transfer servers
    • jasmin notebooks service
    • jasmin notebooks service with gpus
    • creating a virtual environment in the notebooks service
    • project specific servers
    • dask gateway
    • access from vscode
  • batch computing
    • lotus overview
    • slurm scheduler overview
    • slurm queues
    • lotus cluster specification
    • how to monitor slurm jobs
    • how to submit a job
    • how to submit an mpi parallel job
    • example job 2 calc md5s
    • orchid gpu cluster
    • slurm status
    • slurm quick reference
  • software on jasmin
    • software overview
    • quickstart software envs
    • python virtual environments
    • additional software
    • community software esmvaltool
    • community software checksit
    • compiling and linking
    • conda environments and python virtual environments
    • conda removal
    • creating and using miniforge environments
    • idl
    • jasmin sci software environment
    • jasmin software faqs
    • jaspy envs
    • matplotlib
    • nag library
    • name dispersion model
    • geocat replaces ncl
    • postgres databases on request
    • running python on jasmin
    • running r on jasmin
    • rocky9 migration 2024
    • share software envs
  • data transfer
    • data transfer overview
    • data transfer tools
    • globus transfers with jasmin
    • bbcp
    • ftp and lftp
    • globus command line interface
    • globus connect personal
    • gridftp ssh auth
    • rclone
    • rsync scp sftp
    • scheduling automating transfers
    • transfers from archer2
  • short term project storage
    • apply for access to a gws
    • elastic tape command line interface hints
    • faqs storage
    • gws etiquette
    • gws scanner ui
    • gws scanner
    • gws alert system
    • install xfc client
    • xfc
    • introduction to group workspaces
    • jdma
    • managing a gws
    • secondary copy using elastic tape
    • share gws data on jasmin
    • share gws data via http
    • using the jasmin object store
    • configuring cors for object storage
  • long term archive storage
    • ceda archive
  • mass
    • external access to mass faq
    • how to apply for mass access
    • moose the mass client user guide
    • setting up your jasmin account for access to mass
  • for cloud tenants
    • introduction to the jasmin cloud
    • jasmin cloud portal
    • cluster as a service
    • cluster as a service kubernetes
    • cluster as a service identity manager
    • cluster as a service slurm
    • cluster as a service pangeo
    • cluster as a service shared storage
    • adding and removing ssh keys from an external cloud vm
    • provisioning tenancy sci vm managed cloud
    • sysadmin guidance external cloud
    • best practice
  • workflow management
    • rose cylc on jasmin
    • using cron
  • uncategorized
    • mobaxterm
    • requesting resources
    • processing requests for resources
    • acknowledging jasmin
    • approving requests for access
    • working with many linux groups
    • jasmin conditions of use
  • getting started
    • get started with jasmin
    • generate ssh key pair
    • get jasmin portal account
    • get login account
    • beginners training workshop
    • how to contact us about jasmin issues
    • jasmin status
    • jasmin training accounts
    • tips for new users
    • how to login
    • multiple account types
    • present ssh key
    • reconfirm email address
    • reset jasmin account password
    • ssh auth
    • storage
    • understanding new jasmin storage
    • update a jasmin account
  • interactive computing
    • interactive computing overview
    • check network details
    • login servers
    • login problems
    • graphical linux desktop access using nx
    • sci servers
    • tenancy sci analysis vms
    • transfer servers
    • jasmin notebooks service
    • jasmin notebooks service with gpus
    • creating a virtual environment in the notebooks service
    • project specific servers
    • dask gateway
    • access from vscode
  • batch computing
    • lotus overview
    • slurm scheduler overview
    • slurm queues
    • lotus cluster specification
    • how to monitor slurm jobs
    • how to submit a job
    • how to submit an mpi parallel job
    • example job 2 calc md5s
    • orchid gpu cluster
    • slurm status
    • slurm quick reference
  • software on jasmin
    • software overview
    • quickstart software envs
    • python virtual environments
    • additional software
    • community software esmvaltool
    • community software checksit
    • compiling and linking
    • conda environments and python virtual environments
    • conda removal
    • creating and using miniforge environments
    • idl
    • jasmin sci software environment
    • jasmin software faqs
    • jaspy envs
    • matplotlib
    • nag library
    • name dispersion model
    • geocat replaces ncl
    • postgres databases on request
    • running python on jasmin
    • running r on jasmin
    • rocky9 migration 2024
    • share software envs
  • data transfer
    • data transfer overview
    • data transfer tools
    • globus transfers with jasmin
    • bbcp
    • ftp and lftp
    • globus command line interface
    • globus connect personal
    • gridftp ssh auth
    • rclone
    • rsync scp sftp
    • scheduling automating transfers
    • transfers from archer2
  • short term project storage
    • apply for access to a gws
    • elastic tape command line interface hints
    • faqs storage
    • gws etiquette
    • gws scanner ui
    • gws scanner
    • gws alert system
    • install xfc client
    • xfc
    • introduction to group workspaces
    • jdma
    • managing a gws
    • secondary copy using elastic tape
    • share gws data on jasmin
    • share gws data via http
    • using the jasmin object store
    • configuring cors for object storage
  • long term archive storage
    • ceda archive
  • mass
    • external access to mass faq
    • how to apply for mass access
    • moose the mass client user guide
    • setting up your jasmin account for access to mass
  • for cloud tenants
    • introduction to the jasmin cloud
    • jasmin cloud portal
    • cluster as a service
    • cluster as a service kubernetes
    • cluster as a service identity manager
    • cluster as a service slurm
    • cluster as a service pangeo
    • cluster as a service shared storage
    • adding and removing ssh keys from an external cloud vm
    • provisioning tenancy sci vm managed cloud
    • sysadmin guidance external cloud
    • best practice
  • workflow management
    • rose cylc on jasmin
    • using cron
  • uncategorized
    • mobaxterm
    • requesting resources
    • processing requests for resources
    • acknowledging jasmin
    • approving requests for access
    • working with many linux groups
    • jasmin conditions of use
  1.   Data transfer
  1. Home
  2. Docs
  3. Data transfer
  4. Globus transfers with JASMIN

Globus transfers with JASMIN

 

Share via
JASMIN Help Site
Link copied to clipboard

Globus transfers with JASMIN

On this page
Main differences   List your home directory using the web app   List your home directory using the command-line interface (CLI)   Where to/from?  

This article describes how to do data transfers to and from JASMIN using Globus  , an online data transfer service designed specifically for moving large datasets between research institutions.

 

Globus now replaces the previous certificate-based gridftp service.

Although gridftp transfers are currently still possible (using the perhaps confusingly-named globus-url-copy client tool still available on the transfer servers), this now only works with ssh authentication.

Main differences  

JASMIN moved to a newer version of Globus in 2023, resulting in a few changes:

  • Users now interact with a collection
    • Most users: please use “JASMIN Default Collection”  with ID a2f53b7f-1b4e-4dce-9b7c-349ae760fee0
    • For STFC users only where the other collection (either GCP or GCS  ) is within STFC, an additional collection is provided “JASMIN STFC Internal Collection”  and has ID 9efc947f-5212-4b5f-8c9d-47b93ae676b7.
  • You now use the JASMIN Accounts Portal to authenticate (using your JASMIN account credentials) via OpenID Connect (OIDC).
  • During the authentication process, you are redirected to the JASMIN Accounts Portal to link your Globus identity with your JASMIN account.
  • Consent needs to be granted at a number of points in the process to allow the Globus service to carry out actions on your behalf.
  • The default lifetime of the authentication granted to your JASMIN account is now 30 days. After this, you may need to refresh the consent for your “session”.
  • This service is now available to all users of JASMIN: you no longer need the hpxfer access role (now removed).

The following examples show you how to authenticate with the new JASMIN Default Collection and list the contents of your home directory. As before, however, the following file systems are available via this collection

File system Access
$HOME (/home/users/<username>) Read-write
/gws (group workspaces) Read-write
/work/xfc (transfer cache) Read-write
/badc (CEDA Archive)
/neodc Read-only

List your home directory using the web app  

1. Navigate to https://app.globus.org 

2. Log in with your Globus identity (this could be a globusid.org or other identity)

log in
log in

3. In File Manager, use the search tool to search for “JASMIN Default Collection”. Select it.

Find JASMIN Default Collection
Find JASMIN Default Collection

4. In the transfer pane, you are told that Authentication/Consent is required. Click Continue.

Consent
Consent

5. Click the link to use the JASMIN Accounts Portal OIDC server to link your JASMIN identity

6. You are taken to a page on the JASMIN Accounts portal, where you are invited to “Authorise” the external application to authenticate and access your essential account information.

Authorise application
Authorise application

7. If successful, you are taken back to the Globus web app, where you are invited to “Allow” the app to use the listed information and services.

Allow the app to use the info
Allow the app to use the info

8. The directory listing of your home directory should now appear in the transfer pane.

9. Try navigating to another collection known to you (previously known as endpoint) in the other pane and transferring some data. If you have Globus Connect Personal running locally, you should be able to transfer files to/from that.

List your home directory using the command-line interface (CLI)  

1. Load the virtual environment where you have the Globus CLI installed:

(in this example, a Python virtual environment named ~/.globus-cli-venv already exists. If it doesn’t create one with the command python3 -m venv ~/.globus-cli-venv on your local machine). Activate this virtual environment as follows:

source ~/.globus-cli-venv/bin/activate

2. It’s recommended to update to the latest version of the CLI by doing the following:

pip install -U globus-cli

3. Check that you have an active globus session and follow any instructions given, e.g.

globus login
globus session show

4. Use the “globus ls” command to list the collection using its ID, starting at the path of your home directory (/~/)

globus ls a2f53b7f-1b4e-4dce-9b7c-349ae760fee0:/~/

TIP: you can set the ID of the collection to be an environment variable like this, for convenience:

export JASMIN_GLOBUS=a2f53b7f-1b4e-4dce-9b7c-349ae760fee0
globus ls $JASMIN_GLOBUS:/~/

6. You will be taken through an equivalent set of steps to those needed for the web app. First off, you will be asked to copy/paste a URL into your browser and copy/paste back the resulting authentication code.

7. Once the authentication/consent process has been completed, you should see a listing of your home directory.

8. Use the globus transfer command to copy data to/from another collection (previously known as endpoint) to your home directory, within the JASMIN Default Collection. (see globus transfer --help for details)

Where to/from?  

Don’t forget that to actually transfer data to/from JASMIN (e.g. step 8, above), you’ll need another collection somewhere else. If you’re transferring data from ARCHER2, you can use their ARCHER2 filesystems collection (id: 3e90d018-0d05-461a-bbaf-aab605283d21) 

If not, unless your institution runs a Globus collection, you’ll need to install a small piece of software called Globus Connect Personal on a machine at that end that is able to read/write the data that you want to transfer. A good idea is to try this on your own desktop/laptop first.

Our help doc guides you through how to do this and some examples of how to use it. Versions available for Windows, Mac and Linux.

Last updated on 2025-02-06 as part of:  gridftp, hpxfer, nx, sci updates (7084b7cf0)
On this page:
Main differences   List your home directory using the web app   List your home directory using the command-line interface (CLI)   Where to/from?  
Follow us

Social media & development

   

Useful links

  • CEDA Archive 
  • CEDA Catalogue 
  • JASMIN 
  • JASMIN Accounts Portal 
  • JASMIN Projects Portal 
  • JASMIN Cloud Portal 
  • JASMIN Notebooks Service 
  • JASMIN Community Discussions 

Contact us

  • Helpdesk
UKRI/STFC logo
UKRI/NERC logo
NCAS logo
NCEO logo
Accessibility | Terms and Conditions | Privacy and Cookies
Copyright © 2025 Science and Technology Facilities Council.
Hinode theme for Hugo licensed under Creative Commons (CC BY-NC-SA 4.0).
JASMIN Help Site
Code copied to clipboard