Globus gridftp for transferring big data

I was using this very convenient tools when transferring ~2TB data from Gordon at SDSC to CIRC machines: as simple as drag the files from A to B and without worrying disconnect. Here's some basic steps:

  1. Sign up an account on globus.org


  1. Sign in


  1. Transfer Files with Endpoints: click "Transfer Files" on the right top Set up the path and endpoints as shown below and pick up files and use the arrows (blue triangles) to start transfer.

1) Endpoints for CIRC machines

For CIRC machines, the endpoint is "univofrochester#circ" and you need to login with your username and password on Bluehive/BlueStreak. The default path is your home directory on Bluehive. But you can access to your bh scratch or bgq scratch. For example for me— /scratch/bliu17 as bh scratch and /gpfs/fs2/bgqscratch/bliu17 as bgq scratch.

2) Endpoints for XSEDE machines:

xsede#gordon for Gordon at SDSC ( path example: /oasis/scratch/bliu/ for my scratch ) xsede#stampede for Stampede at TACC ( path example:/scratch/01688/bliu for my scratch ) More information can be found here:https://www.xsede.org/data-transfers

3) Endpoint for your own machine:

You can setup an endpoint for your own laptop also. Click "Manage Endpints" on the right top then "add Globus Connect Personal" and follow the instructions


  1. You will receive emails once the transferring is done/get problems.

Attachments (6)

Comments

No comments.