Transfer Data with Globus
The MARCC data transfer node (DTN) is connected to the ScienceDMZ via a 40 Gbps NIC. Globus manages the transfer from a remote server or the user’s workstation to MARCC making sure the transfer picks up after any interruptions and that the data arrives with integrity.
To start using Globus:
1 – Use your browser to connect to Globus. If you do not have an account you should request one at http://globus.org. It is free of charge.
2 – Connect using your JHED userid and password
3 – You should get a window like this one:
4 – Select or type MARCC on one side and your data source on the other (“jhuidies#dmztest” for this example)
Use your authentication credentials. You do not need the Two Factor Authentication for MARCC, just your userid and password. You will get a screen like this one:
5 – Change directories as appropriate, select the files to transfer (see below) and then click on the highlighted “arrow”
Un-select (unclick) “verify file integrity”. This process will take much longer. Use it only if necessary.
You can also label the transfer by using the “Label This Transfer” so you can better identify it.
6 – The file transfer should start within a few seconds/minutes.
7 – You can check the status by clicking on “Activity” top of the window:
Click on the label, you will see progress or if the transfer is complete. An email will be sent to your account when the transfer is complete.
Cleaning your Home Directory with Globus
Home directories (
~) on MARCC are limited to a disk quota of 50GB. For this reason, we strongly recommend using your scratch space (
~/scratch/) for research data generation and manipulation. Should you accidentally fill your home directory, the system will prevent you from logging in. You can restore access without contacting the MARCC help desk using Globus by following the steps outlined below.
Open the MARCC endpoint
Once connected to Globus, ensure you are in the
Transfer Files application. In the left-hand pane, click inside the
Endpoint field that says
Start here.... Search for the MARCC endpoint by typing and select
Continue to authenticate your connection to MARCC using your MARCC username/password and select
Sign In to return to Globus.
Delete some files
/~/, which represents your home directory. Select a file or directory that you can safely delete and click on the hamburger menu (three horizontal lines) in the upper right-hand corner of the file explorer pane. Click
delete selected items to delete the selected file or directory.
Return to MARCC
Your MARCC access should now be restored. You may continue to clean up your home directory using this interface, or you may return to your standard method of connecting to MARCC to finish deleting unnecessary files in your home directory. Should you still not be able to connect to MARCC, first attempt to make additional space in your home directory by following the steps listed above. If that fails, contact email@example.com for further assistance.
It is a known issue that Globus transfers will not work using Hopkins Wifi, please leverage a wired network or alternative networks. if you try it you will see a message:
[ssh stderr] ssh: connect to host relay.globusonline.org port 2223: Connection refused
Is there a non-GUI Interface / Command Line Interface?
Globus has one! It’s called globus-cli
See the following links to get started, when searching for endpoints, search for ‘marcc’.