Connecting to a cluster using SSH

Hint

Usernames to connect with all HPC services will be the same as those you use to login to MUSE not the prefix on your email address.

The most versatile way to run commands and submit jobs on one of the clusters is to use a mechanism called SSH, which is a common way of remotely logging in to computers running the Linux operating system.

To connect to another machine using SSH you need to have a SSH client program installed on your machine. macOS and Linux come with a command-line (text-only) SSH client pre-installed. On Windows there are various SSH clients you can use, including Windows Terminal.

Warning

The University Connect for China (UCC) is not the same service as the SSL VPN service and will not grant access to the HPC clusters. Users of the UCC must disconnect the UCC and connect to the SSL VPN in order to connect to the HPC clusters.

Warning

Eduroam no longer grants direct access to the clusters. If using Eduroam, you must keep the VPN connected at all times while using the clusters.

Valid methods of connecting to the University clusters using SSH (or the related protocols SCP and SFTP) include:

  • Connecting while in a campus building using wired ethernet;

  • Connecting while on campus using Eduroam or off campus after establishing a VPN connection (required);

  • Connecting while off campus without a VPN connection using the HPC SSH gateway.

Connecting using a password or SSH public key authentication will determine whether Multifactor Authentication (MFA) will be mandatory during the login process. The authentication requirements per cluster are summarised below:

Cluster

From campus or via VPN

From off campus and without a VPN connection

Bessemer

Password + DUO MFA or public key

Not permitted (unless using the HPC SSH gateway service)

Stanage

Password + DUO MFA or public key

Not permitted (unless using the HPC SSH gateway service)

Connecting with a Password or SSH keys

If connecting using your password, MFA will be mandatory. The standard University DUO MFA is utilised.

On the Stanage cluster, when you connect you will be prompted via a push notification to your DUO device to approve access or must enter a one-time code from your University provided hardware token which is associated with your DUO account.

ssh te1st@stanage.shef.ac.uk
Password:
Verification code:
Last login: Wed Apr 12 17:09:24 2023 from r.x.y.z
*****************************************************************************
*                           Stanage HPC cluster                             *
*                       The University Of Sheffield                         *
*                       https://docs.hpc.shef.ac.uk                         *
*                                                                           *
*               Unauthorised use of this system is prohibited.              *
*****************************************************************************
[te1st@login1 [stanage] ~]$

If you have not setup your University DUO MFA, please follow the steps published at: https://www.sheffield.ac.uk/it-services/mfa/set-mfa

In addition, if you do not have MFA enabled on your account then you will not be able to login from off campus without using the VPN.

Establishing a SSH connection

Hint

Usernames to connect with all HPC services will be the same as those you use to login to MUSE not the prefix on your email address, and should always be entered in lowercase.

Once you have a terminal open run the following command to log in to a cluster:

ssh -X YOUR_USERNAME@CLUSTER_NAME.shef.ac.uk

Here you need to:

  • replace YOUR_USERNAME with your IT Services username, which should be all lowercase (e.g., te1st).

  • replace CLUSTER_NAME with stanage or bessemer.

After typing in this command hit enter to start connecting at which point you will be prompted for your username, password and then with a Duo MFA prompt.

This should give you a session resembling the one below:

[te1st@login1 [stanage] ~]$

At this prompt if you would like an interactive session you can type:

srun --pty bash -i

Like this:

[te1st@login1 [stanage] ~]$ srun --pty bash -i

Which will start an interactive session, which supports graphical applications resembling the below:

[te1st@node001 [stanage] ~]$

Note

When you login to a cluster you reach one of two login nodes. You should not run applications on the login nodes. Running the interactive job command, srun --pty bash -i (Stanage & Bessemer), gives you an interactive terminal on one of the many worker nodes in the clusters.

Running commands from a terminal (from the command-line) may initially be unfamiliar to Windows users but this is the recommended approach for running commands on Sheffield HPC clusters as it is the idiomatic way of interfacing with the Linux clusters.

Suggested SSH clients

SSH client software on Windows

For Windows PCs, we recommend the use of Windows Terminal which is available on the University’s managed desktops by default. If not already installed on your device, Windows Terminal can be found on the Microsoft Store.

For personal systems you can download and install the Installer edition of MobaXterm.

Caution

We discourage the use of Warp Terminal when accessing our HPC clusters. This is due to multiple environment-related issues encountered by users who connect via Warp.

SSH client software on Mac OS/X and Linux

Linux and macOS (OS X) both typically come with a command-line SSH client pre-installed.

If you are using macOS and want to be able to run graphical applications on the clusters then you need to install the latest version of the XQuartz X Windows server.

Open a terminal (e.g. Gnome Terminal on Linux or Terminal on macOS) and then go to Establishing a SSH connection.

What if I cannot use the VPN or I need a persistent long term connection

Direct SSH access to the HPC clusters from off campus is not possible without the use of VPN. However if you are unable to use VPN we also provide an SSH gateway service to allow off-site SSH access to our HPC clusters.

Note

  • Access to the HPC SSH gateway service requires that you have an existing HPC account.

  • You must additionally request access to the HPC SSH gateway by emailing research-it@sheffield.ac.uk including a justification for your request.

  • If the cluster access can be handled via the usage of the SSL VPN without undue effort, your request will not be granted.

For more information see HPC Gateway Service Details.

What Next?

Now you have connected to a cluster, you can look at how to submit jobs on the Job Submission and Control page or look at the software installed on Stanage and Bessemer.