High-Performance Computing (HPC) Resources

Read: HPC @ MSI

MSI offers several options to remotely access HPC resources. These will allow you to access stored data, run processing jobs, and other computing heavy tasks.

Please be aware that on the first Wednesday of each month, MSI will undergo maintenance. Occasionally, this may extend and affect MSI performance for the entire week.

Open OnDemand

A web portal to access MSI's compute clusters in your browser, which can be used for accessing MSI files and running jobs. - Select Interactive Apps at the top and select which Desktop you would like: - The Persistent Desktop should run until the next maintenance day - If selecting Desktop choose which cluster, how many resources, and the time you need - Agate is good for visualization and GPU utilization - Mangi and Agate are good for running long jobs - Several other apps are available, including MATLAB and RStudio Server

Jupyter Notebooks

A web portal for notebook-based computing in the browser, which can be used for reproducible and shareable data analysis, visualization, and scripted control of larger tasks. Currently supports Python 2, Python 3, and R. Offered on OOD as a server. * Great for playing around with a database initially * Formalizing code here is not recommended

Secure Shell (SSH)

Your computer can communicate with MSI resources via SSH. It is a secure way for administrators to access and manage remote computers over the internet, offering protection for data and allowing tasks like logging in, transferring files, and executing commands. More information about SSH can be found here on the MSI page.

srun

To facilitate the execution of programs or visualization of data lasting more than 15 minutes on any of the systems mentioned above, please consider submitting an interactive job via SLURM. This will allow you to access a command line or graphical interface on the current HPC system (OOD or Terminal) for interactive software execution. For more detailed information on SLURM, you can refer to this section.

SBATCH

SBATCH is a tool used at the Minnesota Supercomputing Institute (MSI) to send tasks to the Slurm system for processing. Users create scripts detailing resource needs like time, processors, memory, and email notifications. These scripts are then submitted using sbatch, ensuring efficient job management and execution within MSI's computing environment. Users can also check job status with 'squeue -u username' and cancel jobs with 'scancel jobIDnumber'. For more information refer to the Job Submission and Scheduling (Slurm)

Storage

Each PI has their own allocation on MSI. These allocations have storage and grid time allocated to them. As one account is more active, it becomes deprioritized relative to all other accounts on MSI. See this page for more information about how prioritization works.

• Damien Fair: faird
• Eric Feczko feczk001
• Oscar Miranda-Dominguez: miran045
• Steve Nelson: smnelson
• Anita Randolph: rando149