HPC Workshop [self-learning]Hybrid Event

28 Aug 2024, 13:00 → 29 Aug 2024, 15:30 Europe/Berlin

E4005 and H0049 (AWI - Building E and H)

Sven Harig (AWI), Miguel Andrés-Martínez, Paul Gierz

HPC Workshop

Self-learning

This course was originally designed for in-person instruction and has already been conducted. However, it was also structured to serve as a self-learning resource. Lecture recordings are available, and exercises include solutions to facilitate independent study. You can access all course materials for self-paced learning here:

https://gitlab.awi.de/hpc/workshops/hpc-workshop#hpc-workshop

If you have questions about the course resources please contact hpc@awi.de.

Course Summary

In this workshop you will learn the basics on how to use an HPC and you'll also learn about specific information regarding Albedo, AWI's HPC.

Since the planned number of seats is taken, registration is currently possible only for the waiting list. Please do register anyway in case you are interested, since we might be able to accommodate some more participants or in any case, we will repeat the event, and the number of registrations allows us to estimate the demand for the future. 

Content

This workshop will cover:

• Introduction to HPCs in general
• Specific information on albedo 
• Connection to albedo (ssh)
• Some basic Linux commands
• Usage of the module environment
• Job processing with Slurm (the big bulk of the workshop)
• JupyterHub
• Software management with Spack
• and more...

Requirements

Very basic Linux knowledge is required. This time, we are accepting participants exclusively affiliated with the Alfred Wegener Institute (employees or guests).

Registration

The registration will be open until the 16th of August. To register click on "Register now" at the bottom of the page.

Preparations

• You'll need to bring a laptop to the workshop
• A Unix-compatible command-line interface (Shell for short). If you are a Windows user, please install Putty before the workshop. On a Mac make sure the Terminal app is installed.
• Access to Albedo HPC -> https://spaces.awi.de/display/HELP/HPC+account

Wednesday 28 August

13:00 → 13:05 Getting started: Introduction to the course

What is an HPC and how can we access our local HPC

13:05 → 13:30 Getting started: What's an HPC?

What is an HPC and how can we access our local HPC

13:30 → 14:00 Getting started: Albedo: Some specific details, access and basic usage

What is an HPC and how can we access our local HPC

14:00 → 14:30 Visit albedo: Excursion to the heart of calculations

14:30 → 15:00 Basic usage: Using the shell - Basic Linux commands

This session addresses the basic usage of the shell

15:00 → 15:30 Basic usage: Shell environment

This session addresses the basic usage of the shell

15:30 → 16:00 Basic usage: Editing text files and writing bash scripts

This session addresses the basic usage of the shell

16:00 → 16:15 Coffee break

16:15 → 16:30 Job scheduling with Slurm: Motivation and introduction to Slurm

This session deals with Slurm usage for job scheduling and basic cluster management.

16:30 → 17:15 Job scheduling with Slurm: Setting up slurm scripts for serial and parallel tasks, submitting and monitoring jobs

This session deals with Slurm usage for job scheduling and basic cluster management.

17:15 → 17:45 Job scheduling with Slurm: More details on OpenMP and MPI tasks, specific topics like job arrays and resource management

This session deals with Slurm usage for job scheduling and basic cluster management.

17:45 → 18:15 Job scheduling with Slurm: Slurm Dependencies

This session deals with Slurm usage for job scheduling and basic cluster management.

Thursday 29 August

09:00 → 09:45 Software development: Python & Co.: Code development (Fortran, C, ...) and compiling

This session deals with software development on albedo:
Python, Fortran, Matlab, as well as editors and compilers

09:45 → 10:45 Software development: Python & Co.: JupyterHub

This session deals with software development on albedo:
Python, Fortran, Matlab, as well as editors and compilers

10:45 → 11:00 Software development: Python & Co.: Using Matlab

This session deals with software development on albedo:
Python, Fortran, Matlab, as well as editors and compilers

11:00 → 11:15 Break

11:15 → 11:30 Software management with Spack: Introduction

This session deals with software management tasks and the tool Spack

11:30 → 12:00 Software management with Spack: Local software installation

This session deals with software management tasks and the tool Spack

12:00 → 12:30 Conclusion: Wrap-up and discussion

Cooldown period

13:30 → 15:30 Conclusion: Open session for questions and selfwork

Cooldown period