High-Performance Computing Workshop [Beginners and Intermediate Level]In-Person Event

Europe/Berlin
114 (CASUS)

114

CASUS

Conrad-Schiedt-Str. 20, 02826 Görlitz
Andreas Knüpfer (CASUS / HZDR), Franz Pöschel (CASUS / HZDR), Jiri Vyskocil (CASUS / HZDR)
Description

High-Performance Computing (HPC) clusters are used for large scale data processing and data analysis as well as highly parallel simulations of ever increasing fidelity. This course is meant to introduce the principles of how to work on HPC clusters in general and invites to collect first hands-on experience on the HZDR cluster. It covers all steps from connecting to the cluster to running parallel code plus useful tips and tricks for convenient day to day work.

The workshop jointly organized by the Scientific Compute Core (SCC) department at CASUS in Görlitz and FWCI-H at HZDR in Dresden Rossendorf. It will take place in Görlitz and is open for attendees from academia, research, and industry.

Registration
High-Performance Computing Workshop
  • Tuesday 4 November
    • Welcome address and Introduction to the HZDR HPC cluster 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Overview of the High Performance Computing cluster at HZDR and its architecture.

    • Access to cluster and interactive jobs 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Logging in to the cluster, run interactive jobs, copy data there and back

    • Coffee Break 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz
    • Running batch jobs & using software from the module system 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Working with the SLURM scheduler and using the module system to load software and libraries from a large set of pre-installed modules.

    • Lunch break 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz
    • Job scripts and Array Jobs 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Series of SLURM jobs for parameter scans. Bonus: Using AI chat bots to generate job scripts for you.

    • Coffee Break 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz
    • Bonus: Log in with SSH without a password 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Login from the command line with SSH, copy data on the command line with SCP, use SSH keys to log in and for copying without entering your password every time

  • Wednesday 5 November
    • Running Jupyter Notebooks on the HPC cluster 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Running your own Python environments and Jupyter notebooks with custom kernels

      Conveners: Franz Poeschel (CASUS/HZDR), Mani Lokamani (HZDR)
    • Coffee Break 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz
    • MPI Jobs 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Running multi-node parallel programs using MPI

    • Lunch break 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz
    • Advanced SLURM

      Scheduling interdependent jobs and using signals to communicate with running jobs.

    • Coffee Break 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz
    • Bonus: On-demand Session 114

      114

      CASUS

      Conrad-Schiedt-Str. 20, 02826 Görlitz

      Topic chosen by participant vote from one of the following
      - Tricks for the command line
      - TU Dresden clusters
      - Remote VSCode integration
      or ask for specific topics.

      Convener: Andreas Knuepfer (HZDR)