Mar 5 – 7, 2024
Julius-Maximilians-Universität Würzburg
Europe/Berlin timezone

Empowering HPC Workflows with Snakemake: A Comprehensive Training Program

Not scheduled
20m
Mathematisch-Naturwissenschaftliches Hörsaalgebäude (Julius-Maximilians-Universität Würzburg)

Mathematisch-Naturwissenschaftliches Hörsaalgebäude

Julius-Maximilians-Universität Würzburg

Am Hubland 97074 Würzburg
Poster RSE Education Poster Session

Speaker

Malte Petersen (University of Bonn, High Performance Computing & Analytics Lab)

Description

In the evolving landscape of High-Performance Computing (HPC), the ability to efficiently design, implement, and manage scientific data analysis workflows is paramount. We recognize this need and present a unique training program tailored for researchers and administrators keen on harnessing the power of the Snakemake workflow system in an HPC environment.

This course material offers a comprehensive curriculum for mastering Snakemake, a versatile workflow management system known for its simplicity, scalability, and reproducibility. Aimed at both beginners and experienced users, our material covers the entire spectrum of HPC conformant workflows, enabling participants to navigate the intricacies of modern computing clusters with ease. We also introduce software engineering best practices in the framework of Snakemake and its workflow and wrapper ecosystem so that creators will be able to contribute their own designs.

The material is designed to be modular and site-agnostic. We invite teachers to adapt the slideset to their requirements. To facilitate this, we offer a flexible configuration system that allows to specify site-specific information in simple configuration files.f

Primary author

Malte Petersen (University of Bonn, High Performance Computing & Analytics Lab)

Co-authors

Mr Aasish Kumar (GWDG) Christian Meesters (Johannes Gutenberg Universität Mainz) Mr Fabian Brand (University of Bonn) Dr Florian Boecker (University of Bonn) Prof. Johannes Köster (University of Duisburg-Essen) Mr Lukas Hellmann (Johannes Gutenberg University of Mainz) Mr Martin Paleico (GWDG)

Presentation materials