Method Spotlight: Pipelines and Workflows

Monday 13 Dec 2021, 14:00 → 17:00 Europe/Berlin

312/7 (HZDR/zoom)

We are happy to have Johannes Köster from University of Duisburg-Essen. We asked Johannes to share some of his experience and insights automating pipelines and workflows.

The presentation will be available via zoom due to Covid19 hygenic regulations at our center.
Please register for the event to retrieve the zoom call details.

We also offer four blocks to meet the speaker for 30 minutes. Use this chance to discuss your specific data and goals with Johannes. The slots are provided on a first-come-first-served basis.

Connection Details

https://us06web.zoom.us/j/82209229913?pwd=NGxuclgwUitKcnVZOCtpbmNjQ2srdz09

Meeting ID: 822 0922 9913
Passcode: 128718
One tap mobile
+496938079884,,82209229913#,,,,*128718# Germany
+496950500951,,82209229913#,,,,*128718# Germany

Dial by your location
        +49 69 3807 9884 Germany
        +49 69 5050 0951 Germany
        +49 69 5050 0952 Germany
        +49 695 050 2596 Germany
        +49 69 7104 9922 Germany
        +49 69 3807 9883 Germany
        +1 301 715 8592 US (Washington DC)
        +1 312 626 6799 US (Chicago)
        +1 346 248 7799 US (Houston)
        +1 646 558 8656 US (New York)
        +1 720 707 2699 US (Denver)
        +1 253 215 8782 US (Tacoma)
Meeting ID: 822 0922 9913
Passcode: 128718
Find your local number: https://us06web.zoom.us/u/kdfKpCXx6x

1 Pipelines and Workflows

Data analyses usually entail the application of a combination of command line tools, scripts and notebooks to transform, filter, aggregate or plot data and results. In order to ensure sustained value for data analysis authors and the scientific community, an analysis has to be reproducible (for checking its technical validity), transparent (for checking its methodological validity), and adaptable (to enable future reuse).
With over 1,000 citations and over 300,000 downloads, Snakemake is one of the most popular workflow management systems.
This talk will present how Snakemake can be used to easily ensure above properties while minimising boilerplate code, maximising human readability, and ensuring efficient execution on any major computing platform.

Speaker: Johannes Köster

notes.md

slides

2 Q & A

Booked Participants only: Meet the Speaker

3 Block 1

4 Block 2

5 Block 3

6 Block 4