12–14 Jun 2023 In-Person Event
Helmholtz-Zentrum Dresden-Rossendorf (HZDR)
Europe/Berlin timezone

Workflows and HELIPORT: Why such a strong integration?

13 Jun 2023, 17:35
10m
114/203 (Helmholtz-Zentrum Dresden-Rossendorf (HZDR))

114/203

Helmholtz-Zentrum Dresden-Rossendorf (HZDR)

Bautzner Landstr. 400, 01328 Dresden, Germany

Speaker

Oliver Knodel (Helmholtz-Zentrum Dresden-Rossendorf)

Description

In the initial HMC application, CWL workflows had a special role in heliport. This contribution explains why this seemed necessary at the time and illustrates what has changed since then.
The role of UNICORE as a central component that provides access to our computing resources and also supports workflows has emerged over the course of the project.
It is challenging to support everything that modern workflow languages can support. Instead, we focus in the future on the work with provenance information (visualisation, ...). The execution of CWL will slowly be phased out and moved to stand-alone third-party tools (e.g. Rabix, Toil, UNICORE, ...) which are able to generate provenance metadata according to established standards (wf4ever wfdesc, W3C PROV, ...). This would also allow us to import workflows from other custom software stacks (e.g. spekNG, Eupraxia Notebooks, ...) and move the implementation into the tools themselves instead of creating more HELIPORT plugins.

Primary author

Oliver Knodel (Helmholtz-Zentrum Dresden-Rossendorf)

Co-authors

David Pape (HZDR) Guido Juckeland (Helmholtz-Zentrum Dresden-Rossendorf) Jeffrey Kelling (HZDR) Mani Lokamani (HZDR) Martin Voigt (HZDR) Stefan Mueller (Helmholtz-Zentrum Dresden-Rossendorf) Thomas Gruber (HZDR)

Presentation materials