24–26 Mar 2025 In-Person Event
Helmholtz-Zentrum Berlin für Materialien und Energie
Europe/Berlin timezone

PUNCH4NFDI: Workflows with REANA

25 Mar 2025, 11:25
10m
Helmholtz-Zentrum Berlin für Materialien und Energie

Helmholtz-Zentrum Berlin für Materialien und Energie

Campus Adlershof Albert-Einstein-Straße 15 12489 Berlin

Speaker

Harry Enke (Leibniz Institute for Astrophysics Potsdam (AIP))

Description

The PUNCH4NFDI consortium has been working with developers at CERN to enable the use of the REANA workflow environment in a federated (and heterogeneous) infrastructure. While the access (Authentication) via the NFDI AAI is easy, the connection with different resource-management facilities required work. Within PUNCH4NFDI, we've connected the CoBALD/TARDIS resource manager (integrated now as module in recent REANA release) and also enabled the use e.g. of dCache storage space, albeit this is still ongoing. The use of storage resources via standard S3 protocol is available. Developing and deployment of more job controller interfaces, e.g. for SLURM clusters, is in the works.
During a ErUM data workshop, a workflow for processing of timepix3 raw data stream has been demonstrated together with HZB colleagues. The talk will give an overview of the REANA deployment within PUNCH4NFDI, and then provide some examples to discuss the advantages of a REANA component for standarized processing tasks of medium experiment data. This supports especially the "R" in FAIR.

Primary author

Harry Enke (Leibniz Institute for Astrophysics Potsdam (AIP))

Co-authors

Dr Elena Sacchi (Leibniz Institute for Astrophysics Potsdam (AIP)) Dr Florian Kronast (HZB) Dr Pierre Schnizer (HZB)

Presentation materials

There are no materials yet.