Generative AI Workshop at GEOMARIn-Person Event

5 Dec 2024, 10:00 → 6 Dec 2024, 13:00 Europe/Berlin

Day 1: room 14-101, Day 2: room 5-3.228 Terminalraum / Terminalroom (GEOMAR, Wischhofstr 1-3, 24148 Kiel)

Adeniyi Mosaku (Helmholtz AI, Hereon, DKRZ), Danu Caus (Helmholtz AI, Hereon, DKRZ)

This will be a two-day workshop on the topic of Transformers and Generative AI / GenAI. In the first day we intend to offer a self-contained presentation spanning several AI topics, starting with the basics of neural networks in general, followed by a high-level overview of Generative AI models, and then focusing on arguably the most important architectures within GenAI, namely the Transformer model architecture. The second day of the workshop will be dedicated towards building a Vision Transformer / ViT from scratch in Python and PyTorch and subsequently applying it to marine data. The application will be a classification task for illustration purposes, but the built model will be universal in nature, adaptable to other marine science tasks. The main focus of the workshop will be to teach AI concepts in an intuitive manner through deconstructing the Transformer foundational model architecture, this way fostering a more generalizable understanding and application across downstream tasks.

GenAIWorkshop_GEOMAR_final.odp

GenAIWorkshop_GEOMAR_final.pdf

GenAIWorkshop_GEOMAR_final.pptx

GenAIWorkshop_GEOMAR_with_footnotes_final.pdf

Venue GenAI workshop.png

Thursday 5 December

10:00 → 11:00 Theory of Neural Nets and Generative AI

Speaker: Danu Caus (Helmholtz AI, Hereon, DKRZ)

11:00 → 11:30 Coffee break

This will also be a chance to set up the Python coding environment for Day 2

11:30 → 13:00 Theory and applications of Transformers

Speaker: Danu Caus (Helmholtz AI, Hereon, DKRZ)

Friday 6 December

10:00 → 11:00 Build a Vision Transformer / ViT from scratch and apply it to marine data, Part 1

Speaker: Adeniyi Mosaku (Helmholtz AI, Hereon, DKRZ)

11:00 → 11:30 Coffee break

11:30 → 13:00 Build a Vision Transformer / ViT from scratch and apply it to marine data, Part 2

Speaker: Adeniyi Mosaku (Helmholtz AI, Hereon, DKRZ)