Seminar: Deep Learning for the Natural Sciences (5 ECTS)
Winter Semester 2024
Organiser: Karnik Ram (karnik.ram@tum.de)
Preliminary meeting : 11.07.24. Slides
Description
Following its success in computer vision and language processing, deep learning is now being increasingly used to augment and accelerate research in the natural sciences. Examples include electro-catalyst discovery for energy storage, fast PDE solvers for weather forecasting, discovery of new anti-biotics, and many other advances that were not possible using traditional methods alone. In this seminar, we will discuss relevant papers in this new area, with an emphasis on the deep learning techniques powering these approaches such as geometric deep learning, generative models, and self-supervised learning.
Format
- Students are expected to study one paper in depth, and present and lead a discussion on it. Apart from the presentation and report, students are also expected to periodically submit one-paragraph summaries of the papers discussed, and participate in the discussions.
- Sessions will be held in-person (with a remote attendance option) once every two weeks, on Tuesday afternoon (14:30 - 16:30). There will be two paper presentations in every session. There will also be a catch-up lecture on certain relevant topics from deep learning (eg. diffusion models, graph learning) at the start based on interest.
- All class-related communications are over Discord, and the summaries, presentation, and report are managed on Gradescope.
Prerequisites
A good understanding of machine learning techniques (esp. deep learning), linear algebra, and calculus. Undergraduate students are requested to check with the organizer before enrolling.
Schedule
Location: CIT Seminarraum 00.08.055
Time: 2:30 PM to 4:30 PM
Virtual: Zoom link
Date | Paper | Presenter | Material |
---|---|---|---|
Oct 15 | Introductory session | Karnik | Intro Review |
Nov 5 | Highly accurate protein structure prediction with AlphaFold 2 | Zeyu | |
AlphaFold Meets Flow Matching for Generating Protein Ensembles | Sascha | ||
Nov 12 | GenCast: Diffusion-based ensemble forecasting for medium-range weather | Leonhard | |
Aurora: A Foundation Model of the Atmosphere | Frederic | ||
Nov 26 | BioCLIP: A Vision Foundation Model for the Tree of Life | Qianlong | |
Fine-Tuned Language Models Generate Stable Inorganic Materials as Text | Ahmet | ||
Dec 10 | Scaling deep learning for materials discovery | Jannis | |
KAN 2.0: Kolmogorov-Arnold Networks Meet Science | Jonathan |