Machine Learning and Physics
Machine learning has become a transformational force in our society, and is profoundly impacting society in ways both good and bad. On the good side, machine learning fuels scientific breakthroughs such as solving the protein folding problem, or creating large language models that by now show sparks of artificial general intelligence. On the bad side, convincing deep fakes are used for manipulation, and machine learning supports surveillance in totalitarian states.
Contents
This course takes a two-pronged approach:
Physics of Machine Learning: Highlight physical ideas and concepts that drive ML
Machine Learning for Physics: Equip you with tools to help conduct, and interpret, future experiments
Curriculum (preliminary)
- Introduction & linear dimension reduction
- Nonlinear dimension reduction: connection to stat. mechanics
- Nonparametric density estimation
- Basic clustering techniques, review of information theory
- Comparing partitions
- Linear regression
- Regularized regression: ridge, lasso
- Classification, take 1: discriminative
- Statistical decision theory
- Bayesian inference
- Classification, take 2: parametric & generative methods
- Classification, take 3: logistic regression, generalized linear models
- Multi-layer perceptrons
- Training of neural networks
- Backpropagation
- Convolutional neural networks
- Self-supervision and foundation models
- Graph neural networks
- Attention, transformers, large language models
- Generative AI: diffusion models
- Probabilistic graphical models
- Reinforcement learning
- Geometric machine learning: symmetries, groups, representations
- Geometric machine learning: SO(3) equivariance and applications
- Ethics of ML
- Q&A
Where and when
The main lectures are on Tuesdays and Thursdays from 9h00 (NOT 9h15!) until 10h45 in Großer Hörsaal, Philosophenweg 12.
FAQ
Q: Do I need prior knowledge in machine learning?
A: No.
Q: I just want to learn the basics. Is this the right course?
A: Students liked my 2022 rendition, but noted a steep learning curve; if you only want to cover the basics, please check for slower-paced alternatives such as the “Machine Learning Essentials”.
Q: Is this course about deep learning?
A: Neural networks will play an important role; but this course is more about principles. We will not discuss the latest architectures in any detail.
Q: Will this course be repeated next year?
A: Yes, like every MSc core course, though likely by a different professor.
Q: Is there a text book?
A: There is unfortunately not a single compact book covering the entire contents of the course. Most material is covered in the 2000 pages of Murphy’s volumes 1 and 2. I will try and make a script available for at least the bulk of the contents.
Q: Exam modalities?
A: To be admitted to the written exam at the end of the semester, you need to gain 50% of the points in the exercise sheets.
Q: 9AM is really early. Is it okay if I come a bit later?
A: No. I try and introduce the material of the day in a didactic manner at the beginning, and you disturb others by coming late. We start early so that we can finish by 10h45, allowing you to smoothly transit to your next lectures. (And yes, I think 9AM is early, too.)