Welcome to the Introduction to Deep Learning course offered in SS19.
Lecture
Mondays (14:00-16:00) - HOERSAAL MI HS 1 (00.02.001)
Lecturers: Prof. Dr. Laura Leal-Taixé and Prof. Dr. Matthias Niessner.
ECTS: 6
SWS: 4
Tutorial
Thursdays (08:00-10:00) - Interims Hörsaal 1 (5620.01.101)
Tutors: Patrick Dendorfer and Andreas Rössler
For details about the exercises please read the README.md, which is distributed with the exercise. In particular, you will submit your solutions via our submission website.
Content
- 25.04 - THURSDAY - Lecture 1: Introduction to the lecture, Deep Learning, Machine Learning.
- 29.04 - Lecture 2: Machine Learning Basics: Linear regression, Classification and Loss Functions.
- 06.05 - Lecture 3: Introduction to neural networks
- 13.05 - Lecture 4: Backpropagation
- 20.05 - Lecture 5: Optimization I
- 27.05 - Lecture 6: Optimization II
- 03.06 - Lecture 7: Training Neural Networks Part I: Regularization, Activation functions, Weight initialization, Gradient flow, Batch normalization and Hyperparameter optimization.
- 10.06 - No lecture - Holidays
- 17.06 - No lecture - CVPR
- 24.06 - Lecture 8: Training Neural Networks Part II: Parameter updates, Ensembles and Dropout.
- 01.07 - Lecture 9: Convolutional Neural Networks (CNN) I
- 08.07 - Lecture 10: CNN II: common architectures, VGG, ResNet, Inception
- 15.07 - Lecture 11: Recurrent networks (RNN), LSTM
- 22.07 - Lecture 12: Guest lecture
Slides
You can now download the slides in PDF format:
Prerequisites
- Strong mathematical background: linear algebra, calculus.
- Previous knowledge of Python is needed.
- Machine Learning background is recommended.
- Previous knowledge of PyTorch is recommended.
Moodle
We use Moodle for discussions and to distribute important information. Please check the News and Discussion boards regularly or subscribe to them.
The slides and all material will also be posted on Moodle.
Exercise and tutorial schedule
- 02.05 - Organisation Exercises (Bonus) and Math Background I (attendance recommended)
- 09.05 - Math Background II
- 16.05 - Introduction to Exercise system, Exercise 0, and presentation Exercise 1
- 23.05 - Start of Exercise 1 ( !!!no tutorial!!! )
- 06.06 - Solution to Exercise 1 and Introduction to Exercise 2
- 13.06 - Supplementary exercise
- 27.06 - Solution to Exercise 2 and Introduction to Pytorch
- 04.07 - Start of Exercise 3 ( !!!no tutorial!!! )
- 25.07 - Solution to Exercise 3
FINAL EXAM:
- Exam date: 08.08.2019, 08-09.30h
If you have any questions regarding the organization of the course, do not hesitate to contact us at: i2dl@dvl.in.tum.de
For questions on the syllabus, exercises or any other questions on the content of the lecture, we will use the Moodle discussion board.
Office hours
In addition to the tutorial we also offer to discuss questions in person in our office hours at room (preliminary, room may change during semester) 02.09.051 :
Office hours start on the 16th of May.
- Monday: 11:00 - 12:00 & 13:00 - 14:00
- Tuesday: 10:00 - 11:00 & 14:00 - 15:00
- Wednesday: 10:00 - 11:00 & 14:00 - 15:00
- Thursday: 16:00 - 17:00
- Friday: 10:00 - 11:00 & 14:00 - 15:00
External (non-TUM) Students
We want to provide access to our lecture for as many students as possible. Therefore, we ask external students that are not TUM students and do not have access to TUMonline to register to Moodle and send us their student information via email. We will then add you to our Moodle course where you will find addtional information and all the course material.
