Welcome to the Introduction to Deep Learning course offered in SS18.
Lecture
Mondays (14:00-16:00) - HOERSAAL MI HS 1 (00.02.001)
Lecturers: Prof. Dr. Laura Leal-Taixé and Prof. Dr. Matthias Niessner.
ECTS: 6
SWS: 4
Tutorial
Thursdays (08:00-10:00) - Interims Hörsaal 1 (5620.01.101)
Tutors: Ji Hou, Tim Meinhardt and Andreas Rössler
For details about the exercises please read the README.md, which is distributed with the exercise. In particular, you will submit your solutions via our submission website.
Content
- 09.04 - Lecture 1: Introduction to the lecture, Deep Learning, Machine Learning.
- 16.04 - Lecture 2: Machine Learning Basics: Linear regression, Classification and Loss Functions.
- 23.04 - Lecture 3: Introduction to neural networks
- 30.04 - Lecture 4: Backpropagation
- 07.05 - Lecture 5: Optimization I
- 14.05 - Lecture 6: Optimization II
- 28.05 - Lecture 7: Training Neural Networks Part I: Regularization, Activation functions, Weight initialization, Gradient flow, Batch normalization and Hyperparameter optimization.
- 04.06 - Lecture 8: Training Neural Networks Part II: Parameter updates, Ensembles and Dropout.
- 11.06 - Lecture 9: Convolutional Neural Networks (CNN) I
- 18.06 - Research lecture: presentation of Deep Learning projects at TUM
- 25.06 - Lecture 10: CNN II
- 02.07 - Guest lecture
- 09.07 - Lecture 11: Recurrent networks (RNN), LSTM
Slides
You can now download the slides in PDF format:
- Lecture 1, Lecture 2, Lecture 3, Lecture 4, Lecture 5, Lecture 6, Lecture 7, Lecture 8 , Lecture 9, Lecture 10, Lecture 11
Prerequisites
- Strong mathematical background: linear algebra, calculus.
- Previous knowledge of Python is needed.
- Machine Learning background is recommended.
- Previous knowledge of PyTorch is recommended.
Moodle
We use Moodle for discussions and to distribute important information. Please check the News and Discussion boards regularly or subscribe to them.
The slides and all material will also be posted on Moodle.
Exercise and tutorial schedule
- 12.04 - Math Background I
- 19.04 - Math Background II
- 26.04 - Introduction to Python, exercise 0 and exercise 1
- 24.05 - Solutions of 1st and introduction to 2nd exercise
- 07.06 - Solutions of 2nd and introduction to 3rd exercise
- 21.06 - Solutions of 3rd and introduction to 4th exercise
- 05.07 - Solutions of 4th exercise
EXERCISE 0:
- Topics: Setup and test the submission system
- Starting date: 26.04
- Due date: 02.05 23:59
EXERCISE 1:
- Topics: TBA
- Starting date: 03.05
- Due date: 23.05 23:59
EXERCISE 2:
- Topics: TBA
- Starting date: 24.05
- Due date: 06.06 23:59
EXERCISE 3:
- Topics: TBA
- Starting date: 07.06
- Due date: 20.06 23:59
EXERCISE 4:
- Topics: TBA
- Starting date: 21.06
- Due date: 04.07 23:59
FINAL EXAM:
If you have any questions regarding the organization of the course, do not hesitate to contact us at: i2dl@dvl.in.tum.de
For questions on the syllabus, exercises or any other questions on the content of the lecture, we will use the Moodle discussion board.
Office hours
We also offer to discuss questions in person in our office hours at room 02.09.051 until Friday 13th of July:
- Monday – Wednesday: 10 - 11 & 13 - 14
- Thursday: 10 - 11
- Friday: 13 - 14
External (non-TUM) Students
We want to provide access to our lecture for as many students as possible. Therefore, we ask external students that are not TUM students and do not have access to TUMonline to register to Moodle and send us their student information via email. We will then add you to our Moodle course where you will find addtional information and all the course material.
