Advanced Course in Machine Learning : Lectures
The course consists of 13 lectures. The upcoming lecture topics are somewhat tentative and subject to minor changes. The lecture slides will be added here after the lectures.
Part I: Preliminaries and general conecpts
-
Tuesday 15.3.: Introduction, practicalities and prerequisities. Includes quick summary of probabilites and linear algebra.
- [SLIDES]
- Alternative reading: The UML lecture notes section 2
-
Thursday 17.3.: Machine learning basics: Loss functions, overfitting, regularization, and all that. The other half covers convex optimization.
- [SLIDES]
- Alternative reading: The UML lecture notes section 3
-
Tuesday 22.3.: Learning tasks and probabilistic models.
- [SLIDES]
- Alternative reading: David Barber's book section 8.7, 8.8, parts of Sections 4, 9 and 13
Part II: Unsupervised learning
-
Thursday 31.3.: Clustering: spectral clustering, mixture models and the EM algorithm
- [SLIDES]
- Alternative reading: The UML lecture notes section 12
-
Tuesday 5.4.: Linear dimensionality reduction: PCA, factor analysis, ICA
- [SLIDES]
- Alternative reading: The UML lecture notes sections 4-8
-
Thursday 7.4.: Matrix factorization and non-linear dimensionality reduction
- [SLIDES]
Part III: Supervised learning
-
Tuesday 12.4.: Linear supervised models for regression and classification; regression and sparse linear models; generative vs discriminative classifiers
- [SLIDES]
-
Thursday 14.4.: Kernel methods and support vector machines
- [SLIDES]
-
Tuesday 19.4.: Decision trees, boosting and ensembles
- [SLIDES]
Part IV: Neural networks and deep learning
-
Thursday 21.4: Neural network concepts, multilayer perceptron, backpropagation
- [SLIDES]
- Alternative reading: Selected parts of the Deep learning book by Goodfellow, Bengio and Courville
-
Tuesday 26.4.: Deep learning: convolutional neural networks and supervised deep learning
- [SLIDES]
-
Thursday 28.4.: Unsupervised deep learning: autoencoders and Boltzmann machines
- [SLIDES]
Part V: Re-cap and exam preparation
- [SLIDES]