Advanced machine learning

Summary

This course will present some of the core advanced methods in the field for structure discovery, classification and non-linear regression. This is an advanced class in Machine Learning; hence, students are expected to have some background in the field.

Content

Keywords

Machine learning, statistics

Learning Prerequisites

Required courses

Probability & Statistics, Linear Algebra

Recommended courses

Machine Learning, Pattern Recognition

Important concepts to start the course

Linear Algebra: Eigenvalue and singular value decomposition

Statistics: Definitions of probability density function, marginal, likelihood, covariance, correlation

Optimization: Lagrange multipliers, gradient descent, local and global optima

Learning Outcomes

By the end of the course, the student must be able to:

• Choose an appropriate method
• Apply the method properly

Transversal skills

• Use a work methodology appropriate to the task.
• Write a scientific or technical report.
• Make an oral presentation.

Teaching methods

The format of the course is that of a Split-Class: The theory of the course is presented through a video which students must watch prior to class. One hour of the course is allocated for this. This is following by an ex-cathedra lecture that consists of a one-hour interactive lecture session. The interactive lecture takes place on campus, but students who need it can also attend through zoom. An electronic polling system is used to engage students during the lecture.

A two-hour exercise sessions is given each week after the lecture. 4 of the weeks of the course are dedicated to computer-based practical sessions, during which students learn to use the algorithms seen in class for processing real data.

Exercise sessions and computer-based practice session are done on site only. No remote connection possible.

Expected student activities

Students are expected to watch the videos prior to the interactive lecture, as the interactive lecture will not repeat the video but go in more depth in the concepts presented in the videos.

Students are expected to attend the exercise sessions and the computer-based practice sessions. They should revise the class notes prior to going to practical session to be on top of the the theoretical material prior to applying it.

Students who are no longer up to date with the pre-requisites should work on these in parralel to taking the class.

Assessment methods

40% of the grade based on personal work during semester (project or in-class critical reading of a paper) and the residual 60% based on oral exam

Supervision

Resources

Virtual desktop infrastructure (VDI)

No

Ressources en bibliothèque

• Machine Learning Technique / Billard

Notes/Handbook

Machine Learning Techniques, available at the Librairie Polytechnique. To be purchased before the class starts.

Moodle Link

• https://go.epfl.ch/MICRO-570

Videos

• https://tube.switch.ch/channels/7e86d16d

Prerequisite for

Students must be knowledgeable about machine learning and have taken a course in the area either at EPFL or elsewhere. Relevant courses at EPFL are:

Applied Machine Learning - MICRO-455

Pattern Classification and Machine Learning: CS-433

Data Analysis and Model Classification - EE-516