COMP 640: Graduate Seminar in Machine Learning

Structure

This research seminar is intended to discuss recent advances and trends in machine learning. We will be presenting and discussing 1-2 recent related technical papers each week. The focus will be on modern techniques, ideas, and trends in machine learning. The aim is to understand the fundamental ideas, tricks, and concepts involved with the aim of using them in practice and stimulating research. The stress will be on reading and grasping maximum out of some seminal papers. Whenever necessary, some concepts will be introduced for clarification and to make connections.


This year we will start with basic SVMs, Kernels, and Random Features for Large Scale Learning. Then we will go from random features to learned features (a.k.a deep learning). Look into tricks and trades of how to train large-scale deep network. We will then switch to reinforcement learning and finally deep-reinforcement learning, which is where we will get some insight into the coolest AI engines of our times: the self-driving car and the Alpha-go system.

Grading and Logistics

Class participation (5 min quiz), one paper presentation, and one paper summarization for 1 credit. In addition students can undergo a semester long research project for 3 credits. There will be a quiz on the readings in the first 5 minutes. It is important to read the listed papers (as much as you can) before coming to the class.

Prerequisite

A rigorous course in machine learning is required. We will be discussing advanced papers in ML papers every week.

Piazza For Discussions

Please signup at: piazza page

Presentations and Scribe Logistics

Each student should sign up for 1 class to present (2-3 students per class) and 1 class to scribe the discussions(2-3 students per class). You cannot scribe the same class that you presented. You should give a dry run of your presentation to the instructor a week before the class in the office hours (or some other scheduled time). Several rounds of modification may be needed before a presentation is ready for the class, so make sure to schedule early. The scribe should be submitted no later than a week of the presentation.


Please sign-up for scribe and presentation assignment at Google Spreadsheet

Schedule

Students with Disability

If you have a documented disability that may affect academic performance, you should: 1) make sure this documentation is on file with Disability Support Services (Allen Center, Room 111 / adarice@rice.edu / x5841) to determine the accommodations you need; and 2) meet with me to discuss your accommodation needs.