Course Schedule
The following tentative course schedule will be followed. The schedule is flexible and might change due to progression paste, students' feedback, and unforeseen issues.
| Event | Week | Description | Required reading |
|---|---|---|---|
| Assignment(p0) | 0 | Warmup: Python, NumPy, Pandas | |
| Lecture | 1 | Introduction | Linear Algebra, Probability, Python |
| Lecture | 1 | K-nearest neighbors | KNN |
| Assignment(w1) | 2 | K-nearest neighbors | |
| Lecture | 2 | Perceptron | NYT |
| Assignment(p1) | 2 | Perceptron | |
| Lecture | 2 | Generative models | |
| Lecture | 3 | Probabilistic reasoning | |
| Lecture | 3 | Bayesian networks | |
| Lecture | 4 | Naive Bayes | Tom Mitchell's book Chp 3, Sec 1,2 |
| Lecture | 4 | Logistic Regression | Tom Mitchell's book Chp 3, Sec 3 |
| Lecture | 5 | Gradient Descent | GD Overview |
| Lecture | 5 | Linear Regression | |
| Assignment(p2) | 5 | Logistic and Linear Regression | |
| Lecture | 6 | Linear SVM | |
| Assignment(p3) | 6 | SVM | |
| Lecture | 6 | Empirical Risk Minimization | |
| Assignment(w2) | 6 | Empirical Risk Minimization | |
| Lecture | 7 | ML Debugging, Over-Underfitting | Andrew Ng's notes |
| Lecture | 7 | Bias/Variance Tradeoff | |
| Lecture | 8 | Kernels | |
| Lecture | 8 | Kernel machines | |
| Lecture | 9 | Decision/Regression Trees | |
| Lecture | 9 | Bagging | |
| Lecture | 10 | Random forests | |
| Lecture | 10 | Boosting | Boosting Paper |
| Assignment(p4) | 10 | Decision/Regression Trees | |
| Exam | 10 | Midterm exam | |
| Lecture | 11 | Feedforward Neural Networks | Deep Learning Chp 2 |
| Lecture | 11 | Backpropagation | |
| Lecture | 12 | Python Automatic Differentiation libraries | |
| Assignment(p5) | 10 | PyTorch | |
| Lecture | 12 | Derivative free optimization | CMA-ES |
| Lecture | 13 | Unsupervised learning: feature extraction | |
| Lecture | 13 | Multi-armed bandits | SB Chp 2 |
| Lecture | 14 | Markov-decision processes | SB Chp 3 |
| Assignment(w3) | 14 | MDP | |
| Lecture | 14 | Value Iteration |