Welcome to Machine learning course. What is machine learning? It is concerned with the question of how to write computer programs that automatically improve with experience. Over the very recent years, the field has expanded so much in every direction of our daily lives that we mostly are unaware of its existence. But, as a concerned citizen of the world, we are going to know the nuts and bolts of machine learning.

The course is based on fundamental knowledge of computer science principles and techniques, probability and statistics, calculus, and the theory and application of linear algebra. The course provides a broad introduction to pattern recognition from given data and how it can relate to machine learning. Topics include supervised learning, unsupervised learning, semi-supervised learning, neural network, and reinforcement learning algorithms. The course will also discuss recent applications of these machine learning concepts in solving real-world problems.

Course objectives

By the end of the course you are expected to gain the following skills:

1. Develop an understanding on how to extract patterns from data.
2. Develop an understanding on a wide variety of machine learning algorithms – how the algorithms work, and their practical usages.
3. Understand different types of optimization techniques, which are heavily utilized in many of the learning algorithms.
4. Capable of discussing pros and cons of the learning algorithms.
5. Be able to implement the covered algorithms in class by themselves using Python programming language.
6. Apply the algorithms to solve real world problems.
7. Understand and apply the principles of responsible AI system design: fairness, inclusiveness, transparency, reliability and safety, privacy and security, accountability, limits of capabilities.

Prerequisites

1. The graduate standing.

Schedule

Week 1

Total watch hour: 1 hour 2 minutes and 55 seconds

1. Introduction to Machine learning [ PDF ] [ Video-Recording, 19:46]
2. I am wondering you want to become a data scientists [ PDF ] [Video-Recording, 17:00]
3. Challenges with Machine learning system design [ PDF ] [Video-Recording, 26:09]

Week 2

Total watch hour: 3 hours 20 minutes and 37 seconds

1. Stories of Machine Learning [ PDF ][ Video-Recording, 58:06]
2. Nuts and Bolts of Machine Learning (part 1): The types of learning [ PDF ][ Video-Recording, 34:31]
3. Nuts and Bolts of Machine Learning (part 2): The task and the datasets [ PDF ] [ Video-Recording, 32:37 ]
4. Nuts and Bolts of Machine Learning (part 3): How to tell the machine learning model is good? [ PDF ] [ Video-Recording, 52:21 ]
5. Nuts and Bolts of Machine Learning (part 4): Exploratory Data analysis – a case study: House price prediction [ zip ] [ Video-Recording, 23:02 ]

Week 3

Total watch hour: 3 hours 6 minutes and 22 seconds

1. Regression, and Simple linear regression [ PDF, slides 1-24 ] [ Video-Recording, 45:24 ]
2. Multiple Linear regression [ PDF, slides 25-32 ] [ Video-Recording, 27:18]
3. Comments on calculating gradient of linear regression loss function [ PDF, slides 51 and onward ] [ Video-Recording, 16:18]
4. Gradient Descend Algorithm [ PDF, slides 33-49 ] [ Video-Recording, 31:06 ]
5. Evaluating Regression models [ PDF, slide 50 ] [ Video-Recording, 13:05 ]
6. Introduction to classification, and kNN classifier [ PDF] [ Video-Recording, 53:06 ]

Weeks 4, 5

Total watch hour: 7 hours 24 minutes and 14 seconds

1. Another look at evaluating linear regression models [Slide PDF] [ Video-Recording, 28:41]
2. Bias-variance tradeoffs, Overfitting, Underfitting [Slide PDF] [ Video-Recording, 26:50 ] [ Another supporting slide]
3. Dataset splits: training, testing, validation, cross-validation [Slide PDF] [ Video-Recording, 16:23 ]
4. Label encoding, One-hot encoding [Slide PDF] [Video_Recording, 10:57]
5. Logistic regression for binary classification [Slide PDF] [ Video-Recording, 54:59]
6. Binary to multi-class classification [Slide PDF][ Video-Recording, 52:24]
7. Multi-label classification [Slide PDF][ Video-Recording, 50:31]
8. Introduction to clustering [Slide PDF][ Video-Recording, 1:03:08]
9. k-means clustering algorithm [Slide PDF][ Video-Recording, 1:05:18]
10. Hierarchical clustering algorithm [Slide PDF] [ Video-Recording, 1:15:03 ]

Weeks 6, 7

Total watch hour: 4 hours 19 minutes and 6 seconds

1. Naive Bayes Classifier : The Bayes’ Theorem [ PDF ] [ Video-Recording, 14:39 ]
2. Naive Bayes Classifier : A simple math problem [ PDF] [ Video-Recording, 7:25]
3. Naive Bayes Classifier : Idea behind the classification algorithm [PDF] [ Video-Recording, 11:47]
4. Definition of Naive Bayes Classifier [ PDF ] [ Video-Recording, 10:01]
5. Naive Bayes Classifier in action [PDF] [ Video-Recording, 22:01 ]
6. Naive Bayes Classifier : few implementation facts [ PDF] [ Video-Recording, 5:42 ]
7. Principal Component Analysis (PCA) for Dimensionality Reduction [Link 1] [Notebook] [Video-Recording, 50:44]
8. Introduction to Reinforcement Learning with OpenAI-Gym [ Notebook/Slide ] [ Github-Repo ] [ Video-Recording, 37:11 ]
9. Working with OpenAI-Gym environments [Notebook/Slides: ALE/Breakout, Blackjack, CarRacing, ALE/Pong, ALE/Riverraid ][ Github-Repo ] [ Video-Recording, 16:00 ]
10. Making of an Intelligent CartPole agent [Notebook/Slides: Random CartPole Agent, Q-learning CartPole Agent][ Github-Repo ] [ Video-Recording, 48:27]
11. Non-gym environment and Reinforcement learning from scratch [Notebook/Slides: Goal-vs-Hole-v0, Goal-vs-Hole-v1][ Github-Repo ] [ Video-Recording, 35:09 ]

Week 8, 9

Total watch hour: 4 hours 19 minutes and 6 seconds

1. Ensemble Learning [ PDF ] [ Video-Recording, 52:39 ]
2. Ridge Regression [ PDF ] [ Video-Recording, 1:07:23 ]
3. LASSO Regression [ PDF ] [ Video-Recording, 37:05]
4. Support Vector Machines :: [ PDF ]
   • Part 1: The intuition [ Video-Recording, 16:07]
   • Part 2: Formal introduction [ Video-Recording, 1:00:06]
   • Part 3: Kernel tricks & Programming Support Vector machines from scratch [ Video-Recording 54:40], [ Jupyter Notebooks with both primal and dual form ]
   • Part 4: Solving Support Vector Machines on a piece of paper [ Video-Recording, 22:46]

Week 10

Total watch hour: 1 hours 42 minutes and 29 seconds

1. Introduction to Artificial neural networks (ANN) and deep learning [ PDF ] [Video Recording, 24:19]
2. Artificial Neural Networks – the basics [ PDF ], [ Jupyter notebook ]
   • The preliminaries [ Video-Recording, 44:15 ]
   • The math, the backpropgation algorithm and the implementation [Video-recording, 33:55]

Week 11, 12, 13

Total watch hour: 9 hours 21 minutes and 52 seconds

1. Compute framework for Artificial Neural Network + Deep Learning [ PDF ] [Video Recording, 01:00:03]
2. Tensorflow 2.0 [ PDF ] [Video Recording, 32:56]
3. Introduction to Tensors [Jupyter Notebook] [Video Recording, 01:02:38]
4. Backpropagation with Tensorflow 2.0 [Jupyter Notebook] [Video Recording, 01:08:55]
5. Convolution Neural Network
   1. The intuition [ Notebooks ][Video Recording, 30:52]
   2. Convolution Operation, 1x1 conv, implementation aspects [Notebooks] [Video Recording, 01:27:10]
   3. The pooling layer [Notebook] [Video Recording, 11:11]
   4. Flattened layer and fully connected layer [Notebooks] [Video Recording, 14:08]
   5. Few examples [Notebooks] [Video Recording, 14:16]
   6. Epilog + comment on weight sharing property [Notebooks] [Video Recording, 09:02]
6. Recurrent Neural Networks
   1. Introduction [Notebooks] [Video Recording, 38:20]
   2. Basic language modeling with Recurrent Neural Networks [Notebooks] [Video Recording, 29:15]
   3. Vanilla architecture of RNN [Notebooks] [Video Recording, 58:49]
   4. Long short term memory (LSTM) architecture of RNN [Notebooks] [Video Recording, 44:17]