CSCI-4930/5930: Machine Learning

Cross-listed course (ugrad+grad), Student Commons -2504, 2019

Welcome to Machine learning course. What is machine learning? It is concerned with the question of how to write computer programs that automatically improve with experience. Over the very recent years, the field has expanded so much in every direction of our daily lives that we mostly are unaware of its existence. But, as a concerned citizen of the world, we are going to know the nuts and bolts of machine learning.

The course is based on fundamental knowledge of computer science principles and techniques, probability and statistics, calculus, and the theory and application of linear algebra. The course provides a broad introduction to pattern recognition from given data and how it can relate to machine learning. Topics include supervised learning, unsupervised learning, semi-supervised learning, neural network, and reinforcement learning algorithms. The course will also discuss recent applications of these machine learning concepts in solving real-world problems.

Course objectives

By the end of the course you are expected to gain the following skills:

  1. Develop an understanding on how to extract patterns from data.
  2. Develop an understanding on a wide variety of machine learning algorithms – how the algorithms work, and their practical usages.
  3. Understand different types of optimization techniques, which are heavily utilized in many of the learning algorithms.
  4. Capable of discussing pros and cons of the learning algorithms.
  5. Be able to implement the covered algorithms in class by themselves using Python programming language.
  6. Apply the algorithms to solve real world problems.

Prerequisites

For undergraduates:

  1. MATH-3195 (Linear algebra and differential equations)
  2. CSCI-3412 (Algorithms).

For graduate students:

  1. The graduate standing.

Topics covered

  1. Introduction to Machine Learning
  2. Linear regression
  3. Gradient Descent
  4. Python programming for ML
  5. Principal component analysis
  6. Least-square estimates vs Shrinkage methods for regression
  7. Introduction to classification
  8. Classifier Evaluation
  9. k-NN classifier
  10. Naive Bayes classifier
  11. Binary vs Multi-class classification
  12. Introduction to Ensemble learning
  13. Introduction to clsutering
  14. k-means and hierarchical clustering algorithms
  15. Introduction to collaborative filtering algorithms
  16. Introduction to Support Vector Machines
  17. Reinforcement Learning
  18. Artificial Neural Networks