ECS 171: Machine Learning

Summary of Course Content
This course will provide an introduction to machine learning methods and learning theory. Students will acquire a general background on machine learning and pattern recognition, including state-of-the-art techniques in supervised and unsupervised learning. The course will include five problem sets that are related to the course outline. Students will work individually or as part of teams to complete a term project that will pertain on the application of these methods in different scientific fields. Topics will include:

1. Supervised learning
   1. Regression
   2. Generative learning
      1. Naive Bayes
      2. Bayesian learning
   3. Discriminative learning
      1. K-nearest neighbors
      2. Decision trees
      3. Support Vector Machines (SVM) and kernels 2) Unsupervised learning
         1. Clustering (K-means, hierarchical)
         2. Dimensionality reduction methods (principal component analysis, independent component analysis)
         3. Association rule mining
         4. Self-organizing maps
      4. Learning theory
         1. Bias-variance trade-offs
         2. Kernels
         3. Statistical validation
         4. VC Theory
      5. ML applications in other fields (Social networks, biology, image processing) Students will have to complete a computational/review project in coordination with the instructor.

Illustrative Reading

• C. Bishop. Pattern Recognition and Machine Learning. Springer, 2007 • Technical papers and class notes will be used.

Potential Course Overlap
There is an overlap with ECS 170, related to feature extraction methods and Bayesian methods. This overlap is minimal and the treatment of the underlying methods is fundamentally different: ECS 170 focuses on AI algorithms and logic-based decision making while ECS 171 takes a pattern recognition and machine-learning approach.