ECS 171: Machine Learning

ECS 171
Machine Learning
Effective Term
2020 Spring Quarter
Learning Activities
Lecture: 3 hours
Discussion: 1 hour
Introduction to machine learning. Supervised & unsupervised learning, including classification, dimensionality reduction, regression & clustering using modern machine learning methods. Applications of machine learning to other fields. GE Prior to Fall 2011: SciEng. GE: SE.
ECS 060 or ECS 032B or ECS 036C; or Consent of Instructor. Probability equivalent to STA 032 or STA 131A or ECS 132 recommended; linear algebra equivalent to MAT 22A recommended.
Enrollment Restrictions
Pass One open to Computer Science and Computer Science & Engineering Majors only; Pass Two open to undergraduate students only.

Summary of Course Content
This course will provide an introduction to machine learning methods and learning theory. Students will acquire a general background on machine learning and pattern recognition, including state-of-the-art techniques in supervised and unsupervised learning. The course will include five problem sets that are related to the course outline. Students will work individually or as part of teams to complete a term project that will pertain on the application of these methods in different scientific fields. Topics will include:

  1. Supervised learning
    1. Regression
    2. Generative learning
      1. Naive Bayes
      2. Bayesian learning
    3. Discriminative learning
      1. K-nearest neighbors
      2. Decision trees
      3. Support Vector Machines (SVM) and kernels 2) Unsupervised learning
        1. Clustering (K-means, hierarchical)
        2. Dimensionality reduction methods (principal component analysis, independent component analysis)
        3. Association rule mining
        4. Self-organizing maps
      4. Learning theory
        1. Bias-variance trade-offs
        2. Kernels
        3. Statistical validation
        4. VC Theory
      5. ML applications in other fields (Social networks, biology, image processing) Students will have to complete a computational/review project in coordination with the instructor.

Illustrative Reading

  • C. Bishop. Pattern Recognition and Machine Learning. Springer, 2007 • Technical papers and class notes will be used.

Potential Course Overlap
There is an overlap with ECS 170, related to feature extraction methods and Bayesian methods. This overlap is minimal and the treatment of the underlying methods is fundamentally different: ECS 170 focuses on AI algorithms and logic-based decision making while ECS 171 takes a pattern recognition and machine-learning approach.

Course Category