AI 391L. Machine Learning
Focuses on foundational and theoretical aspects of machine learning, with a wide range of inductive classification techniques.
AI 391M. Case Studies in Machine Learning
Applies ML methods to practical, real-world data problems using case studies.
AI 391L—Machine Learning (Theory & Foundations)
1. Inductive Classification Techniques
Version space learning
Concept learning using version spaces and hypotheses. Decision Trees
ID3, C4.5, CART, and pruning methods. Rule-Based Systems
Rule induction, RIPPER, CN2. Neural Networks
Perceptron, MLP, backpropagation, activation functions. Bayesian Learning
Naive Bayes, Bayesian networks, and probabilistic inference. Instance-Based Learning
k-NN, distance metrics, and weighting functions. 2. Computational Learning Theory
3. Explanation-Based Learning
Deriving generalizations from a single example using prior knowledge. Combining symbolic reasoning with inductive learning. 4. Knowledge Refinement & Transfer
Concept drift and model updating 5. Learning Modalities
Supervised vs unsupervised 6. LISP and AI Fundamentals (Prerequisite Knowledge)
Programming basics in LISP AI techniques like search, reasoning, and planning Prerequisite Knowledge
Familiarity with: Artificial Intelligence (CS 381K or equivalent) AI 391M—Case Studies in Machine Learning (Application-Focused)
1. Review of Core ML Algorithms
Logistic regression, SVM, decision trees, random forests Gradient boosting methods (e.g., XGBoost) Neural networks, CNNs (for images), RNNs (for sequences) 2. ML Workflow with Real Data
Data preprocessing & cleaning Feature engineering & selection Model selection & hyperparameter tuning Cross-validation, performance evaluation 3. Evaluation Techniques
Confusion matrix, ROC, precision/recall, F1 score AUC, log-loss, calibration curves 4. Case Studies by Domain
Examples (could vary by instructor):
Healthcare: Predicting disease risk Finance: Fraud detection or credit scoring Retail: Recommendation systems Social Media: Sentiment analysis Image/Video: Object detection or classification 5. Tools and Libraries
Python (NumPy, pandas, scikit-learn) TensorFlow/PyTorch for deep learning Jupyter notebooks for analysis 6. Project Work
Students analyze a dataset, apply ML, and present findings Could include Kaggle-style competitions or open datasets
Plan Structure (6-Months)
Phase 1: Foundations (Weeks 1–8)
Phase 2: Intermediate & Theory (Weeks 9–16)
Phase 3: Case Studies & Capstone (Weeks 17–24)