Teaching & mentorship

Rational agents: choosing actions to maximize expected utility.

• Search & planning

  Represent goals, states, and constraints.

  Uninformed search

  BFS, DFS, uniform-cost search (UCS)

  Informed search

  A*, admissibility, consistency

  Constraint satisfaction (CSP)

  Backtracking, forward checking, arc consistency

  Adversarial search

  Minimax, alpha-beta pruning

• Uncertainty & decisions

  Reason under uncertainty and over time.

  Probabilistic models

  Bayesian networks, hidden Markov models

  Probabilistic inference

  Conditional independence, Bayesian inference, sampling

  Decision theory

  Utility, expected utility, decision networks

  Markov decision processes (MDPs)

  Bellman equations, value and policy iteration

• Learning & adaptation

  Learn predictions and policies from experience.

  Reinforcement learning

  Temporal-difference learning, Q-learning

  Supervised learning

  Naive Bayes, perceptron

  Neural networks

  Multi-layer networks for classification

Learn from data, and test what generalizes to new examples.

• Models & patterns

  Build predictors and uncover structure in data.

  Supervised learning

  Naive Bayes, perceptron, logistic regression

  Trees & ensembles

  Decision trees, information gain, random forests, AdaBoost

  Clustering

  K-means, hierarchical clustering

  Dimensionality reduction

  PCA, LDA, t-SNE

• Optimization & evaluation

  Connect training choices to performance on new data.

  Optimization

  Loss functions, gradient descent

  ML pipelines

  Feature engineering; training, validation, and test sets

  Evaluation

  Cross-validation, classification metrics, ROC curves

  Generalization

  Bias-variance trade-off and regularization

• Neural networks

  Learn representations and relationships in data.

  Network foundations

  Layers, activation functions, learned representations

  Backpropagation

  Gradients and parameter updates

  Attention & transformers

  Self-attention, multi-head attention, positional encoding