NBML Course

Noisebridge Machine Learning Course

We're trying to come up with a hands-on curriculum for teaching Machine Learning at Noisebridge. Please help out in any way you can, such as:

1. Volunteer to teach a course in one of the subjects below
2. Fill in one of the subjects below with links to learning material and related software
3. Show up to classes and asking questions
4. Join the ML Mailing List and talk about stuff
5. Don't talk shit on mathematics, it wants to be your friend.

Online Machine Learning Courses

• Stanford CS229
• MIT OCW 6.867

Curriculum

Block 1: Basic Math and Machine Learning

• Linear Algebra
  • Vectors and Matricies
  • Solving Linear Systems: Gaussian Elimination
  • Vector Spaces
  • Eigenvectors and Eigenvalues
  • Quadratic Forms
• Calculus
  • Derivatives, Gradients, and Hessians
  • Integration
• Probability Theory
  • Distribution and Density Functions
    • Discrete Distributions
    • Continuous Distributions
  • Random Variables and Vectors
  • Expectation
  • Variance and Covariance
  • Correlation Functions
  • Law of Large Numbers
  • Information Theory
    • Entropy
    • Mutual Information
• Machine Learning
  • The data
  • The model
  • Unsupervised vs. Supervised Learning
  • Training a Model
    • Maximum Likelihood
    • Optimization
      • Gradient Descent
      • Lagrange Optimization
      • Expectation Maxmimization
    • Overfitting and Regularization
    • Bias-Variance Tradeoff

Block 2: Linear Regression

• Linear Regression
  • Least Squares Formulation
  • Maximum-likelihood Formulation
  • Regularization
    • Ridge Regression (L2)
    • Lasso Regression (L1)
    • Least-angle/Elastic Net Regression
  • Bayesian Linear Regression

Block 3: Linear Classification (non-SVM)

• Linear Classification
  • Binary vs. Multi-class
    • One-versus-the-rest, one-versus-one
  • Discriminant Functions