The Supervised Learning Pipeline: From Data to Deployed Model
Three full courses of ML math — linear algebra, calculus, probability — were the foundation. Now the machine learning itself begins. And it begins with the most useful, most-deplo…
Supervised Learning covers: The Supervised Learning Pipeline, Bias, Variance, Overfitting, and the Art of Generalization, Linear and Logistic Regression, Decision Trees and Ensembles, The Rest of the Toolbox, and Honest Evaluation. Year 4, Quarter 14. Includes 14 exercises and 3 projects.
This course unlocks once you've finished its prerequisite. Open prerequisite →
Complete prerequisites first to enroll.
Three full courses of ML math — linear algebra, calculus, probability — were the foundation. Now the machine learning itself begins. And it begins with the most useful, most-deplo…
The last lesson named the central drama of supervised learning — memorizing versus learning, fitting the training data versus generalizing to unseen data. This lesson is the theor…
Now the algorithms — and it's right to start here, with linear regression and logistic regression, because they are the two foundational models that everything else generalizes fr…
Here is the most useful, least-hyped fact in applied machine learning: for the tabular data that most business problems involve, an ensemble of decision trees — gradient boosting,…
Two things remain to complete your classical-ML foundation. First, the rest of the toolbox — three more algorithms, each embodying a distinct and instructive idea about how to lea…
- [ ] Kaggle: Titanic — Survival prediction — Feature engineering (age bins, family size), logistic regression baseline - [ ] Implement linear regression from scratch in Python — …
- [ ] Kaggle: House Prices — Advanced regression — Feature engineering, handle missing values, try Random Forest + XGBoost - [ ] Implement logistic regression from scratch — Sigmo…
- [ ] Implement gradient boosting from scratch in Python — Sequential weak learners, residual fitting, learning rate - [ ] Implement SVM with SMO algorithm in Python — Quadratic p…
- [ ] End-to-end ML pipeline — Pick a Kaggle dataset, full pipeline: EDA, feature engineering, model selection (compare 5+ models), hyperparameter tuning (Optuna), evaluation, wri…
Implement 3 algorithms from scratch in Python (no sklearn for the algorithm, only for data loading/evaluation): linear regression with gradient descent, logistic regression, and d…
Build a Python script that takes any sklearn model and dataset, runs 5-fold cross-validation, computes metrics (accuracy, precision, recall, F1, AUC-ROC), plots learning curves an…
- [ ] Milestone 1: EDA — distributions, correlations, missing values, outliers (matplotlib/seaborn) - [ ] Milestone 2: Feature engineering — encoding, scaling, new features, clust…
- [ ] Explain the bias-variance tradeoff. How does model complexity affect each? - [ ] What is regularization? Explain L1 (Lasso) vs L2 (Ridge) and when to use each. - [ ] Explain…
13 lessons. Read in order; spiral back when you need to. By the end you'll have used the core ideas twice — once on the abstract, once on something you'll meet at work next week.