Vectors, Matrices, and the Geometry of Data
You are beginning the math that powers machine learning, and here is the single most liberating fact to carry into it: linear algebra is the most visual branch of mathematics — ev…
Linear Algebra covers: Vectors, Matrices, and the Geometry of Data, Vector Spaces, Solving and Inverting, Eigenvalues, Eigenvectors, and Diagonalization, SVD and PCA. Year 4, Quarter 13. Includes 13 exercises and 3 projects.
This course unlocks once you've finished its prerequisite. Open prerequisite →
You are beginning the math that powers machine learning, and here is the single most liberating fact to carry into it: linear algebra is the most visual branch of mathematics — ev…
The previous lesson said data lives in a vector space; this lesson asks the natural next question — what is the structure of that space, and what does its structure tell you about…
At the computational heart of an enormous amount of science, engineering, and machine learning is one deceptively simple question: given a matrix A and a vector b, find the vector…
Eigenvalues and eigenvectors have a reputation for being the intimidating, abstract peak of a linear algebra course — the formula Av = λv looks like a wall. But the idea is one of…
This is the lesson everything in the course has been building toward — where the abstract machinery (vectors, spaces, rank, eigenvalues) resolves into two of the most powerful and…
- [ ] Compute dot product, cross product of 3D vectors by hand — 5 exercises — MML Ch2 - [ ] Solve a 3x3 system of equations using Gaussian elimination — Row echelon form — MML Ch…
- [ ] Find eigenvalues and eigenvectors of a 3x3 matrix — Characteristic polynomial — MML Ch4 - [ ] Implement PCA from scratch in Python — Center data, compute covariance, eigende…
- [ ] Implement image compression using SVD in Python — Keep top-k singular values, compare quality vs compression - [ ] Prove that rank(A) = rank(A^T) = rank(A^T A) — Linear alge…
- [ ] Build a face recognition system using PCA (Eigenfaces) in Python — Load face images, compute eigenfaces, project new faces, find nearest match using Euclidean distance in ei…
Implement Vector and Matrix classes from scratch (no NumPy for the core). Support: addition, scalar multiplication, dot product, matrix multiplication, transpose, determinant, inv…
Implement PCA from scratch using your linear algebra library (or NumPy). Load images, reshape to data matrix, compute covariance, eigendecompose, project to top-k components, reco…
- [ ] Milestone 1: Matrix operations — matmul, transpose, element-wise ops (linear algebra) - [ ] Milestone 2: Forward pass — layers, activations (ReLU, sigmoid, softmax) - [ ] Mi…
- [ ] What is a vector space? What are the requirements for a set to be a vector space? - [ ] What are eigenvalues and eigenvectors? What do they tell you about a matrix? - [ ] Wh…
13 lessons. Read in order; spiral back when you need to. By the end you'll have used the core ideas twice — once on the abstract, once on something you'll meet at work next week.