distill

Courses

From Kevin Bacon to Billion-Scale Vector Search: Building ANN Indices from Scratch

A hands-on systems engineering course that builds a working vector search engine piece by piece. Starting from brute-force search and the curse of dimensionality, you'll implement greedy graph trav…

6 modules · 21 exercises

Self-Compressing Neural Networks: Learning to Quantize from Scratch

Reproduce the Self-Compressing Neural Networks paper (arXiv 2301.13142) from scratch using PyTorch. Build a neural network that learns its own compression during training by making quantization bit…

5 modules · 16 exercises