Topic · Machine Learning & AI
← All topicsUnsupervised Learning
27 articles · 4 checkpoints · 15 deeper reads · 8 reference notes
A standalone topic: it is on no roadmap, so read it on its own terms.
Every article, in reading order
plant a flag as you finish eachRead these first
A Gaussian mixture describes data as several bell curves blended together, each with its own centre, width and share of the population. Instead of a hard label it gives every point a probability of belonging to each group.
Start with every point as its own cluster, repeatedly glue the two closest together, and record the whole history as a tree. You get every possible number of clusters at once and choose the granularity afterwards by cutting the tree.
The default way to split unlabelled data into k groups, guess k centres, assign every point to its nearest, move each centre to the middle of what it caught, repeat. Fast and useful, but it needs you to pick k and it can land in the wrong answer.
EM solves the chicken-and-egg problem of fitting a model when some labels are missing: guess the labels from the parameters, refit the parameters from the guessed labels, repeat. Each round provably never makes the fit worse.
Then the rest