Qm

Topic · Machine Learning & AI

← All topics

Unsupervised Learning

27 articles · 4 checkpoints · 15 deeper reads · 8 reference notes

A standalone topic: it is on no roadmap, so read it on its own terms.

Every article, in reading order

plant a flag as you finish each

Read these first

  1. A Gaussian mixture describes data as several bell curves blended together, each with its own centre, width and share of the population. Instead of a hard label it gives every point a probability of belonging to each group.

  2. Start with every point as its own cluster, repeatedly glue the two closest together, and record the whole history as a tree. You get every possible number of clusters at once and choose the granularity afterwards by cutting the tree.

  3. The default way to split unlabelled data into k groups, guess k centres, assign every point to its nearest, move each centre to the middle of what it caught, repeat. Fast and useful, but it needs you to pick k and it can land in the wrong answer.

  4. EM solves the chicken-and-egg problem of fitting a model when some labels are missing: guess the labels from the parameters, refit the parameters from the guessed labels, repeat. Each round provably never makes the fit worse.

Then the rest

Reference notes8 short entries