The Pareto Distribution and Power Laws
The distribution behind "the top 1% own most of it" — a heavy-tailed shape where extreme outcomes aren't rare exceptions to the pattern, they're a predictable part of it, governed by a single tail-thickness parameter.
Prerequisites: Expectation, Variance & Moments
City sizes, trading volume across stocks, wealth, and the size of insurance claims all share an odd feature: a small number of instances are enormously larger than the typical one, and this isn't a fluke — it's the reliable pattern. A normal distribution would predict those giants essentially never happen. The Pareto distribution is built specifically to describe data where a few extreme values dominate the total, and to make precise exactly how likely those giants are.
The analogy: the 80/20 rule, made exact
"20% of clients generate 80% of trading volume" is the informal version of a Pareto pattern. The Pareto distribution turns that folk rule into a formula: instead of most values clustering near an average, values are spread across scales — some near the minimum, progressively fewer as you go up, but the "progressively fewer" happens slowly enough that genuinely enormous values keep showing up far more often than a bell curve would ever allow. One parameter, the tail index, controls exactly how slowly that thinning-out happens — and how heavy the consequences are.
Writing it down
The Pareto distribution with minimum value and tail index has survival function (probability of exceeding ):
In words: the chance of seeing a value bigger than shrinks as a power of , not an exponential of — this is the defining feature of a "fat tail," and it's why extreme values stay far more plausible, far further out, than under a normal or exponential model. The mean exists only if : . The variance exists only if . For , variance is infinite; for , even the mean is infinite — a direct generalization of the Cauchy distribution's broken-mean behavior, with as the dial controlling exactly how broken it gets.
Set a low (negative, since this is a decay) exponent and watch the curve fall off slowly, staying meaningfully above zero far to the right — that's the visual signature of a small : a heavy tail where big values remain plausible long after a normal distribution would have written them off entirely.
Worked example 1: insurance claim sizes
Claims above a $1,000 deductible follow . What's the probability a claim exceeds $10,000? — about 1 in 316 claims. Mean claim size: \frac{2.5 \times 1000}{1.5} \approx \1{,}667\alpha=1.5P(X>10{,}000) = (0.1)^{1.5} \approx 0.0316\frac{1.5\times1000}{0.5}=$3{,}000\alpha$ changed both the typical claim size and the frequency of catastrophic ones dramatically.
Worked example 2: does trading volume across stocks fit a power law?
Suppose daily dollar volume across 500 stocks has a minimum (screened) value of x_m = \1\text{m}\hat\alpha = 1.2\hat\alpha = n / \sum \ln(x_i/x_m)\hat\alpha < 2\hat\alpha$ is barely above 1, even the mean daily volume is barely well-defined — a single mega-cap name's flow can distort a "total market volume" statistic in a way that never averages out, matching the well-known empirical fact that trading volume is dominated by a handful of names.
Hold this thin-tailed curve in mind as the baseline, then compare it against the power-law shape above: a normal distribution's tail is essentially zero past 4 or 5 standard deviations, while a Pareto tail with a small stays meaningfully above zero for values dozens of "typical" widths away — the entire practical difference between "extreme events don't happen" and "extreme events are a routine part of the pattern."
What this means in practice
- Position sizing and concentration risk. If a book's P&L or a market's volume genuinely follows a power law with near or below 2, standard deviation is a misleading risk measure — it may not even be estimating anything finite.
- Tail index estimation matters more than the mean. For fat-tailed data, the single most important number to estimate accurately is — it directly answers "how much worse can the worst case realistically be," which the sample mean cannot.
- Related everywhere fat tails appear. City populations, word frequencies, insurance losses, and crash magnitudes are classic empirical Pareto-like fits — always sanity check the tail index rather than assuming a normal or lognormal shape by default.
A Pareto distribution's survival probability decays as a power of rather than exponentially, controlled by the tail index — small means both the mean and variance can be formally infinite, and extreme outcomes remain far more plausible than intuition (or a normal model) would suggest.
Fitting a Pareto tail index using ordinary least squares on a log-log plot is a well-known bad habit — it's biased and gives misleadingly tight-looking fits even on data that isn't really power-law distributed. Use maximum likelihood estimation for (or a formal statistical test like Clauset-Shalizi-Newman) instead of eyeballing a straight line on log-log axes.
Related concepts
Practice in interviews
Further reading
- Taleb, Statistical Consequences of Fat Tails (ch. 3)
- Clauset, Shalizi, Newman, Power-Law Distributions in Empirical Data (2009)