Markov and Chebyshev Inequalities
Two distribution-free tail bounds. Markov bounds a positive quantity using only its mean; Chebyshev bounds how far a quantity strays from its mean using only its variance. Loose, but they hold for any distribution.
Prerequisites: Expected Value, Expectation, Variance & Moments
Most tail calculations assume you know the whole distribution — you say "returns are normal" and read off a probability. But what if you know almost nothing? What if you have only the mean, or only the mean and the variance, and no idea of the shape? The Markov and Chebyshev inequalities answer exactly this. They give you a hard ceiling on how much probability can hide in the tail, using nothing but a moment or two. The price of assuming so little is that the bounds are loose — but they are true for every distribution, including the fat-tailed ones that break tidier models.
Markov: a mean is enough to bound a tail
If a random quantity is never negative and has mean , then for any level ,
Here is the chance of landing at or above , and is the average. The intuition is a budget argument: the average is a fixed pot of "size." If too much probability piled up at large values, the average would have to be bigger than it is. So a large tail is capped by how much mean you have to spend. If daily trade volume averages lots, then at most of days can see lots or more — you needn't know anything else about the distribution.
Chebyshev: add a variance, bound the spread
Markov only sees one side and needs non-negativity. Apply it to the squared distance from the mean and you get something far more useful. With mean and standard deviation , for any ,
In words: the chance of landing more than standard deviations from the mean is at most , no matter the distribution. Beyond two sigma, at most a quarter of the probability; beyond three sigma, at most a ninth; beyond ten sigma, at most one in a hundred. It's a universal speed limit on how often a variable can stray far from its center.
Markov: for , . Chebyshev: . The first needs only a mean, the second only a variance — and both hold for every distribution.
How loose is it? Chebyshev vs. the normal
The bound is universal precisely because it must cover the worst-behaved distribution, so for a well-behaved one it is far from tight. Compare Chebyshev's ceiling to what the normal actually delivers:
| Distance from mean | Chebyshev ceiling | Actual for a normal |
|---|---|---|
| beyond | about | |
| beyond | about | |
| beyond | about | |
| beyond | about |
The gap is enormous — Chebyshev allows an three-sigma tail where a normal has a one. That is not a flaw; it's the point. The normal earns its tiny tail by assuming a specific thin-tailed shape. Chebyshev makes no such assumption, so it must leave room for the ugliest distribution consistent with that variance.
Worked example: bounding a bad day
A trading desk's daily P&L has mean and a standard deviation of $10,000, but you refuse to assume the shape is normal — you've seen the fat tails. What can you say about the chance of a loss worse than $30,000?
That threshold is standard deviations out. Chebyshev caps both tails combined at . Since a loss is only the lower tail, a common refinement (the one-sided Cantelli inequality) tightens the single-tail bound to . Either way, you can promise a rigorous ceiling — "no worse than about one such day in nine or ten" — without ever naming the distribution. A normal would claim one in seven hundred, but you don't trust that, and Chebyshev lets you stay honest.
When you distrust the distribution's shape — exactly when tails are fat — Chebyshev is your friend. It needs only the mean and variance and delivers a bound that cannot be broken, however wild the tails turn out to be.
These are ceilings, not estimates. Never quote the Chebyshev bound as an actual probability — for most real data it wildly overstates the true tail. Use it to certify "no worse than," not to predict "about this often."
Where it leads
Chebyshev is the engine behind the The Law of Large Numbers: as you average more independent draws, the variance of the average shrinks like , so Chebyshev forces the probability of straying from the true mean to zero. It also sits opposite Jensen's Inequality in the toolkit of moment-based reasoning — one bounds tails from a variance, the other bounds averages through curvature.
Related concepts
Practice in interviews
Further reading
- Blitzstein & Hwang, Introduction to Probability, ch. 10
- Wasserman, All of Statistics, ch. 4