Quant Memo
Core

Markov and Chebyshev Inequalities

Two distribution-free tail bounds. Markov bounds a positive quantity using only its mean; Chebyshev bounds how far a quantity strays from its mean using only its variance. Loose, but they hold for any distribution.

Prerequisites: Expected Value, Expectation, Variance & Moments

Most tail calculations assume you know the whole distribution — you say "returns are normal" and read off a probability. But what if you know almost nothing? What if you have only the mean, or only the mean and the variance, and no idea of the shape? The Markov and Chebyshev inequalities answer exactly this. They give you a hard ceiling on how much probability can hide in the tail, using nothing but a moment or two. The price of assuming so little is that the bounds are loose — but they are true for every distribution, including the fat-tailed ones that break tidier models.

Markov: a mean is enough to bound a tail

If a random quantity XX is never negative and has mean E[X]E[X], then for any level a>0a > 0,

P(Xa)E[X]a.P(X \ge a) \le \frac{E[X]}{a} .

Here P(Xa)P(X \ge a) is the chance of landing at or above aa, and E[X]E[X] is the average. The intuition is a budget argument: the average is a fixed pot of "size." If too much probability piled up at large values, the average would have to be bigger than it is. So a large tail is capped by how much mean you have to spend. If daily trade volume averages 1,0001{,}000 lots, then at most 10005000=20%\tfrac{1000}{5000} = 20\% of days can see 5,0005{,}000 lots or more — you needn't know anything else about the distribution.

Chebyshev: add a variance, bound the spread

Markov only sees one side and needs non-negativity. Apply it to the squared distance from the mean and you get something far more useful. With mean μ\mu and standard deviation σ\sigma, for any k>0k > 0,

P(Xμkσ)1k2.P\bigl(|X - \mu| \ge k\sigma\bigr) \le \frac{1}{k^2} .

In words: the chance of landing more than kk standard deviations from the mean is at most 1/k21/k^2, no matter the distribution. Beyond two sigma, at most a quarter of the probability; beyond three sigma, at most a ninth; beyond ten sigma, at most one in a hundred. It's a universal speed limit on how often a variable can stray far from its center.

Markov: for X0X \ge 0, P(Xa)E[X]/aP(X \ge a) \le E[X]/a. Chebyshev: P(Xμkσ)1/k2P(|X-\mu| \ge k\sigma) \le 1/k^2. The first needs only a mean, the second only a variance — and both hold for every distribution.

How loose is it? Chebyshev vs. the normal

The bound is universal precisely because it must cover the worst-behaved distribution, so for a well-behaved one it is far from tight. Compare Chebyshev's ceiling to what the normal actually delivers:

Distance from meanChebyshev ceilingActual for a normal
beyond 1σ1\sigma100%\le 100\%about 32%32\%
beyond 2σ2\sigma25%\le 25\%about 4.6%4.6\%
beyond 3σ3\sigma11.1%\le 11.1\%about 0.27%0.27\%
beyond 4σ4\sigma6.25%\le 6.25\%about 0.006%0.006\%

The gap is enormous — Chebyshev allows an 11%11\% three-sigma tail where a normal has a 0.3%0.3\% one. That is not a flaw; it's the point. The normal earns its tiny tail by assuming a specific thin-tailed shape. Chebyshev makes no such assumption, so it must leave room for the ugliest distribution consistent with that variance.

Worked example: bounding a bad day

A trading desk's daily P&L has mean 00 and a standard deviation σ\sigma of $10,000, but you refuse to assume the shape is normal — you've seen the fat tails. What can you say about the chance of a loss worse than $30,000?

That threshold is k=3k = 3 standard deviations out. Chebyshev caps both tails combined at 132=1911.1%\tfrac{1}{3^2} = \tfrac{1}{9} \approx 11.1\%. Since a loss is only the lower tail, a common refinement (the one-sided Cantelli inequality) tightens the single-tail bound to 11+k2=110=10%\tfrac{1}{1+k^2} = \tfrac{1}{10} = 10\%. Either way, you can promise a rigorous ceiling — "no worse than about one such day in nine or ten" — without ever naming the distribution. A normal would claim one in seven hundred, but you don't trust that, and Chebyshev lets you stay honest.

When you distrust the distribution's shape — exactly when tails are fat — Chebyshev is your friend. It needs only the mean and variance and delivers a bound that cannot be broken, however wild the tails turn out to be.

These are ceilings, not estimates. Never quote the Chebyshev bound as an actual probability — for most real data it wildly overstates the true tail. Use it to certify "no worse than," not to predict "about this often."

Where it leads

Chebyshev is the engine behind the The Law of Large Numbers: as you average more independent draws, the variance of the average shrinks like 1/n1/n, so Chebyshev forces the probability of straying from the true mean to zero. It also sits opposite Jensen's Inequality in the toolkit of moment-based reasoning — one bounds tails from a variance, the other bounds averages through curvature.

Related concepts

Practice in interviews

Further reading

  • Blitzstein & Hwang, Introduction to Probability, ch. 10
  • Wasserman, All of Statistics, ch. 4
ShareTwitterLinkedIn