Quant Memo
Core

Peaks Over Threshold and the Generalized Pareto Distribution

A recipe for modeling extreme losses that throws away everything below some high threshold and fits a specific curve, the Generalized Pareto Distribution, to just the overflow amounts.

Prerequisites: The Hill Estimator for the Tail Index, The Pareto Distribution and Power Laws

To price tail risk you need to know the distribution of losses beyond some painful level — how bad does a loss get, given that it already breached your risk limit? Fitting a single distribution to the whole dataset and reading off the tail wastes the fit's effort modeling the ordinary, boring middle of your data, which you don't care about. Peaks Over Threshold flips this: pick a high bar, keep only the amounts by which losses clear that bar, and fit a distribution to just those overflow amounts. There is a theorem guaranteeing what shape that distribution has to take, almost regardless of what your original data looked like.

An analogy: a dam and the water that spills over

Picture a dam wall at a fixed height. Most days no water reaches the top. On the days it does, what matters is not the water level itself but how much it overflows the wall — an inch, a foot, ten feet. If you record only the overflow amounts on the days there is any, and ignore every day the water stayed below the wall, the shape of those overflow amounts turns out to belong to one specific family of curves almost no matter what the underlying water-level distribution was. That family is the Generalized Pareto Distribution (GPD), and the "wall height" is your threshold.

threshold u excess
Gray points below the threshold are discarded. Only the accent points that exceed it are used, and only the amount by which each one exceeds — the GPD models that excess.

The rule, one symbol at a time

Let uu be the threshold you chose. For any loss XX that exceeds uu, define the excess Y=XuY = X - u — how far past the wall it went. The Pickands–Balkema–de Haan theorem says that, for uu high enough, the distribution of YY is approximately

P(Y>y)=(1+ξyσ)1/ξ,y0,P(Y > y) = \left(1 + \xi \frac{y}{\sigma}\right)^{-1/\xi}, \qquad y \ge 0 ,

read as: "the probability the excess is bigger than yy depends on two knobs, ξ\xi and σ\sigma, through this specific formula, no matter what distribution the original losses came from." Here ξ\xi (xi) is the shape parameter — the same tail-fatness idea as in the Hill estimator, with ξ>0\xi > 0 meaning a fat, Pareto-like tail — and σ\sigma (sigma) is a scale parameter, controlling how large a typical excess is in absolute units. In plain English: once you're past the threshold, the excess amounts follow one of a small, well-understood family of curves, and fitting that curve just means estimating two numbers, ξ\xi and σ\sigma, from your excess data.

Distribution · normal
-2.000.002.00μvalue →
Within ±1σ 68.3%mean μ 0.00std σ 1.00

Slide a threshold uu far into the right tail of a curve like the one above. Whatever shape the full distribution had, the theorem guarantees that just the spillover past uu settles into one predictable two-parameter family — that predictability is what makes the flood-wall analogy work.

Peaks Over Threshold turns "model the whole loss distribution" into "pick a high bar, keep only what spills over, and fit a two-parameter curve to the spillover." The theorem is what guarantees that curve is the GPD.

Worked example 1: fitting by the method of moments

Suppose daily losses exceeding a threshold of $5m (out of a much larger dataset) give five excess amounts, in millions of dollars: 1,3,0.5,2,4.51, 3, 0.5, 2, 4.5. The sample mean excess is yˉ=(1+3+0.5+2+4.5)/5=11/5=2.2\bar{y} = (1+3+0.5+2+4.5)/5 = 11/5 = 2.2, and the sample variance is s2=14(yi2.2)2=14(1.44+0.64+2.89+0.04+5.29)=10.34=2.575s^2 = \frac{1}{4}\sum(y_i - 2.2)^2 = \frac{1}{4}(1.44+0.64+2.89+0.04+5.29) = \frac{10.3}{4} = 2.575 (in squared millions).

Method-of-moments formulas for the GPD give ξ^=12(yˉ2s21)\hat{\xi} = \frac{1}{2}\left(\frac{\bar{y}^2}{s^2} - 1\right) and σ^=yˉ2(yˉ2s2+1)\hat{\sigma} = \frac{\bar{y}}{2}\left(\frac{\bar{y}^2}{s^2}+1\right). Compute yˉ2/s2=4.84/2.575=1.880\bar{y}^2/s^2 = 4.84/2.575 = 1.880. So ξ^=12(1.8801)=0.440\hat{\xi} = \frac{1}{2}(1.880-1) = 0.440, and σ^=2.22(1.880+1)=1.1×2.880=3.168\hat{\sigma} = \frac{2.2}{2}(1.880+1) = 1.1 \times 2.880 = 3.168. A shape of 0.440.44 signals a fairly fat tail — excesses well beyond the threshold are not rare.

Worked example 2: pricing a 1-in-1000-day loss

Using ξ^=0.44\hat{\xi} = 0.44, σ^=3.168\hat{\sigma} = 3.168 from above, and supposing losses exceed the $5m threshold on about 5% of days, find the loss level exceeded once every 1,000 days (probability 0.0010.001). Conditional on exceeding the threshold, we need P(Y>y)=0.001/0.05=0.02P(Y>y) = 0.001/0.05 = 0.02. Solve (1+ξy/σ)1/ξ=0.02\left(1+\xi y/\sigma\right)^{-1/\xi} = 0.02 for yy: raise both sides to the power ξ-\xi: 1+ξy/σ=0.02ξ=0.020.441+\xi y/\sigma = 0.02^{-\xi} = 0.02^{-0.44}. Compute 0.020.44=e0.44ln0.02=e0.44×(3.912)=e1.721=5.590.02^{-0.44} = e^{-0.44 \ln 0.02} = e^{-0.44\times(-3.912)} = e^{1.721} = 5.59. So ξy/σ=4.59\xi y/\sigma = 4.59, giving y=4.59×σ/ξ=4.59×3.168/0.44=33.05y = 4.59 \times \sigma/\xi = 4.59 \times 3.168/0.44 = 33.05 (in millions). The 1-in-1000-day loss is about $5m + $33.05m, roughly $38.05m.

What this means in practice

  • Value-at-risk beyond the data. POT/GPD is the standard tool for extrapolating loss quantiles far beyond anything actually observed, used throughout tail-risk and stress-testing frameworks.
  • Choosing the threshold. Too low a uu and the theorem's approximation hasn't kicked in yet; too high and there's too little excess data to fit two parameters reliably — the same trade-off as choosing kk for the Hill estimator.
  • Complements the Hill estimator. Hill uses a fixed count of top points; POT uses a fixed threshold value. They often give similar shape estimates and are used as a cross-check on each other.

Fitting the GPD to excesses assumes the losses that trigger them are roughly independent events. Financial losses cluster — a bad week in a crisis produces many correlated exceedances — and treating clustered exceedances as independent data points overstates how much genuine information you have, understating the uncertainty in ξ^\hat{\xi} and σ^\hat{\sigma}.

Related concepts

Practice in interviews

Further reading

  • Coles, An Introduction to Statistical Modeling of Extreme Values, ch. 4
  • Embrechts, Klüppelberg & Mikosch, Modelling Extremal Events, ch. 3
ShareTwitterLinkedIn