Quant Memo
Advanced

Stein's Lemma

A shortcut that turns the covariance between a normal variable and a function of it into an expectation of the function's slope — the identity quietly underneath CAPM's beta and many option-Greek relationships.

Suppose XX is normally distributed and gg is some reasonably smooth function of XX — a payoff, a portfolio weight rule, anything. You often want Cov(X,g(X))\text{Cov}(X, g(X)), and computing it directly means grinding through an integral against the normal density every time. Stein's Lemma skips that grind: if XN(μ,σ2)X \sim N(\mu, \sigma^2), then

Cov(X,g(X))=σ2E[g(X)].\text{Cov}(X, g(X)) = \sigma^2 \, E[g'(X)] .

In plain English: the covariance between a normal variable and any smooth function of it equals the variance of the variable times the average slope of the function. A steeper function on average produces a bigger covariance; a flat function produces none, no matter how wild XX is.

Analogy. Think of XX as a lever position and g(X)g(X) as a dial reading tied to that lever. How much the dial reading moves together with the lever depends only on how steeply the dial is geared at each position, averaged over where the lever tends to sit — not on the dial's shape in any more complicated sense.

Worked example

Let XX be a stock's log-return, XN(0,σ2)X \sim N(0, \sigma^2) with σ2=0.04\sigma^2 = 0.04, and let g(X)=X2g(X) = X^2 (a proxy for realized variance exposure). Then g(X)=2Xg'(X) = 2X, so E[g(X)]=2E[X]=0E[g'(X)] = 2E[X] = 0, giving Cov(X,X2)=0\text{Cov}(X, X^2) = 0. That matches intuition: a symmetric normal variable's sign carries no information about the magnitude of its square. Swap in g(X)=eXg(X) = e^X (a simple payoff), and g(X)=eXg'(X) = e^X, so Cov(X,eX)=σ2E[eX]=σ2eσ2/2\text{Cov}(X, e^X) = \sigma^2 E[e^X] = \sigma^2 e^{\sigma^2/2} — a closed form with no direct integration needed.

Where it shows up

Stein's Lemma is the quiet reason CAPM's beta, β=Cov(Ri,Rm)/Var(Rm)\beta = \text{Cov}(R_i, R_m)/\text{Var}(R_m), has a clean interpretation when returns are normal: it reduces beta to an average sensitivity of the asset's payoff to the market, rather than a raw covariance number. The same identity underlies several option-Greek relationships, since it turns covariances involving a normal underlying into expectations of derivatives.

For XN(μ,σ2)X \sim N(\mu, \sigma^2) and smooth gg, Cov(X,g(X))=σ2E[g(X)]\text{Cov}(X, g(X)) = \sigma^2 E[g'(X)] — covariance with a function of a normal variable reduces to variance times the function's average slope, replacing an integral with a derivative.

Practice in interviews

Further reading

  • Stein, Estimation of the Mean of a Multivariate Normal Distribution
ShareTwitterLinkedIn