The Heckman Selection Correction
A two-step fix for regressions run on data that's only observed for a non-random subset of cases — it models the selection process itself, then adds a correction term to the main regression so the missing, unselected cases stop biasing the result.
Prerequisites: Probit Versus Logit Models, Ordinary Least Squares (OLS)
Suppose you want to know what drives hedge fund returns, and you regress return on fund characteristics using historical data. There's a hidden problem: funds that performed badly tend to shut down and stop reporting, so your dataset only contains the funds that survived. Regressing on this survivor-only sample doesn't estimate "what drives returns" — it estimates "what drives returns, conditional on having survived," which is a systematically different and more flattering question. The Heckman correction is the standard tool for fixing a regression when the sample you observe was filtered by a process related to the very outcome you're studying.
An analogy: judging restaurants only from happy reviewers
Imagine trying to learn what makes a restaurant good using only its posted reviews. People who had a mediocre-but-not-terrible meal often don't bother reviewing at all; the ones who show up are disproportionately either delighted or furious. If you regress "review score" on "food quality" using only these self-selected reviewers, you'll get a distorted picture, because who chose to leave a review is itself correlated with how the meal actually went. The Heckman correction works by first modeling who chooses to review (or here, which funds survive) as its own equation, and then explicitly accounting for that selection when estimating the main relationship you actually care about.
The method, one piece at a time
The Heckman correction runs in two stages. Stage one is a probit model of whether an observation is selected into the sample at all — for funds, whether they survive to be observed:
where is a variable that predicts selection (survival) and is the normal CDF, as in probit regression (see Probit Versus Logit Models). From this fitted probit, you compute for each selected observation the inverse Mills ratio, , where is the normal density — a number that measures how "surprising" it is that this particular observation was selected, given its characteristics.
Stage two adds as an extra regressor in the main equation:
In plain English: rather than just regressing return on fund characteristics using only the survivors, you also control for how unusual each survivor's survival was — funds that "shouldn't" have survived (had a high predicted probability of shutting down but didn't) get a different correction than funds that were always likely to survive. If the coefficient on is significantly different from zero, selection bias was present and the correction meaningfully changes ; if it's near zero, selection wasn't distorting the naive estimate much after all.
Worked example 1: fund survivorship, by the numbers
A naive regression of fund returns on manager tenure, using only surviving funds, gives (each extra year of tenure predicts 0.15 percentage points more return). The first-stage probit shows that funds with low past volatility and high past returns were far more likely to survive; among the surviving sample, the average inverse Mills ratio is 0.6, and the second-stage regression's coefficient on comes out at and is highly significant. The corrected estimate of drops to 0.04 — most of the naive 0.15 was actually the shutdown filter favoring longer-tenured managers who happened to have gotten lucky, not tenure itself driving returns.
Worked example 2: when correction changes little
A separate study looks at what predicts an IPO's first-day return, using only IPOs that actually priced and listed (some deals are withdrawn beforehand). The first-stage probit for "deal completes" finds that completion is driven almost entirely by market-wide conditions (VIX level at filing), not by the deal's own expected first-day return. The resulting inverse Mills ratio has a coefficient of in the second stage, with a standard error of 0.4 — not statistically distinguishable from zero. Here the naive OLS estimate and the Heckman-corrected estimate come out nearly identical, correctly signaling that selection into the completed-IPO sample wasn't meaningfully related to the outcome being studied.
What this means in practice
The Heckman correction belongs in any study built on data that survived a filter correlated with the outcome: hedge fund and mutual fund databases (survivorship), analyst coverage (analysts only cover firms worth covering), loan performance (only approved loans are observed), or executive compensation (only completed deals report terms). Skipping it doesn't just add noise — it produces a systematically biased coefficient that looks statistically solid.
When a sample is filtered by a process related to the outcome being studied, regressing on the observed subsample alone gives a biased answer; the Heckman correction models the selection process explicitly and folds an inverse-Mills-ratio correction term into the main regression to remove that bias.
The Heckman correction needs a variable that predicts selection but doesn't directly belong in the main outcome equation — without at least one such "exclusion restriction," the two stages are separated mainly by the assumed functional form of , and the correction can become fragile or nearly collinear with the other regressors, producing unstable estimates that look precise but aren't. A significant coefficient on the inverse Mills ratio should also not be over-interpreted as proof the selection story is correctly specified — it only shows some selection-related bias was present, not that the chosen selection model is the right one.
Related concepts
Practice in interviews
Further reading
- Heckman, Sample Selection Bias as a Specification Error, Econometrica 1979