Quant Memo
Core

Unit Roots and the ADF Test

The random walk and the difference between a stochastic and deterministic trend, the augmented Dickey–Fuller test, its non-standard null distribution, and the spurious-regression trap that manufactures fake relationships between unrelated prices.

Prerequisites: Stationarity, ARMA Models

A unit root is the precise statement of what makes a price series non-stationary: it wanders with no tendency to return, its variance grows without bound, and shocks to it are permanent. Distinguishing a unit-root (random-walk) series from a stationary or trend-stationary one is not academic hair-splitting, it determines whether you difference or detrend, whether a regression between two series is meaningful or nonsense, and whether a "mean-reverting spread" is real. The augmented Dickey–Fuller test is the standard instrument, and the spurious-regression phenomenon is the expensive lesson behind why it matters.

The random walk and the unit root

Consider the AR(1) yt=ρyt1+εty_t = \rho\,y_{t-1} + \varepsilon_t. The reciprocal characteristic root is ρ\rho, and stationarity requires ρ<1|\rho| < 1. The boundary case ρ=1\rho = 1,

yt=yt1+εtΔyt=εt,y_t = y_{t-1} + \varepsilon_t \quad\Longleftrightarrow\quad \Delta y_t = \varepsilon_t,

is the random walk, a unit root. Its properties are qualitatively different from a stationary AR(1):

  • Permanent shocks. Iterating, yt=y0+s=1tεsy_t = y_0 + \sum_{s=1}^t \varepsilon_s: every shock is fully absorbed into the level forever; there is no mean reversion. (A stationary AR(1) decays shocks at rate ρk\rho^k.)
  • Variance grows with time. Var(yt)=tσ2\operatorname{Var}(y_t) = t\sigma^2 \to \infty. The series has no fixed variance to estimate, weak stationarity fails.
  • No unconditional mean to revert to. The best forecast of yt+hy_{t+h} is just yty_t (a martingale), whatever the horizon.

Such a series is integrated of order one, I(1)I(1): its first difference Δyt=εt\Delta y_t = \varepsilon_t is stationary I(0)I(0). This is why prices (I(1)I(1)) are modeled through returns (I(0)I(0)). See Stationarity.

Stochastic versus deterministic trend

Both a random walk with drift, yt=δ+yt1+εty_t = \delta + y_{t-1} + \varepsilon_t, and a trend-stationary process, yt=δt+uty_t = \delta t + u_t with stationary utu_t, look like upward-drifting lines. But they demand opposite remedies:

  • Difference-stationary (unit root): the trend is stochastic; the right transform is differencing. Detrending by regression leaves the series non-stationary.
  • Trend-stationary: the trend is deterministic; the right transform is regressing out the trend. Differencing over-differences it, inducing a non-invertible MA unit root.

Choosing wrong leaves non-stationarity in or destroys real structure, which is exactly what a unit-root test is for.

The Dickey–Fuller test

Test H0:ρ=1H_0: \rho = 1 (unit root) against H1:ρ<1H_1: |\rho| < 1 (stationary). Rewrite the AR(1) by subtracting yt1y_{t-1}:

Δyt=(ρ1)yt1+εt=γyt1+εt,\Delta y_t = (\rho - 1)\,y_{t-1} + \varepsilon_t = \gamma\,y_{t-1} + \varepsilon_t,

so the unit-root null becomes H0:γ=0H_0: \gamma = 0 against H1:γ<0H_1: \gamma < 0. You run this regression and look at the tt-statistic on γ\gamma. The crucial subtlety: under the null the regressor yt1y_{t-1} is itself non-stationary, so the tt-statistic does not follow a Student-tt or normal distribution. Its distribution is non-standard (a functional of Brownian motion), so you must compare against the special Dickey–Fuller critical values, which are more negative than the usual ones (about 2.86-2.86 at 5% with a constant, versus 1.65-1.65). Using the normal table here is a classic error that massively over-rejects. The augmented Dickey–Fuller (ADF) test adds lagged differences iδiΔyti\sum_i \delta_i \Delta y_{t-i} to soak up serial correlation in εt\varepsilon_t so the residuals are white:

Δyt=α+βt+γyt1+i=1kδiΔyti+εt.\Delta y_t = \alpha + \beta t + \gamma\,y_{t-1} + \sum_{i=1}^k \delta_i\,\Delta y_{t-i} + \varepsilon_t.

You choose whether to include the constant α\alpha and trend βt\beta t based on the series; the critical values differ for each specification. The KPSS test flips the null (stationary under H0H_0) and is often reported alongside ADF for a confirmatory cross-check, since ADF has notoriously low power.

The spurious-regression trap

This is why unit roots matter to a trader. Granger and Newbold showed that regressing one independent random walk on another unrelated random walk produces, with high probability, a large R2R^2 and a hugely significant tt-statistic on the slope, a completely fake relationship. Two series that share nothing but a stochastic trend will look strongly "related" because both wander persistently. The tell is a very low Durbin–Watson (strongly autocorrelated residuals) alongside the high R2R^2. Regressing price levels on price levels is exactly this trap: correlations of levels are near-meaningless. The disciplines that avoid it: regress returns (differenced, I(0)I(0) series) on returns, or, when the levels genuinely move together, test for Cointegration, the one legitimate way to regress I(1)I(1) on I(1)I(1).

Worked example

Take two independent simulated random walks xt,ytx_t, y_t (no relationship whatsoever). Regress yty_t on xtx_t in levels: you routinely get R2>0.5R^2 > 0.5 and t>4|t| > 4 on the slope, spuriously "significant." Now first-difference both and regress Δyt\Delta y_t on Δxt\Delta x_t: the slope is insignificant and R20R^2 \approx 0, correctly revealing no relationship. Same data, opposite conclusions, the levels regression was reading shared wandering as association. Running ADF on each level fails to reject the unit root (as it should), warning you not to regress the levels in the first place.

Failure modes in financial data

  • Low power. ADF struggles to distinguish a true unit root from a stationary process with ρ\rho close to 1 (e.g. ρ=0.98\rho = 0.98), exactly the persistent-but-mean-reverting case a pairs trader cares about. Short samples make this worse; pair ADF with KPSS and economic judgment.
  • Structural breaks masquerade as unit roots. A stationary series with a level shift is often mistaken by ADF for I(1)I(1); break-robust tests (Zivot–Andrews) are needed.
  • Over-differencing. Differencing a trend-stationary or already-stationary series introduces a non-invertible MA and inflates variance, the mirror-image mistake.
  • Fat tails and volatility clustering distort the finite-sample null distribution of the ADF statistic; the tabulated critical values assume homoskedastic Gaussian errors.

In interviews

Define a unit root via ρ=1\rho = 1 in an AR(1) and list the three consequences, permanent shocks, variance growing as tσ2t\sigma^2, and the martingale forecast y^t+h=yt\hat y_{t+h} = y_t. Set up the ADF regression as Δyt=γyt1+\Delta y_t = \gamma y_{t-1} + \dots testing γ=0\gamma = 0, and, the point that separates the prepared candidate, stress that the test statistic has a non-standard (Dickey–Fuller) distribution, not Student-tt, because yt1y_{t-1} is non-stationary under the null, so you must use special critical values. Explain the difference-stationary vs trend-stationary remedies (difference vs detrend). The spurious-regression story is the applied payoff: regressing I(1)I(1) on I(1)I(1) manufactures fake significance, which is why we model returns and test for cointegration before ever regressing price levels.

Related concepts

Practice in interviews

Further reading

  • Dickey & Fuller (1979), Distribution of the Estimators for Autoregressive Time Series with a Unit Root
  • Hamilton, Time Series Analysis (Ch. 15–17)
  • Granger & Newbold (1974), Spurious Regressions in Econometrics
ShareTwitterLinkedIn