Noncentrality Parameters and Power Curves
When the null hypothesis is false, a test statistic doesn't just shift a little — it follows a whole different, "noncentral" version of its usual distribution, and the size of that shift is what a power curve traces out.
Prerequisites: Hypothesis Testing, Statistical Power and Sample Size
A t-statistic under the null hypothesis follows the ordinary, symmetric t-distribution centered on zero. But if the true effect isn't zero, the same statistic still follows a t-shaped curve — just shifted away from zero and slightly reshaped. That shifted curve is a noncentral distribution, and the amount of shift is the noncentrality parameter, usually written or .
The noncentrality parameter measures how far the true effect sits from the null in standardized units. Bigger effect, more data, or less noise all raise it — and a power curve is just the probability of rejecting the null, plotted as that parameter climbs.
For a one-sample t-test, the noncentrality parameter is — the true gap from the null, measured in standard errors. Notice this is exactly the t-statistic you'd expect to see on average if the alternative is true. When , the noncentral t-distribution collapses back to the ordinary central one, which is why the null case is really just the special case .
Worked example. A strategy's true daily edge is 0.05% with a daily return standard deviation of 1%, and a backtest covers 400 days. The standard error is , so . A noncentrality of 1.0 is modest — plugging it into the noncentral t-distribution with the test's critical value shows power around 30–40% at the usual 5% significance level, meaning a real, tradeable edge this small would still be missed by the test more often than not.
Power curves plot exactly this: power on the y-axis against noncentrality (or equivalently, sample size, since sits inside ) on the x-axis. They flatten out near 100% once the noncentrality parameter is large enough that overlap between the null and alternative distributions is negligible, which is the visual explanation for why power analysis asks "how big a sample before this curve gets steep enough."
Related concepts
Practice in interviews
Further reading
- Cohen, Statistical Power Analysis for the Behavioral Sciences (ch. 2)