Live Information Coefficient Monitoring
A signal's backtested information coefficient is a historical average. Watching the live IC day by day, with proper statistical bands, is what tells you the signal is decaying weeks before the P&L makes it obvious.
Prerequisites: Information Coefficient
A cross-sectional equity signal backtests at an average monthly information coefficient of 0.05 — a modest, entirely plausible edge for a mid-frequency signal on 2,000 names. It launches, and for the first four months live IC averages 0.048, indistinguishable from the backtest. Nobody is tracking it with a proper statistical band, just an eyeballed monthly print, so the fifth month's IC of 0.01 reads as "a quiet month," the sixth month's 0.005 reads the same way, and by the time the P&L has clearly turned, the signal has been dead for two months and the desk is only now asking why.
What the information coefficient is, and why it needs a band
The information coefficient is the cross-sectional correlation, each period, between the signal's forecast and the realized forward return:
In words: on any given day or month, how well did the signal's ranking of names line up with what actually happened next. A single period's IC is noisy — even a genuinely good signal bounces between, say, −0.05 and +0.15 month to month purely from cross-sectional noise. What matters for monitoring is not any one period's IC but whether a rolling average has drifted outside the band that noise alone would produce around the signal's known historical mean.
Worked example: setting the control band
Backtested mean monthly IC: 0.05, monthly SD across the backtest 0.09 (typical — cross-sectional ICs are noisy even for real signals). For a rolling 6-month average, SE shrinks by : . Two-SE lower control limit: .
Live rolling 6-month IC: month 4 average 0.048 (fine), month 6 average 0.021 (inside band), month 8 average −0.008 (worth a flag), month 9 average −0.031 (below limit). The check would have flagged this by month 8 or 9, well before an eyeballed monthly print made it obvious around month 11.
Worked example: false alarm from a regime, not decay
A different signal's rolling IC drops from 0.06 to 0.01 over two months, tripping the same rule. Stratified by sector, excluding energy names (which went through a macro-driven repricing that quarter), the remaining universe's rolling IC is still 0.052 — essentially unchanged. The alarm was real in the blended number but attributable to one sector's regime, and the fix is a temporary exclusion, not retiring the signal.
The banding logic above is exactly the reasoning behind the plot's own confidence interval: a rolling mean of noisy monthly draws has a predictable spread under "nothing changed," and a genuine break shows up as an excursion outside that spread — not as any single low reading, which noise alone produces routinely.
Track a rolling-average IC against a statistically derived control band, not a single period's raw print. A signal that's genuinely decaying shows a sustained drift outside the band; ordinary noise shows brief excursions that snap back.
The classic confusion: reacting to a single bad month's IC as if it were decay, or dismissing a real decay because any one month still looks "within normal range." Both errors come from skipping the rolling-average-plus-control-limit step and eyeballing raw monthly numbers instead — and as the sector-regime example shows, a real flag still needs to be decomposed (by sector, by name size, by holding period) before you know whether the fix is retiring the signal or excluding one segment.
What this means in practice
Compute IC every period, maintain a rolling average with a control band derived from the signal's own historical IC volatility, and stratify any flagged drift by sector, size bucket, or region before concluding the signal itself has broken. Pair this with CUSUM Monitoring of Strategy PnL, which catches the same kind of drift from the P&L side and rarely trips at exactly the same moment — agreement between the two is strong evidence, disagreement tells you where to look first.
Related concepts
Practice in interviews
Further reading
- Grinold & Kahn, Active Portfolio Management
- Qian, Hua & Sorensen, Quantitative Equity Portfolio Management