The Deflated Sharpe Ratio
Bailey & López de Prado's correction that adjusts an observed Sharpe ratio for the number of trials, non-normal returns, and sample length, deflating it against the expected maximum Sharpe achievable by luck alone.
Prerequisites: Sharpe Ratio, Data-Snooping Bias, p-values and Multiple Testing
The Deflated Sharpe Ratio (DSR) answers the question every impressive backtest raises: is this Sharpe ratio real, or is it the luckiest of many tries? An observed Sharpe of 2 means one thing if it is the only strategy you ever tested and something entirely different if it is the best of a thousand. Bailey & López de Prado's DSR is a single number, a probability, that corrects the observed Sharpe for three things ordinary Sharpe ignores: the number of trials, the non-normality (skew and kurtosis) of the returns, and the length of the track record. It is the rigorous form of the intuition behind Data-Snooping Bias.
Step 1: the Probabilistic Sharpe Ratio
Start with the sampling uncertainty of the Sharpe estimate itself. The estimated (per-observation) Sharpe has, for possibly non-normal returns, an asymptotic standard error
where is the number of return observations, is the skewness of returns, and is the kurtosis (not excess; for a normal). Negative skew and fat tails, the norm for real strategies, raise the standard error, making a given Sharpe less trustworthy. The Probabilistic Sharpe Ratio is the probability that the true Sharpe exceeds a benchmark :
with the standard-normal CDF. PSR tells you how confident to be that the Sharpe clears a fixed bar, correcting for track-record length and non-normality.
Step 2: the benchmark that accounts for selection
The DSR's key move is to set the benchmark not to zero but to the expected maximum Sharpe under the null that no strategy has skill, given that you tried of them. Across trials with per-trial Sharpe variance , extreme-value theory (the maximum of Gaussians follows a Gumbel law) gives the expected maximum:
where is the Euler–Mascheroni constant and is the inverse standard-normal CDF. The bracket is the expected maximum of standard normals; multiplying by the cross-trial Sharpe standard deviation scales it to your actual dispersion of results. This benchmark rises with : the more variants you tried, the higher a Sharpe you should expect from luck alone, and the higher the bar your winner must clear.
Step 3: deflate
The Deflated Sharpe Ratio is just the PSR evaluated at this selection-aware benchmark:
Read it as the probability that the strategy's true Sharpe is positive after accounting for the number of trials, the non-normality of returns, and the sample length. A DSR near 1 is evidence of genuine skill; a DSR near 0.5 or below means the observed Sharpe is indistinguishable from the best of lucky draws. A conventional acceptance threshold is .
Worked example
A backtest reports a per-annum Sharpe of over daily observations (≈5 years), with mild negative skew and fat tails . You tried variants whose Sharpes had a cross-trial standard deviation of .
First the benchmark. With : and . So
The expected lucky maximum Sharpe is already , most of your observed . Plugging into the DSR (using per-observation Sharpe consistently), the numerator is small and the fat tails inflate the denominator, so the DSR lands well below the bar. The verdict: a Sharpe, selected from 100 tries on a 5-year, fat-tailed sample, is not convincing evidence of skill. Had you tried only , the benchmark would be and the same Sharpe would be strongly significant. The number you must disclose is .
Failure modes
- Undercounting . The trials include every variant you, your team, and the literature ever ran on this data, not just the grid in your final notebook. Undercount and the deflation is too weak.
- Ignoring skew and kurtosis. Assuming normality understates the Sharpe standard error; real strategies with negative skew and fat tails deserve a wider confidence interval.
- Correlated trials. The variance term and the effective independent are entangled when variants overlap; use the observed dispersion of trial Sharpes rather than a nominal count.
- Short samples. Small makes itself noisy; the term punishes short track records appropriately.
In interviews
Expect "you have a backtest with a Sharpe of 2, what else do you need to know to judge it?" The three answers the DSR formalizes are: how many strategies you tried (), how long and how non-normal the track record is (, skew, kurtosis), and how dispersed the trial Sharpes were. Be able to explain the expected-maximum benchmark, that the max of Gaussians grows like (or the exact Gumbel expression above), and why fat tails and negative skew lower your confidence in a given Sharpe. The one-sentence summary: the DSR asks whether your best Sharpe beats the best Sharpe luck would have handed you across all your trials. See Data-Snooping Bias and Backtest Overfitting.
Practice in interviews
Further reading
- Bailey & López de Prado, The Deflated Sharpe Ratio: Correcting for Selection Bias, Backtest Overfitting and Non-Normality
- Bailey, Borwein, López de Prado & Zhu, Pseudo-Mathematics and Financial Charlatanism
- Harvey & Liu, Backtesting