Quant Memo
Advanced

The Probabilistic Sharpe Ratio

A confidence statement about a Sharpe ratio, the probability that the true Sharpe beats a benchmark, once you account for how short the track record is and how non-normal the returns are.

Prerequisites: Sharpe Ratio, Confidence Intervals

A Sharpe ratio computed from a backtest is an estimate, not a fact. You measured it on one finite sample, and a different sample would have handed you a different number. So the honest question is never "is the Sharpe 1.2?" but "given this Sharpe of 1.2, how sure am I the strategy's true Sharpe is even positive?" The Probabilistic Sharpe Ratio (PSR) answers exactly that: it converts an observed Sharpe into a probability that the real, long-run Sharpe clears some benchmark.

The trick is knowing how noisy your Sharpe estimate is. A Sharpe measured over 30 years is far more trustworthy than the same Sharpe measured over 6 months, and returns with fat tails and negative skew make the estimate noisier still. PSR bakes both effects into a single number between 0 and 1.

The formula

The PSR is the probability that the true Sharpe exceeds a chosen benchmark SRSR^\star:

PSR^(SR)=Φ ⁣((SR^SR)n11γ^3SR^+γ^414SR^2).\widehat{PSR}(SR^\star) = \Phi\!\left(\frac{(\widehat{SR} - SR^\star)\,\sqrt{n-1}}{\sqrt{1 - \hat\gamma_3\,\widehat{SR} + \frac{\hat\gamma_4 - 1}{4}\,\widehat{SR}^{\,2}}}\right).

Reading it piece by piece: SR^\widehat{SR} is your observed (per-period) Sharpe; SRSR^\star is the bar you want to beat (often 00); nn is the number of return observations; γ^3\hat\gamma_3 is the skewness of the returns and γ^4\hat\gamma_4 is their kurtosis (γ^4=3\hat\gamma_4 = 3 for a normal, higher for fat tails); and Φ\Phi is the standard-normal CDF (the bell curve's running total, which turns a z-score into a probability). The numerator asks how far your Sharpe sits above the bar, scaled up by n1\sqrt{n-1} so a longer record counts for more. The denominator is the standard error of the Sharpe estimate: negative skew and fat tails make it bigger, shrinking your confidence.

PSR is the probability that the true Sharpe beats a benchmark, given your observed Sharpe, the length of the track record (nn), and the non-normality of returns (skew γ^3\hat\gamma_3, kurtosis γ^4\hat\gamma_4). More data raises it; fatter tails and negative skew lower it.

The picture below shows the idea. The bell is the range of true Sharpes consistent with what you measured, centered on SR^\widehat{SR}. PSR is the shaded mass to the right of the benchmark SRSR^\star, the chunk of that range where the strategy really does have a positive edge.

benchmark SR* observed Sharpe PSR 1 − PSR possible true Sharpe →
PSR is the shaded area above the benchmark: the probability that the strategy's true Sharpe is really better than the bar. A wider bell (short sample or fat tails) pushes more mass below the benchmark and lowers the PSR.

Worked example

A strategy shows a monthly Sharpe of SR^=0.30\widehat{SR} = 0.30 over n=36n = 36 months, and you want the probability the true Sharpe is positive, so SR=0SR^\star = 0.

If returns were normal (γ^3=0\hat\gamma_3 = 0, γ^4=3\hat\gamma_4 = 3): the denominator is 10+314(0.30)2=1+0.045=1.022\sqrt{1 - 0 + \tfrac{3-1}{4}(0.30)^2} = \sqrt{1 + 0.045} = 1.022. The numerator is 0.30×35=0.30×5.916=1.7750.30 \times \sqrt{35} = 0.30 \times 5.916 = 1.775. So the z-score is 1.775/1.022=1.741.775 / 1.022 = 1.74, and Φ(1.74)0.96\Phi(1.74) \approx 0.96. A PSR of 0.96, above the usual 0.95 bar, you're fairly confident the edge is real.

Now make the returns realistic with negative skew γ^3=0.5\hat\gamma_3 = -0.5 and fat tails γ^4=6\hat\gamma_4 = 6: the denominator grows to 1(0.5)(0.30)+614(0.30)2=1+0.15+0.1125=1.124\sqrt{1 - (-0.5)(0.30) + \tfrac{6-1}{4}(0.30)^2} = \sqrt{1 + 0.15 + 0.1125} = 1.124. The numerator is unchanged at 1.7751.775, so the z-score falls to 1.775/1.124=1.581.775 / 1.124 = 1.58, and Φ(1.58)0.94\Phi(1.58) \approx 0.94. The PSR slips to 0.94, now below 0.95. Nothing about the return path changed except its shape, yet the same Sharpe is no longer convincing. That is the entire point: a Sharpe from lumpy, crash-prone returns deserves less trust than one from smooth returns.

To lift a borderline PSR you have two honest levers: collect more data (raise nn) or genuinely reduce the strategy's tail risk (tame γ^3\hat\gamma_3 and γ^4\hat\gamma_4). Re-running the optimizer to nudge SR^\widehat{SR} up is the dishonest lever, and it feeds straight into Backtest Overfitting.

Where it fits

PSR judges a single strategy against a fixed bar. But if you tried many strategies and kept the best, that best-of-many Sharpe is inflated by selection, and a fixed bar of SR=0SR^\star = 0 is too easy. The fix is to raise the benchmark to the Sharpe luck alone would produce across all your trials, which turns PSR into the The Deflated Sharpe Ratio. And the flip side of PSR, "how long a record do I need before a given Sharpe is trustworthy?", is answered by the Minimum Backtest Length.

PSR corrects for track-record length and non-normality, but it does not know how many strategies you tested. Report a high PSR on your single best backtest and you are quietly hiding the selection bias. Deflate it, or disclose the trial count.

In interviews

If asked "your backtest Sharpe is 1.5, is that good?", the sophisticated answer is: it depends on how long the sample is and how non-normal the returns are, quantified by the PSR, and on how many variants you tried, quantified by the deflated Sharpe. Be able to name the two ingredients of the standard error, the n1\sqrt{n-1} that rewards long records and the skew/kurtosis term that punishes fat tails, and to state that PSR is just Φ\Phi of a z-score comparing your Sharpe to a benchmark.

Related concepts

Practice in interviews

Further reading

  • Bailey & López de Prado, The Sharpe Ratio Efficient Frontier
  • López de Prado, Advances in Financial Machine Learning (Ch. 14)
ShareTwitterLinkedIn