Basic Prerequisites: 03 · The Multiple-Testing Problem (expected maximum Sharpe) and Probability & Measure Theory.
1. Intuition & Practical Objective
A raw Sharpe ratio conflates two very different claims: (i) “this strategy made money relative to its risk” and (ii) “this strategy is statistically distinguishable from luck”. The Probabilistic Sharpe Ratio (PSR) answers (ii) for a single trial. The Deflated Sharpe Ratio (DSR) answers it after admitting that the strategy was selected as the best of trials - and that its returns are not normal.
The practical objective: turn a strategy’s reported Sharpe, sample length, skew/kurtosis, and the number of trials into one number in - the probability that the true Sharpe exceeds the selection-bias-adjusted threshold . Pass/fail conventions: = significant at 95%, i.e. the strategy is not explainable as the best of null flukes.
The one-line essence. “DSR is a PSR whose rejection threshold is raised to the height expected of the maximum of zero-skill trials: , and whose standard error is widened by skewness and kurtosis.”
2. Mathematical Ground Truth & Derivations
2.1 The Probabilistic Sharpe Ratio (single trial)
The Sharpe estimator’s variance under non-normal returns (Lo 2002; Bailey & López de Prado 2012) is
where is skewness and is Pearson kurtosis ( for normal). Hence, against a user-chosen benchmark ,
Note the non-normality penalty: negative skew inflates the denominator (raises the bar); fat tails (kurtosis ) do the same. Two strategies with identical Sharpe but different higher moments get different PSRs.
2.2 The Deflated Sharpe Ratio
Replace the arbitrary benchmark by the expected maximum under the null of trials: with
and define
Everything is in non-annualized (per-period) units - DSR is scale-invariant only if matches the return frequency and , share the period.
What DSR adds over a raw Sharpe - five extra inputs, each of which can only lower significance:
- - the number of independent trials (raises ),
- - how dispersed the trials were (scales ),
- - sample length (longer = more certain),
- - non-normality (widens the denominator).
2.3 Minimum Track Record Length
Inverting DSR for the required sample length (PSR threshold) gives the MinTRL:
It answers “how long must this track record be before it is significant?” - and it grows with negative skew and fat tails, the empirical signature of option-selling and carry strategies.
3. Computational Implementation - DSR end-to-end
Stdlib only. Reproduces the canonical Bailey & López de Prado worked example, sweeps , contrasts normal vs non-normal returns, and computes MinTRL.
Read the story: a strategy with an annualized Sharpe of 2.5 over 5 years is only fundable if it survived at most ~46 trials (). At the 100 trials it actually survived, - below the 95% bar. The normal-returns column isolates the second source of inflation: holding fixed, non-normality (skew , kurt ) costs ~4 percentage points of DSR at (0.942 0.900). MinTRL shows the flip side: a Sharpe-2.5 record needs only ~110 days (~0.44 yr) ignoring non-normality, stretched to ~168 days (0.7 yr) once skew / kurt are priced in - negative skew is expensive.
4. Failure Modes & First-Principles Breakdowns
- Unit mismatch. DSR mixes , , , and ; all must be in the same (per-period) units. Annualizing some but not others is the classic implementation bug (annualize the final threshold, not the inputs).
- Kurtosis convention. The formula uses Pearson kurtosis ( for normal). Passing excess kurtosis ( for normal) silently biases DSR;
scipy.stats.kurtosis(..., fisher=False)is the safe call. - ignored or guessed. is the variance of the trial Sharpes, not the strategy’s own variance. Using the strategy’s return variance is a category error; using a made-up is unverifiable.
- understated. Every dependent/derived trial counts (page 03). Understating makes DSR too generous - the exact failure DSR exists to prevent.
- Threshold mis-read. does not prove fraud; it says the result is not distinguishable from the best of flukes at 95%. Conversely is necessary, not sufficient - it says nothing about costs, capacity, or decay.
- Short samples + fat tails. Both inflate the standard error; a 6-month record with kurtosis 12 can never reach DSR 0.95 regardless of Sharpe. MinTRL tells you this before you deploy.
5. References
- Bailey, D. H. & López de Prado, M.: The Deflated Sharpe Ratio: Correcting for Selection Bias, Backtest Overfitting and Non-Normality, JPM 40(5), 94–107 (2014)
- Bailey, D. H. & López de Prado, M.: The Sharpe Ratio Efficient Frontier, Journal of Risk 15(2) (2012)
- Lo, A.: The Statistics of Sharpe Ratios, Financial Analysts Journal 58(4) (2002)
- Ingersoll, Spiegel, Goetzmann & Welch: Portfolio Performance Manipulation and Manipulation-Proof Performance Measures, RFS 20(5) (2007)
6. Connected Graph Bridges
- Back: 03 · Multiple Testing · Index Hub
- Forward: 05 · Failure Modes & Practice → 06 · Purged CV, PBO & Reality Check
- Siblings: 02 · Why Backtests Lie · Feature Engineering & Labeling (triple-barrier labels drive the skew that DSR penalizes)