Basic Prerequisites: 03 · Crowding & Capacity and 04 · Post-Publication Decay.


1. Intuition & Practical Objective

The previous pages derived how a factor premium can be estimated, sized, and eroded. This page assembles the operating manual: the six ways factor investing actually loses money, each named precisely, tied to a first principle, and - where possible - given a number. The objective is not cynicism. It is knowing exactly where the elegant arithmetic stops describing the world.

The six failures, in one line each:

  1. The diversification illusion - many “factors” that are highly correlated are one factor wearing several names; the Sharpe you thought you diversified away was never there.
  2. Crowding & the liquidity black hole - a forced unwind of a crowded factor has no counterparty; the tail is far fatter than the risk model says.
  3. Post-publication decay - a published premium loses ~35% of its in-sample alpha, and the decay is fastest where arbitrage is cheapest.
  4. Capacity & trading costs - net alpha is concave in AUM and dies at a break-even that scales with the square of the gross premium.
  5. The factor zoo / multiple testing - with hundreds of candidates, hundreds of chance discoveries; the right hurdle is , FDR, or a deflated Sharpe.
  6. Factor timing is a high-variance, low-IC bet - timing has breadth ≈12, so it needs an IC ≈0.1 to matter, and in-sample-optimal timing weights routinely collapse out-of-sample (developed on 06 · Advanced Extensions).

The one-sentence essence. “Factor investing fails in six predictable ways - correlated ‘factors’ that are one bet, crowded unwinds with no counterparty, publication decay of ~a third, capacity that dies quadratically in the premium, multiple testing that manufactures discoveries, and timing that needs an IC three times stronger than stock selection - and a practitioner’s skill is measuring which one is active right now.”


2. Mathematical Ground Truth & Derivations

Failure 1 - the diversification illusion, quantified. Take factor strategies, each with expected alpha and residual volatility . Their residuals are not independent: suppose the average pairwise residual correlation is . Then an equal-weighted portfolio of the strategies has alpha and volatility

so its appraisal ratio (information ratio) is

Two limits matter. As , - the diversification we hope for. As , regardless of - twenty factors become one. This is why Cochrane insisted that covariance, not the mean, is the central object: “if the value firms decline, they all decline together.”

Failure 2 - crowding, the flow-shock term the risk model omits. A standard risk model writes with diagonal, i.e. it treats idiosyncratic and flow-driven moves as independent noise. In a crowded unwind they are perfectly aligned: everyone sells the same names. The correct structure has an extra term for the common flow shock,

and is time-varying - it is small in normal times and enormous in a deleveraging. No historical covariance matrix captures that, so the mitigation is a stress overlay, not a bigger : scenario impact, participation caps, liquidity-adjusted VaR.

Failure 3 - decay, restated as a half-life. If a premium decays exponentially at rate , , the half-life is . McLean–Pontiff’s ~35% post-publication decline over their post-publication window implies a long but finite half-life; the practitioner’s rule is to apply a haircut of roughly to every backtested alpha before evaluating it. With a 35% haircut, an in-sample 5%/yr is worth 3.25%/yr - and if the factor is liquid and low-idio-risk, haircut more (their cheap-to-arbitrage group decayed ~49%).

Failure 4 - capacity. From 03: , with break-even . Halving the gross premium quarters the capacity.

Failure 5 - the multiple-testing floor. Under the null with tests, the expected false-discovery count is ; a hurdle is the standard remedy; BH-FDR controls the fraction rather than the count.

Failure 6 - timing breadth. ; to reach IR 0.5 you need a monthly timing IC of ~0.14, on a single highly volatile bet. (Developed on page 06.)


3. Computational Implementation - the two failures you can see in a backtest

Stdlib only. Experiment A shows eighteen of your twenty factors were one factor; Experiment B is the crowding monitor every factor book should run - the moment pairwise correlation creeps up, the risk model’s diversification forecast is already wrong.

Twenty uncorrelated factors give an IR of 1.50 (closed form 1.55) - genuine diversification, a near-5× improvement over one factor. Twenty factors with 85% residual correlation give an IR of 0.29 (closed form 0.37), which is indistinguishable from holding a single factor. Eighteen of them bought you nothing but fees. A real factor book routinely holds “value”, “quality”, “low-vol”, and “profitability” simultaneously; if their pairwise correlation is 0.85 they are one bet, and the portfolio’s advertised diversification is fiction.

Both factors keep the same mean and the same volatility throughout - nothing in either factor’s own statistics changes. What changes is their correlation, from +0.07 to +0.83. The consequences: the book’s realized volatility is 1.31× the risk model’s forecast; the Sharpe collapses from 0.88 to 0.09 (the premium is unchanged, but it is no longer diversified); and the worst month deepens to −8.18%. This is the mechanism that turns a market-neutral book into a one-way bet without anyone changing a position - and it is only visible if you monitor pairwise factor correlation, not factor volatility.


4. Failure Modes & First-Principles Breakdowns (numbered)

  1. The diversification illusion. As Experiment A shows, is bounded by as . Practice: estimate the residual-correlation matrix of your factor sleeves, orthogonalize (Gram–Schmidt or PCA) before combining, and count eigenvalues, not sleeves. If the correlation matrix’s second eigenvalue is tiny, you own one factor.
  2. Crowding & liquidity black holes. August 2007 (Quant Quake) and March 2020 (the value crash) are the canonical episodes: forced deleveraging cascades into same-side liquidations across the whole factor, producing unprecedented drawdowns in supposedly market-neutral books. The factor’s modeled beta-risk says “low”; the realized tail says otherwise - because everyone holds the same long-short. Practice: monitor cross-factor correlation, valuation spreads, short interest, and participation; hold a stress scenario, not just a covariance matrix.
  3. Post-publication decay. ~35% average haircut, larger for cheap-to-arbitrage characteristics (~49% in the low-idio-risk group), smaller for costly ones (~17%). Practice: haircut backtested alphas before sizing; re-estimate the premium on post-publication data only; prefer factors that are hard to trade - they decay slower.
  4. Capacity & trading costs. Net alpha is concave in AUM, and . A factor with 2%/yr gross alpha has roughly a quarter the capacity of one with 4% (≈$158bn vs ≈$630bn for the §03 calibration). Practice: build the impact model into the backtest, cap participation at a few percent of ADV, and report capacity alongside Sharpe.
  5. The factor zoo / multiple testing. Expected false discoveries ; use or BH-FDR; state the number of configurations you tried. See Backtesting Hygiene & Deflated Sharpe.
  6. Factor timing is a high-variance, low-IC bet. Timing breadth ≈12, so an IR of 0.5 needs a monthly timing IC ≈0.14. In-sample-optimal timing weights collapse out-of-sample (page 06 quantifies the collapse). Practice: treat timing as a small overlay (a tilt of ±0.25–0.5× the factor’s normal risk budget), validate with purged cross-validation, and never size it as if it were a stock-selection signal.
  7. The meta-failure: every one of these is a time-varying quantity. Correlations, decay rates, capacities, and premia are not constants to be estimated once; they are state variables. A factor programme is a monitoring system, and the practitioner’s edge is in noticing the regime change before the P&L does.

5. References

  • Khandani, Amir & Lo, Andrew, “What Happened to the Quants in August 2007?” (JIM, 2007)
  • McLean & Pontiff (JF, 2016)
  • Almgren et al. (Risk, 2005)
  • Ilmanen, Expected Returns (2011)
  • Cochrane, (JF, 2011) §II
  • Grinold, Richard & Kahn, Ronald, Active Portfolio Management
  • Taleb, Nassim Nicholas, Dynamic Hedging
  • Sibling practitioner page: the construction folder’s failure page - multicollinearity in , the factor zoo, and the same crowding episode seen from the model side.

6. Connected Graph Bridges