Basic Prerequisites: 01 · From Zero and Statistics & Inference.


1. Intuition & Practical Objective

This page is the map: what alternative datasets are, how they are categorized, and - the practical question every PM asks - is a given dataset worth anything to a portfolio? The objective is the framework that answers “worth anything”: the Fundamental Law of Active Management, which says the value of a signal is , and its extension to combining signals, which says a new dataset’s worth is governed not by its own IC but by its uniqueness - how much of it is not already in the signals you trade.

The central reframing: alt-data rarely raises your IC; it raises your breadth. Almost no single dataset has a large IC (weak signals are the norm - see Financial ML Pitfalls). What a portfolio of unique signals does is multiply your number of independent bets - and is where the leverage lives. Twenty genuinely-uncorrelated signals beat one signal, because grows like while IC grows like only in a fantasy where the signals are perfect.


2. Mathematical Ground Truth & Derivations

The Fundamental Law. For a signal with information coefficient IC and independent bets per period (rebalances × names, adjusted for correlations),

with transfer coefficient capturing implementation friction (constraints, costs, capacity). Breadth, not IC, is the lever most strategies actually pull - and alt-data is the main way to add breadth because each unique dataset is a new, weakly-correlated bet stream.

Combining signals with correlation. Let each of alphas have standalone IC and let be their common pairwise correlation. An equal-weight composite has IC and IR

The two limits are the whole lesson: as with , (unbounded - every new independent alpha helps); with , the denominator gives the ceiling , a finite wall. Correlated alt-data saturates; unique alt-data compounds.

Required IC vs breadth. Setting (a decent standalone strategy) and reading off IC:

A monthly strategy needs an enormous IC to “work” alone; a daily strategy needs a tiny one. This is why alt-data desks are obsessed with frequency and breadth.

Uniqueness (why the margin is in the residual). If a model already uses a factor , a new signal contributes only its orthogonal part. Define uniqueness from regressing on (and the existing factor set):

The marginal IR contribution of scales with , not with its raw IC. A signal with and adds less than a signal with and .


3. Computational Implementation - breadth, correlation, and the ceiling

Stdlib only. It computes the Fundamental Law for a single alpha, the compounding of independent alphas, the saturation wall when they are correlated, and the IC required for at each breadth.

Read the two middle blocks together. With independent alphas, ten signals combine to and - the compounding, real diversification. With correlated alphas (), adding signals barely helps: rises from () to only () - it hits the wall. The marginal value of an alt-data dataset is its correlation to what you already trade, not its standalone IC.


4. Failure Modes & First-Principles Breakdowns

  1. “We have 500 datasets” - but they are all the same signal. Correlated alt-data (card panels from two vendors, three satellite providers of parking-lot counts) adds almost no breadth. The first principle: breadth counts independent bets, not tickers or feeds; saturates at .
  2. Backtesting the IC and ignoring capacity/transfer. A big IC in a tiny, illiquid name set with no capacity is worthless (). The law has three factors; optimizing IC alone is optimizing of the problem.
  3. The uniqueness illusion. A new signal with high raw IC but high correlation to your existing model (low ) is already priced into your P&L; adding it double-counts and inflates the backtest. Always compute the residual (06 · Advanced Extensions).
  4. Frequency ≠ breadth. Rebalancing the same signal more often does not create independent bets when the signal is autocorrelated; must be an effective bet count after accounting for serial and cross-sectional correlation (Backtesting Hygiene).

5. References

  • Grinold, Richard C. & Kahn, Ronald N.: Active Portfolio Management (2nd ed.)
  • López de Prado, Advances in Financial Machine Learning, §2.2.4 (the alt-data taxonomy: individuals / business processes / sensors, after Kolanovic & Krishnamachari)
  • Kolanovic & Krishnamachari, Big Data and AI Strategies (J.P. Morgan, 2017)
  • Guida, Tony, Big Data and Machine Learning in Quantitative Investment (Wiley, 2019)
  • AIMA / SS&C, Casting the Net (2017)

6. Connected Graph Bridges