Basic Prerequisites: 01 - From Zero and basic probability (mean, variance, Monte Carlo).


1. Intuition & Practical Objective

Before optimizing anything, we must be able to measure it. The industry’s measuring stick is implementation shortfall (IS) - Perold (1988). The idea is blunt: write down the price and size you decided on (the “paper portfolio” price ), then compare what you actually got at the end. The gap is the cost of execution, and it decomposes into two pieces you can manage separately:

  • Execution cost - what you paid on the shares you did trade, relative to the decision price.
  • Opportunity cost - the P&L on the shares you failed to trade (canceled, or the order was too patient and the price ran away).

The practical objective of this page: build the cost-and-risk objective as a random variable with a mean and a variance , then verify with Monte Carlo that the closed forms in the Almgren–Chriss model actually describe the simulated world. Every later page optimizes ; this page is where those two objects are defined.

The one-sentence essence. “Implementation shortfall is the difference between the paper portfolio and the real one; it splits into execution cost (you traded but at a bad price) and opportunity cost (you didn’t trade and the price moved) - and prior to trading it is a random variable, so we optimize its mean and variance.”


2. Mathematical Ground Truth & Derivations

Definition (Perold 1988; Hasbrouck Ch 14, eq 14.1). Let be the initial (actual) holdings, the desired (“paper”) target, the realized final holdings, and the initial and terminal benchmark prices. Then

where is the average realized execution price. Execution costs are zero-sum across users sharing the benchmark - one trader’s slippage is another’s gain - while opportunity cost is not a transfer; it is the tracking error of a partially-filled program.

Effective vs realized cost (Hasbrouck eq 14.2). With the benchmark midquote :

and the second term is exactly the price-impact estimate. SEC Rule 605 (the old “dash-five”) mandates this reporting - it is the regulatory shadow of implementation shortfall.

The AC objective as a random variable (AC eqs 3-5). For a liquidation with linear impact, the total shortfall is

With and the deterministic part evaluates to

and because the are independent with unit variance and the loading on is ,

The critical structural fact: IS is (approximately) Gaussian, since it is a sum of many independent increments; this is why “mean + variance” is a complete description and why the AC frontier (next pages) is exactly a mean-variance frontier. The permanent-impact term is schedule-independent; only (temporary) and (risk) move with the schedule.


3. Computational Implementation - simulating implementation shortfall

Simulate the arithmetic random walk with permanent + temporary impact, execute a TWAP schedule, and check that the realized mean and standard deviation of IS match the closed forms and . Stdlib only.

The Monte Carlo reproduces the closed forms to within sampling error (; Hasbrouck’s Ch 14-15 formulas are confirmed as descriptors of the realized shortfall).

Decomposition check. The $20,000 fixed cost and \tfrac12\gamma X^2= $125,000 permanent impact account for $145,000 of the $644,500; the remaining $499,500 is temporary impact - the part a schedule can actually reduce.


4. Failure Modes & First-Principles Breakdowns

  1. Benchmark choice changes everything. IS relative to the decision price is what a PM cares about; VWAP slippage (TWAP) is what a broker reports. The two disagree, and one is gameable (Harris 2003): an algorithm can “beat VWAP” by trading more when the market is heavy, without adding anything.
  2. Opportunity cost is often ignored - and it is real. If you are too patient and half the order is unfilled, the execution cost on the filled half looks great while the unfilled half’s tracking error dominates. Perold’s point is that IS must include the miss.
  3. The Gaussian assumption is fragile. The IS distribution is Gaussian only because the increments are independent and the horizon is short. On a macro-announcement day the impact function itself jumps (non-stationarity): the mean and variance you calibrated yesterday no longer describe today.
  4. Slippage is measured ex-post but optimized ex-ante. All the quantities above are random variables realized after trading. Calibrating from past fills and trusting them as constants is the leap that page 05 - Failure Modes scrutinizes.
  5. Zero-sum trap. Because execution cost nets to zero across users sharing the benchmark, a desk can show low “cost” simply by being on the winning side of a transfer. Aggregate cost is a selection statistic, not a quality statistic (Hasbrouck Ch 14).

5. References

  • Perold, André F. - “The implementation shortfall: Paper versus reality,” Journal of Portfolio Management 14(3), 4-9 (1988). The origin of IS.
  • Hasbrouck, Joel - Empirical Market Microstructure (2007)
  • Bertsimas, Dimitris; Lo, Andrew W. - “Optimal control of execution costs,” Journal of Financial Markets 1(1), 1-50 (1998). Defines best execution as minimal expected cost; the DP formulation IS sits inside.
  • Almgren, Robert; Chriss, Neil - “Optimal execution of portfolio transactions,” Journal of Risk 3(2), 5-40 (2000)

6. Connected Graph Bridges