Basic Prerequisites: 03 · Calibrating Local Vol and 04 · Calibrating Stochastic Vol.
1. Intuition & Practical Objective
This page names the three ways calibration goes wrong - overfitting, instability, non-identifiability - ties each to a first-principles cause, and then describes how a real desk survives them (market data, conventions, and the discipline of distrusting the calibrated model). The objective is not cynicism: it is knowing precisely which assumptions to distrust so the residual model risk can be measured and managed.
Three structural facts do the damage:
- Differentiation amplifies noise. Local vol needs second derivatives of prices; noisy quotes ⇒ huge local-vol spikes or negative variance. (Ill-posedness.)
- The smile fixes combinations, not parameters. SABR’s , Heston’s are collinear; different parameters fit identically. (Non-identifiability.)
- The model is static but the market is not. A parameter set fit to today is not a law of motion; recalibration drift is real P&L risk. (Overfitting + model risk.)
2. Mathematical Ground Truth & Derivations
Ill-posedness of the local-vol inversion (Gatheral 1.10; Bergomi 2.19). The local variance is
which contains - a second finite difference. If observed with noise at grid spacing , the second difference has error , and the denominator can be driven to (or negative, i.e. strike arbitrage / negative butterfly). Near a zero denominator, . This is the textbook ill-posed inverse problem: the forward map (smile → local vol) is smoothing, so its inverse is unstable.
Non-identifiability (Bergomi Ch 6, Ch 8; Gatheral Ch 3). The ATMF skew is, to first order, a weighted integral of the instantaneous spot/vol covariance:
The combination is fixed by the smile; how it is split between and (or and ) is not. That split changes the dynamics (, the skew-stickiness ratio) without changing the static fit - hence identical fits with different hedge ratios.
Conventions that quietly change the answer. Calibration output is only meaningful given a convention set (Bergomi Ch 5 on variance swaps makes this vivid): implied vs realized vol, log-returns vs arithmetic returns in the variance payoff ( vs standard returns flips the sign of the third-order term), vs moneyness, per-point vs per-unit vol scaling, the dividend model (continuous yield vs discrete), and the discount curve. Two desks with the same data and model but different conventions report different calibrated parameters.
3. Computational Implementation - instability in numbers
Reconstruct local vol from a smooth smile with and without realistic bid/ask noise (~0.4 vol pts, white across strikes). The differentiation amplifies the noise catastrophically. Stdlib only.
A 0.4-vol-point wiggle in the smile blows one reconstructed local variance up to - about nine orders of magnitude above the true level () - and swings the butterfly denominator to near zero. This is why desks never invert raw quotes: they first fit a smooth, arbitrage-free parametric surface (SVI, a parametric LV, a calibrated SV model) and only then invert, and they clip/smooth the result. The instability is structural, not a code bug.
4. Failure Modes & First-Principles Breakdowns (numbered)
- Ill-posed inversion (differentiation amplifies noise ~). The local-vol map needs second derivatives of prices; raw-quote noise explodes it (Experiment above). Fix: smooth/parameterize the smile first, regularize, clip local variance to be positive and bounded.
- Non-identifiability (smile fixes combinations, not parameters). SABR and Heston trade off; identical fits, different hedges. Fix: fix a convention ( equity, FX), use term structure, or ridge-regularize toward a prior (04 · Stochastic Vol).
- Overfitting (rich model, sparse data). Enough parameters drive today’s residuals to zero and tomorrow’s prices to nonsense - the far wings have few quotes, so that is where overfit surfaces break. Fix: cross-validate, penalize (ridge), check no-arbitrage (butterfly , total variance increasing in ).
- Convention drift. Two desks with identical data and model but different conventions (moneyness, log vs arithmetic returns, dividend model, discount curve, per-point scaling) get different parameters - a silent reconciliation risk.
- Recalibration drift (model risk). The calibrated model is static; when the market moves you recalibrate, and the change in the calibrated surface is itself unhedgeable P&L (Bergomi Ch 2.6: LV future skews are not lockable). The desk prices the deal and the cost of holding the model’s dynamics.
- Incomplete-market assumption (). Setting the price of vol risk to zero is a choice; it is invisible in the vanilla fit but changes exotic prices.
Desk practice distilled. Fit in implied vol (the quoted unit). Smooth, then invert (never invert raw quotes). Fix or regularize the non-identifiable parameters. Check no-arbitrage after every calibration. Report residuals - they flag where the model is structurally wrong. And treat every calibration as a snapshot, not a law of motion.
5. References
- Gatheral, The Volatility Surface
- Bergomi, Stochastic Volatility Modeling
- Duffy, Finite Difference Methods in Financial Engineering
- Hull, Options, Futures, and Other Derivatives
6. Connected Graph Bridges
- Back: 04 · Calibrating Stochastic Vol · Index Hub
- Forward: 06 · Advanced Extensions
- Sibling: Heston & SABR · Implied Volatility Surfaces · Counterparty Risk & XVA