Monte Carlo: Antithetic Variates, Control Variates, Quasi-MC

Medium·22 min read
Numerical MethodsMonte CarloVariance ReductionQuasi-Monte Carlo

Setup

What Monte Carlo Computes

Monte Carlo (MC) methods estimate expectations of the form

μ=E[f(X)],\mu = \mathbb{E}[f(X)],

where XX is a random variable (or vector) with a known distribution and ff is a payoff or functional. In derivatives pricing, XX is typically a path of the risk-neutral process and ff is the discounted payoff.

The standard MC estimator with NN i.i.d. samples X1,,XNX_1, \ldots, X_N is

μ^N=1Ni=1Nf(Xi).\hat{\mu}_N = \frac{1}{N}\sum_{i=1}^N f(X_i).

By the law of large numbers, μ^Nμ\hat{\mu}_N \to \mu almost surely. By the central limit theorem,

N(μ^Nμ)dN(0,σf2),σf2=Var(f(X)).\sqrt{N}\left(\hat{\mu}_N - \mu\right) \xrightarrow{d} \mathcal{N}(0, \sigma_f^2), \qquad \sigma_f^2 = \mathrm{Var}(f(X)).

The standard error is SE=σf/N\mathrm{SE} = \sigma_f / \sqrt{N}, converging at rate O(N1/2)O(N^{-1/2}) regardless of the dimension of XX. This is the central virtue of MC: convergence rate is dimension-independent.

Notation

  • σf2=Var(f(X))\sigma_f^2 = \mathrm{Var}(f(X)): variance of the estimator (per sample).
  • NN: number of independent sample paths.
  • σ^f2\hat{\sigma}_f^2: sample variance estimator, used to construct confidence intervals.
  • The 95%95\% confidence interval for μ\mu is μ^N±1.96σ^f/N\hat{\mu}_N \pm 1.96 \cdot \hat{\sigma}_f / \sqrt{N}.

A key principle: reducing σf\sigma_f by a factor kk is equivalent to increasing NN by k2k^2. Variance reduction techniques achieve this without generating more samples.


Antithetic Variates

Principle

For each sample XiX_i, generate a paired sample XiX_i' from the antithetic distribution — typically by negating the underlying normal draw. The antithetic estimator is:

μ^NAV=1Ni=1Nf(Xi)+f(Xi)2.\hat{\mu}_N^{\mathrm{AV}} = \frac{1}{N}\sum_{i=1}^N \frac{f(X_i) + f(X_i')}{2}.

This is unbiased: E ⁣[f(X)+f(X)2]=μ\mathbb{E}\!\left[\frac{f(X) + f(X')}{2}\right] = \mu since XX' has the same marginal distribution as XX.

Variance Analysis

Var ⁣(f(X)+f(X)2)=Var(f(X))+Var(f(X))+2Cov(f(X),f(X))4.\mathrm{Var}\!\left(\frac{f(X) + f(X')}{2}\right) = \frac{\mathrm{Var}(f(X)) + \mathrm{Var}(f(X')) + 2\,\mathrm{Cov}(f(X), f(X'))}{4}.

Since XX and XX' are identically distributed, Var(f(X))=Var(f(X))=σf2\mathrm{Var}(f(X)) = \mathrm{Var}(f(X')) = \sigma_f^2. Therefore:

Var ⁣(f(X)+f(X)2)=σf2+Cov(f(X),f(X))2.\mathrm{Var}\!\left(\frac{f(X) + f(X')}{2}\right) = \frac{\sigma_f^2 + \mathrm{Cov}(f(X), f(X'))}{2}.

Variance is reduced whenever Cov(f(X),f(X))<0\mathrm{Cov}(f(X), f(X')) < 0. Compared to the standard estimator variance σf2/N\sigma_f^2 / N using 2N2N samples (matching the computational cost — two paths per antithetic pair), the antithetic estimator variance is:

1Nσf2+Cov(f(X),f(X))2vs.σf22N.\frac{1}{N} \cdot \frac{\sigma_f^2 + \mathrm{Cov}(f(X), f(X'))}{2} \quad \text{vs.} \quad \frac{\sigma_f^2}{2N}.

The efficiency gain is:

Efficiency gain=σf2/(2N)(σf2+Cov)/2N=σf2σf2+Cov(f(X),f(X))=11+ρf,f,\text{Efficiency gain} = \frac{\sigma_f^2 / (2N)}{(\sigma_f^2 + \mathrm{Cov})/2N} = \frac{\sigma_f^2}{\sigma_f^2 + \mathrm{Cov}(f(X), f(X'))} = \frac{1}{1 + \rho_{f,f'}},

where ρf,f\rho_{f,f'} is the correlation between f(X)f(X) and f(X)f(X'). For this to be a gain, we need ρf,f<0\rho_{f,f'} < 0.

Application to GBM Call Option

Under GBM, one path realises WT=TZW_T = \sqrt{T} Z for ZN(0,1)Z \sim \mathcal{N}(0,1). The antithetic path uses Z-Z:

ST=S0exp ⁣((r12σ2)T+σTZ),ST=S0exp ⁣((r12σ2)TσTZ).S_T = S_0 \exp\!\left((r - \tfrac{1}{2}\sigma^2)T + \sigma\sqrt{T}\, Z\right), \qquad S_T' = S_0 \exp\!\left((r - \tfrac{1}{2}\sigma^2)T - \sigma\sqrt{T}\, Z\right).

The payoff f(Z)=erT(STK)+f(Z) = e^{-rT}(S_T - K)^+ is an increasing function of ZZ. When ZZ is large (call in the money), Z-Z is large and negative (call out of the money). So Cov(f(Z),f(Z))<0\mathrm{Cov}(f(Z), f(-Z)) < 0 for a convex, monotone payoff — antithetic variates are effective.

For path-dependent options, antithetic variates require generating the full antithetic path {Z1,,Zn}n=1Nsteps\{-Z_1, \ldots, -Z_n\}_{n=1}^{N_\text{steps}}.


Control Variates

Principle

Let YY be a random variable correlated with f(X)f(X) such that E[Y]=μY\mathbb{E}[Y] = \mu_Y is known analytically. The control variate estimator is:

μ^NCV(c)=1Ni=1N[f(Xi)c(YiμY)].\hat{\mu}_N^{\mathrm{CV}}(c) = \frac{1}{N}\sum_{i=1}^N \left[f(X_i) - c(Y_i - \mu_Y)\right].

This is unbiased for any constant cc: the correction term c(YiμY)c(Y_i - \mu_Y) has mean zero.

Optimal Control Coefficient

The variance of f(X)c(YμY)f(X) - c(Y - \mu_Y) is:

Var(f(X)cY)=σf22cCov(f,Y)+c2σY2.\mathrm{Var}(f(X) - c Y) = \sigma_f^2 - 2c\,\mathrm{Cov}(f,Y) + c^2 \sigma_Y^2.

Minimising over cc:

c=Cov(f(X),Y)Var(Y).c^* = \frac{\mathrm{Cov}(f(X), Y)}{\mathrm{Var}(Y)}.

This topic requires Premium

Only today's featured topic is free. Unlock the full Today's Focus archive with Premium.

Read the theory? Run the code.

View Notebook