The Matrix Exponential
The generalization of e^x to matrices, used to solve systems of linear differential equations in one shot — most notably, to move a continuous-time Markov chain forward by any amount of time.
Prerequisites: Diagonalization and Similarity
A system of quantities that all influence each other's rate of change — say, capital flowing between three linked trading strategies, each bleeding into or draining from the others at fixed rates — is described by a system of coupled linear differential equations. Solving each equation separately is impossible because they're tangled together. The matrix exponential solves the whole system at once, producing a single matrix that tells you exactly where every quantity will be at any future time, given only where it started.
An analogy: compound growth, but for several linked accounts
Ordinary compound growth says a single quantity growing continuously at rate becomes after time — the familiar exponential. Now imagine several accounts that don't just grow on their own, but also leak into and receive from each other continuously. There's no single growth rate anymore; there's a whole matrix of rates. The matrix exponential is exactly the multi-account version of : instead of one number growing, an entire vector of linked quantities evolves together, and the "growth rate" is replaced by a matrix describing every account's self-growth and cross-leakage simultaneously.
The math, one symbol at a time
For a system with initial condition , the solution is
In words: is defined the same way as the ordinary exponential's power series, just with the matrix (times ) plugged in for the scalar exponent, and matrix powers used instead of number powers. Computing that infinite sum directly is impractical, but if is diagonalizable as , then , where is just a diagonal matrix of ordinary scalar exponentials — the infinite matrix sum collapses to exponentiating each eigenvalue separately.
Worked example 1: a two-strategy capital flow system
Two strategies pass capital back and forth: strategy 1 grows at rate 1 but leaks to strategy 2 at rate 1; strategy 2 shrinks at rate but nothing flows into it otherwise. has eigenvalues , (it's already lower triangular, so eigenvalues sit on the diagonal), with eigenvectors and . Diagonalizing and exponentiating each eigenvalue: capital along the direction grows like , while capital along the direction decays like . Starting from , expanding in the eigenvector basis and recombining gives — strategy 1 grows exponentially, and strategy 2 first absorbs inflow, then its own decay term eventually dominates.
Worked example 2: a continuous-time Markov chain transition matrix
A trading state (idle, active) switches with generator matrix (rows sum to zero, off-diagonals are transition rates). The probability of being in each state after time , starting idle, is the first row of . 's eigenvalues are and ; the eigenvalue never decays and corresponds to the long-run steady state, while the term decays to zero — after about , , so the chain is already 95% of the way to its steady-state split of time between idle and active, read directly off the surviving eigenvector.
Watch how a mean-reverting path settles toward its long-run level at a rate set by its decay parameter — the same exponential-decay mechanism that a negative eigenvalue produces inside .
What this means in practice
The matrix exponential is the standard tool for propagating any continuous-time linear system forward: continuous-time Markov chain transition probabilities, term-structure models built on linear ODEs, and coupled mean-reverting processes. It's also the bridge between discrete-time matrix powers (see Diagonalization and Similarity) and continuous time — is what a transition matrix becomes when the number of steps is replaced by a continuous clock.
solves in one closed form, and via diagonalization it reduces to exponentiating each eigenvalue of separately — positive eigenvalues explode, negative ones decay, zero eigenvalues persist.
is not the matrix you get by exponentiating each entry of individually — that's a completely different (and generally meaningless) operation. The matrix exponential is defined by the full power series , which mixes entries together through repeated matrix multiplication. Confusing entrywise exponentiation with the true matrix exponential is a common error that produces a matrix with no connection to the actual solution of the underlying differential equation.
Related concepts
Practice in interviews
Further reading
- Strang, Introduction to Linear Algebra, ch. 6