The Matrix Exponential
The generalization of e^x to matrices, used to solve systems of linear differential equations in one shot, most notably, to move a continuous-time Markov chain forward by any amount of time.
Prerequisites: Diagonalization and Similarity
A system of quantities that all influence each other's rate of change, say, capital flowing between three linked trading strategies, each bleeding into or draining from the others at fixed rates, is described by a system of coupled linear differential equations. Solving each equation separately is impossible because they're tangled together. The matrix exponential solves the whole system at once, producing a single matrix that tells you exactly where every quantity will be at any future time, given only where it started.
An analogy: compound growth, but for several linked accounts
Ordinary compound growth says a single quantity growing continuously at rate becomes after time , the familiar exponential. Now imagine several accounts that don't just grow on their own, but also leak into and receive from each other continuously. There's no single growth rate anymore; there's a whole matrix of rates. The matrix exponential is exactly the multi-account version of : instead of one number growing, an entire vector of linked quantities evolves together, and the "growth rate" is replaced by a matrix describing every account's self-growth and cross-leakage simultaneously.
The math, one symbol at a time
For a system with initial condition , the solution is
In words: is defined the same way as the ordinary exponential's power series, just with the matrix (times ) plugged in for the scalar exponent, and matrix powers used instead of number powers. Computing that infinite sum directly is impractical, but if is diagonalizable as , then , where is just a diagonal matrix of ordinary scalar exponentials , the infinite matrix sum collapses to exponentiating each eigenvalue separately.
Worked example 1: a two-strategy capital flow system
Two strategies pass capital back and forth: strategy 1 grows at rate 1 but leaks to strategy 2 at rate 1; strategy 2 shrinks at rate but nothing flows into it otherwise. has eigenvalues , (it's already lower triangular, so eigenvalues sit on the diagonal), with eigenvectors and . Diagonalizing and exponentiating each eigenvalue: capital along the direction grows like , while capital along the direction decays like . Starting from , expanding in the eigenvector basis and recombining gives , strategy 1 grows exponentially, and strategy 2 first absorbs inflow, then its own decay term eventually dominates.
Worked example 2: a continuous-time Markov chain transition matrix
A trading state (idle, active) switches with generator matrix (rows sum to zero, off-diagonals are transition rates). The probability of being in each state after time , starting idle, is the first row of . 's eigenvalues are and ; the eigenvalue never decays and corresponds to the long-run steady state, while the term decays to zero, after about , , so the chain is already 95% of the way to its steady-state split of time between idle and active, read directly off the surviving eigenvector.
Watch how a mean-reverting path settles toward its long-run level at a rate set by its decay parameter, the same exponential-decay mechanism that a negative eigenvalue produces inside .
What this means in practice
The matrix exponential is the standard tool for propagating any continuous-time linear system forward: continuous-time Markov chain transition probabilities, term-structure models built on linear ODEs, and coupled mean-reverting processes. It's also the bridge between discrete-time matrix powers (see Diagonalization and Similarity) and continuous time, is what a transition matrix becomes when the number of steps is replaced by a continuous clock.
solves in one closed form, and via diagonalization it reduces to exponentiating each eigenvalue of separately, positive eigenvalues explode, negative ones decay, zero eigenvalues persist.
is not the matrix you get by exponentiating each entry of individually, that's a completely different (and generally meaningless) operation. The matrix exponential is defined by the full power series , which mixes entries together through repeated matrix multiplication. Confusing entrywise exponentiation with the true matrix exponential is a common error that produces a matrix with no connection to the actual solution of the underlying differential equation.
Discussion
💡 Discussion rules
- Ask and answer about this concept. Off-topic gets removed.
- No homework dumps. Show what you tried first.
- Corrections are welcome. Cite a source when you claim an error.
Loading discussion…
Related concepts
Practice in interviews
Further reading
- Strang, Introduction to Linear Algebra, ch. 6