Quant Memo
Foundational

The Bernoulli Distribution

The simplest possible random variable — a single coin flip with two outcomes — and the building block underneath binomial counts, logistic regression, and win/loss trade outcomes.

A Bernoulli random variable takes only two values, conventionally 11 ("success") and 00 ("failure"), with success probability pp and failure probability 1p1-p. It's the mathematical model for a single yes/no event: one coin flip, whether one specific trade is a winner, whether one specific option expires in-the-money.

Its mean is simply E[X]=pE[X] = p — the long-run average of a 0/1 variable is just the probability of getting a 1. Its variance is Var(X)=p(1p)\mathrm{Var}(X) = p(1-p), which is largest when p=0.5p = 0.5 (maximum uncertainty about the outcome) and shrinks toward zero as pp approaches 0 or 1 (the outcome becomes near-certain either way).

Worked example: a strategy wins a given trade with probability p=0.6p = 0.6. Its per-trade outcome has mean 0.60.6 and variance 0.6×0.4=0.240.6 \times 0.4 = 0.24, so a standard deviation of about 0.490.49 — nearly as large as the mean itself, which is typical for Bernoulli outcomes near the middle of the range. Summing nn independent Bernoulli trials with the same pp gives a binomial random variable, the count of successes out of nn tries; this is exactly how a win-rate estimate over a backtest is built, one Bernoulli outcome per trade.

A Bernoulli variable is a single 0/1 outcome with mean pp and variance p(1p)p(1-p); it's the atomic building block behind binomial counts, win-rate statistics, and the likelihood function used in logistic regression.

Related concepts

Practice in interviews

Further reading

  • Wasserman, All of Statistics, ch. 2
ShareTwitterLinkedIn