Probability Axioms
00 · Symbol Glossary
A number in the model assigns to the event . Which assignments are allowed is fixed by the Kolmogorov axioms of this chapter, whatever interpretation (frequency, belief, market-implied) sits behind the numbers.
A sample space together with a probability on its events. In this chapter is finite or countable and every subset of is an event.
The probability of the single outcome , . On a finite or countable space the weights determine every event's probability by summation.
Add up a quantity over every outcome in . The basic computation of this chapter is .
The number of outcomes in a finite event . Used in the uniform model .
Probability that and occur together. This is the overlap term that inclusion–exclusion subtracts, and the quantity naive risk aggregation forgets.
with union . Countable additivity forces the probabilities to settle: . A cumulative default curve is this kind of nested sequence.
01 · From Sets to Numbers
Chapter 01 built the language: a sample space , and events as subsets of it. A probability model adds one more ingredient, a rule that assigns each event a number.
There are several ways to read those numbers. A frequency reading says is the long-run fraction of runs on which occurs. A belief reading says it is the price at which you would bet on . A market-implied reading backs probabilities out of traded prices, such as default probabilities implied by credit spreads. These readings disagree about where the numbers come from, but they all agree on the rules the numbers must obey. Those rules are Kolmogorov's axioms, and every later result in this subject — Bayes' rule, expectation, the limit theorems — is derived from them.
The axioms do not tell you what is for a given firm. Estimating that is a statistics problem, taken up from Chapter 13 onward. The axioms only tell you which collections of numbers are internally consistent — and that alone rules out a surprising number of real-world risk reports.
A long-run default frequency and a probability backed out of a credit spread can be different numbers for the same event. Both still have to be non-negative, total to , and add on disjoint events. The axioms police consistency; they do not choose between a historical reading and a market-implied one. Which reading a price uses is a modeling decision made outside this chapter.
02 · The Kolmogorov Axioms
Let be a sample space. A function that assigns a real number to every event is a probability if:
- Non-negativity: for every event .
- Normalization: .
- Additivity: if , then .
Plain language: probabilities are never negative, something certainly happens, and for events that cannot happen together, the chance that one of them happens is the sum of their chances. Probability behaves like a fixed total amount of mass, , spread over the outcomes; the mass sitting on two non-overlapping regions is the sum of the two masses.
Applying additivity repeatedly extends it to any finite number of events. If are pairwise disjoint ( for ), then
In particular, for a partition of the cell probabilities sum to .
The full axiom requires the same identity for a countably infinite sequence of pairwise disjoint events. For a finite the two versions say the same thing. On a countable space such as "days until the first down day," , the countable version is what guarantees that is the sum of the outcome weights in even when is infinite. Continuous spaces (Chapter 06) need it as well, along with care about which sets count as events; nothing in this chapter depends on those details.
03 · First Consequences
Every rule below is derived from the three axioms alone. Prove each once and use it freely afterwards.
A bond has a one-year default probability of and a five-year cumulative default probability of . Let be "defaults within one year" and be "defaults within five years."
- Survival through year one: .
- Defaulting within one year implies defaulting within five, so and the numbers are consistent with monotonicity: .
- Defaulting in years two to five is , with .
A model reports a five-year cumulative default probability of and a seven-year cumulative default probability of for the same issuer.
Why it breaks: "default within five years" is a subset of "default within seven years," so monotonicity forces . Read through the difference rule, the curve implies , a negative probability.
Consequence: any price built from this curve — a seven-year credit default swap, say — is computed from an inconsistent model. Cumulative default and cumulative loss curves must be non-decreasing in the horizon; checking that is the cheapest sanity test a curve can get.
04 · Building a Probability From Outcome Weights
On a finite or countable space you never need to list for every one of the possibly many events. It is enough to give one weight per outcome.
Let be finite or countable. Choose weights with
and define, for every event ,
Then satisfies the axioms: sums of non-negative numbers are non-negative, the total weight is , and if and are disjoint, no outcome is counted in both sums. Conversely, every probability on such a space arises this way, with .
Plain language: put a non-negative weight on each outcome so the weights total one. The probability of an event is the total weight of the outcomes inside it.
An analyst models tomorrow's index return with five buckets: big down (below ), down, flat, up, big up (above ), with weights
The weights are non-negative and sum to , so this is a valid model. Then , , and by the complement rule. Nothing forces the five weights to be equal, and in a model of real returns they should not be.
If is finite and every outcome receives the same weight , then
Plain language: when all outcomes are equally likely, a probability is a count of favorable outcomes divided by a count of possible outcomes. This is where combinatorics enters probability — but it is one special choice of weights, not the definition of probability.
Model three trading days by with the uniform weight on each outcome. "At least two up days" is , so its probability is . "Up on day 2" has outcomes, also probability . "Up all three days" is the single outcome , with probability .
Someone reasons: "Over two fair trading days the number of up days is , , or , so each count has probability ."
Why it breaks: uniformity was a property of the ordered space , where each outcome has weight . The count "exactly one up day" collects two of those outcomes, and , while the counts and collect one each. The correct weights on the coarser space are , , . Merging outcomes into buckets of different sizes destroys uniformity.
Consequence: a binary option paying on "exactly one up day" would be priced at instead of — off by a third of the payoff. The same error appears in the shortcut "either the firm defaults or it does not, so the probability is 50%": two outcomes do not make two equally likely outcomes. Uniformity is a modeling claim that needs a reason, usually symmetry on the finest space.
05 · Inclusion–Exclusion
Additivity only applies to disjoint events. When events overlap, adding their probabilities counts the overlap twice.
For any events and ,
For three events,
Plain language: add the single events, subtract every pairwise overlap because it was counted twice, then add back the triple overlap because subtracting three pairs removed it once too often. The pattern continues with alternating signs for more events.
Let be "firm 1 defaults" and be "firm 2 defaults," with , , and . Then
not . By the complement rule, both survive with probability . The overlap is large relative to the marginals: firms in the same sector tend to default together.
Since , inclusion–exclusion gives two bounds that hold with no knowledge of the overlap at all:
The first is the union bound, obtained by dropping the subtracted overlap and repeating over events. The second rearranges the two-event formula using . Together with monotonicity, , they bracket what the joint behavior can be when only the marginals are known. For two events these upper and lower bounds on the intersection are the Fréchet–Hoeffding bounds. Chapter 10 returns to the same bracket once dependence is modeled directly, instead of being left as an unknown overlap.
A quarterly risk report lists three stress scenarios: rates shock with probability , equity drawdown , credit-spread blowout . It states the probability of "at least one stress event" as .
Why it breaks: the sum equals only when the scenarios are pairwise disjoint. Stress scenarios are the opposite of disjoint — a spread blowout usually arrives with an equity drawdown. Every overlap is counted more than once.
Consequence: is only an upper bound. Monotonicity gives the lower bound , since the union contains the equity drawdown. If the other two scenarios occur only alongside an equity drawdown, the true answer is . With enough listed risks, the naive sum exceeds — a reliable sign that the aggregation, not the world, is wrong. Combining risks needs the joint probabilities, not only the marginals.
Five bonds each have default probability over the year, and nothing is known about how their defaults are related. Use monotonicity and the union bound to show that lies between and . Describe a joint arrangement of defaults that attains each end of the range.
06 · Countable Spaces and Running Totals
A finite list of buckets is not always enough. "Trading day of the first down move" has one outcome per positive integer. On that space, finite additivity does not by itself control an infinite union. The countable form of the axiom does.
Let and put weight on day . These weights are positive, and the geometric series sums to one:
so the list is a probability. The first down move falls within three days with probability
and falls after day 3 with probability . There is no outcome called "never": that description is the empty set, and . Survival through days has probability , which can be made arbitrarily small and is still not the probability of an extra outcome you forgot to list. Chapter 04 derives weights of this shape from a constant daily down-move probability; here they are simply a list that obeys the axioms.
If and , countable additivity implies
The increments and are disjoint and union to , so is a partial sum of their probabilities and the infinite sum is . In the waiting-time model, increases to and increases to .
Plain language: as you lengthen the horizon, the probability of a nested event settles to the probability of everything it eventually covers. A cumulative default curve is exactly such a sequence. The number at the longest printed tenor is for that , not automatically .
A credit memo lists cumulative default probabilities of , , and at one, three, and five years, then a "total default risk" of .
Why it breaks: "default by year 1" is a subset of "default by year 3", which is a subset of "default by year 5". The already contains the . Adding the three numbers counts the early defaults once for every later tenor. Additivity applies to the increments, which are disjoint: in the first year, over the next two years, and over the two years after that.
Consequence: the five-year cumulative probability is , the last number on the curve, and the increments sum to that same . The figure is not a probability of anything in the model. Chapter 03 shows a related trap with conditional (given-survival) default probabilities, which are not increments either and can sum to more than .
07 · Exercises
Write as the disjoint union of and , apply additivity, and use non-negativity on the leftover piece. For the bound, take .
Since , the sets and are disjoint and their union is . Additivity gives , so . Non-negativity gives , so . Taking and using normalization, . Only the three axioms were used; the upper bound never had to be assumed.
Using only the three axioms, prove that implies and . Deduce that for every event.
The intersection is capped above by the smaller marginal (monotonicity) and below by . Then feed each extreme into inclusion–exclusion to get the range for the union.
Monotonicity gives . The lower bound gives . So . Inclusion–exclusion gives . The upper end means : the index never rises in a month when spreads fail to tighten. The lower end means is certain: in every month at least one of the two happens.
Let be "the index rises this month" and be "credit spreads tighten this month," with and . Which values of are consistent with the axioms? What range does that imply for , and what does each extreme say about how the two events relate?
Apply the three-event formula directly. For "exactly one," peel the overlaps off each marginal: the probability that only firm 1 defaults is minus the parts of shared with or .
(a) The marginals sum to , the pairwise overlaps to , so
(b) Only and : . Only and : . Only and : . Then only firm 1: ; only firm 2: ; only firm 3: . Exactly one default has probability . All seven pieces are non-negative and add to , which confirms both the answer in (a) and that the inputs are consistent.
(c) The naive sum overstates the true by about . The no-default probability is , not .
A basket holds three bonds with one-year default probabilities , , , pairwise joint default probabilities , , , and . (a) Find the probability of at least one default. (b) Find the probability of exactly one default. (c) By how much does simply adding the three marginals overstate the answer to (a)?
A geometric series with ratio between and sums to . Here and . "Never" is not an element of .
(a) The sum is . The first term is and the ratio is , so the sum equals . The weights are a probability. (b) . (c) The tail , which is also . (d) No outcome in is "the down move never arrives", so that description is and has probability . Survival past day is the tail , which tends to and never needs its own outcome.
Let be the day of the first down move, with weights . (a) Show that the weights sum to . (b) Compute the probability that the first down move falls on day 1 or day 2. (c) Compute the probability that it falls after day 2. (d) Why is the probability that a down move never arrives equal to in this model, even though every finite horizon still has positive probability of all up days?
08 · Chapter Summary
| Concept | Meaning |
|---|---|
| Axioms | , , additive on disjoint events |
| Complement rule | |
| Monotonicity | implies ; cumulative curves never fall |
| Outcome weights | non-negative summing to ; is the weight inside |
| Uniform model | equal weights; favorable count over total count, valid only on the right space |
| Inclusion–exclusion | add events, subtract pairwise overlaps, add back the triple overlap |
| Union bound | summing marginals gives an upper bound, not the probability of the union |
| Fréchet–Hoeffding | |
| Nested cumulatives | add the increments , never the cumulative levels themselves |
| Countable additivity | infinite disjoint unions add; waiting-time weights must sum to |
Next: Chapter 03 — Conditional Probability & Bayes, which updates probabilities once some information about the outcome has been observed.