From Real-Analysis Foundations to Rigorous Measure-Theoretic Probability
11 levels · Learn at your own pace
Assumed Prerequisites
Your starting point is the four assumed prerequisite pages: Sequences and Limits, Limits of Real Functions, Continuity, IVT, EVT, and Uniform Continuity, and The Derivative and the Mean Value Theorems. Together they supply convergent and Cauchy sequences, the algebra of limits and the squeeze theorem, the ε-δ limit of a function with its one-sided and sequential forms, continuity on a set, compactness-based theorems on R (extreme value, Heine–Cantor) and the derivative with the mean value theorems. Read these before anything else: nothing in the later measure-theoretic build restates them, and the ε-δ idiom they fix is the notation in which every later estimate is written.
From that base the route runs through the remaining levels of the plan: suprema and the topology and countability of R, then σ-algebras and measures, outer measure and Carathéodory extension, Lebesgue measure and measurable functions, the integral with its convergence theorems, Lp spaces and duality, product measures and Radon–Nikodym, differentiation and covering, Radon measures, and finally the probability levels from probability spaces through limit theorems to martingales. Disclosed gaps: the catalog has no dedicated Lebesgue-measure-on-R page, no pre-measure-theoretic probability page on the route taken, and no standalone monotone class / π-λ, uniform integrability, disintegration, or characteristic-function-to-weak-convergence item; the nearest substitutes listed in the plan are used instead, and those tools are not supplied by the library in dedicated form.
Landmark definitions & theorems
- Definition: Sequences of reals: bounded, eventually, frequently, tails, subsequences
- Theorem: Algebra of limits: sums, scalar multiples, products and quotients
- Theorem: The squeeze theorem
- Definition: The ε-δ limit lim_x → c f(x) = L of f : A → ℝ at a limit point c of A
- Theorem: Heine criterion: lim_x → c f(x) = L iff f(xₖ) → L for every sequence in A ∖ {c} converging to c
- Theorem: Sums, scalar multiples, products and quotients of function limits, the quotient under the hypothesis that the denominator limit is nonzero
- Theorem: If f ≤ g ≤ h near c and f and h have the same limit at c, then so does g
- Definition: Continuity of f : A → ℝ at a point of A and on A: the ε-δ condition, its agreement with lim_x → c f(x) = f(c) at a limit point, and continuity at an isolated point
- Theorem: Sums, scalar multiples, products, absolute values, maxima, minima and quotients with nonvanishing denominator of continuous functions are continuous, as are constants, the identity and every polynomial function
- Theorem: A composite of continuous functions is continuous, with no side hypothesis of the kind the composition of limits needs
- Theorem: f : A → ℝ is continuous on A if and only if the preimage of every open subset of ℝ is the intersection with A of an open subset of ℝ, and dually for closed sets
- Theorem: Extreme value theorem: a continuous real function on a nonempty compact subset of ℝ attains a greatest and a least value
- Theorem: Intermediate value theorem, by bisection with a canonical left-half rule: a continuous function on [a,b] takes every value between f(a) and f(b)
- Definition: Uniform continuity of f : A → ℝ: one δ serving every pair of points of A
- Theorem: Heine-Cantor in ℝ: a continuous real function on a compact subset of ℝ is uniformly continuous
- Definition: The derivative f'(c) = lim_x → c f(x) - f(c)/x - c of f : A → ℝ at a point c ∈ A that is a limit point of A, and differentiability on a set
- Theorem: Carathéodory's characterisation: f is differentiable at c if and only if there is φ : A → ℝ, continuous at c, with f(x) - f(c) = φ(x)(x - c) for every x ∈ A, and then φ is unique and φ(c) = f'(c)
- Theorem: Sums, scalar multiples, products and quotients: (f+g)'(c) = f'(c) + g'(c), (α f)'(c) = α f'(c), (fg)'(c) = f'(c)g(c) + f(c)g'(c), and (f/g)'(c) = (f'(c)g(c) - f(c)g'(c))/g(c)² when g(c) ≠ 0
- Theorem: The chain rule, in one line from Carathéodory: if g is differentiable at c and f is differentiable at g(c), then f ∘ g is differentiable at c with (f ∘ g)'(c) = f'(g(c)) g'(c)
- Theorem: Rolle's theorem: if a < b, f is continuous on [a,b], differentiable at every point of (a,b), and f(a) = f(b), then f'(c) = 0 for some c ∈ (a,b)
- Theorem: Cauchy's mean value theorem: for f, g continuous on [a,b] with a<b and differentiable on (a,b) there is c ∈ (a,b) with (f(b)-f(a))g'(c) = (g(b)-g(a))f'(c); no hypothesis on g' is needed in this product form
Section 1: Foundations of the Real Numbers and Set-Theoretic Setting
This section builds the real-analytic and set-theoretic foundation that Sections 2–11 will consume. Begin with Foundations of the Real Numbers: the field and ordered-field axioms, the least-upper-bound property, and the uniqueness of the complete ordered field establish ℝ as the ambient object on which Lebesgue measure will be built. From your stated background you have limits and continuity for single-valued functions; the field-theoretic material (def-field, def-ordered-field, def-abs-value, def-canonical-natural) is not implied by that background, so read it rather than skim it, since σ-algebras and measures are defined over subsets of structures carrying these operations. Suprema and Infima then converts the least-upper-bound property into the infimum machinery (thm-infimum-property) used whenever you take monotone limits of measures.
Topology of ℝ supplies the vocabulary for Borel sets and for regularity: open and closed sets, closure and interior, limit points, compactness, and the countable decomposition of open sets. These are the exact inputs for σ-algebras and Borel sets in Section 2, so do not skip the closure characterisations or Heine–Borel. Countability and Uncountability is the bridge to the measure-theoretic setting: equinumerosity, Schröder–Bernstein, countable products and unions, Cantor's theorem, and the uncountability of ℝ explain why countable additivity is the right axiom and why non-measurable sets in Section 2 require a choice principle. Note the library gap: countable unions of countable sets assume the Axiom of Countable Choice, and no page here constructs Lebesgue measure on ℝ directly; that begins in Section 2. Landmark results in this section include def-complete-ordered-field, thm-uniqueness-complete-ordered-field, thm-infimum-property, thm-heine-borel-characterisation-r, thm-closure-characterisations-r, def-countable, thm-schroder-bernstein, and thm-r-uncountable.
Landmark definitions & theorems
- Definition: Ordered field
- Definition: Complete ordered field (least-upper-bound property)
- Theorem: Uniqueness of the complete ordered field: ℝ up to a unique isomorphism
- Theorem: Every complete ordered field is Archimedean
- Theorem: Every nonempty set bounded below has an infimum
- Definition: Open subset of ℝ (every point has a neighbourhood inside it), closed subset (complement open), and clopen
- Theorem: The closure equals the set together with its limit points, equals the set of points every neighbourhood of which meets it, and is the smallest closed superset; a set is closed iff it contains its limit points
- Theorem: Every open subset of ℝ is a countable disjoint union of open intervals, namely its order components
- Theorem: A subset of ℝ is compact if and only if it is closed and bounded
- Definition: Finite, countably infinite, countable, uncountable
- Theorem: The Schröder-Bernstein theorem
- Theorem: Countable unions of at most countable sets, assuming AC_ω
- Theorem: ℚ is countably infinite
- Theorem: Cantor's theorem: A ≺ P(A)
- Theorem: ℝ is uncountable (Cantor's nested intervals, 1874)
Section 2: Measure Spaces and Sigma-Algebras
This section builds the measure-theoretic scaffolding you need for probability, starting only from your real-analysis background (sequence and function limits, continuity, differentiability). Begin with Sigma Algebras and Borel Sets, working through Algebras of subsets, Sigma-algebras, Measurable spaces and measurable sets, and The sigma-algebra generated by a family of sets together with its existence and minimality theorem. The generator machinery then pays off in Dynkin's pi-lambda theorem and The monotone class generated by an algebra equals the sigma-algebra it generates, and in The Borel sigma-algebra of a topological space via Seven generating families for the Borel sigma-algebra on the real line.
Next, Measures and Their Basic Properties introduces Measures on sigma-algebras, Measure spaces, and continuity from below/above, with subadditivity and the first Borel-Cantelli lemma already in a form probability will reuse. Then Outer Measure and the Caratheodory Extension Theorem supplies Outer measures, Carathéodory's theorem, Premeasures on algebras, and the extension and uniqueness theorems, giving the construction route to Lebesgue measure. Finally Non Measurable Sets and the Cost of Choice shows why the axioms are needed: Vitali sets, Bernstein sets, and the failure of translation-invariant measures on all subsets. Landmark definitions and theorems: Sigma-algebras; Measurable spaces; The sigma-algebra generated by a family of sets and its existence/minimality; The Borel sigma-algebra; Dynkin's pi-lambda theorem; The monotone class theorem; Measures on sigma-algebras; Measures on sigma-finite pi-systems uniqueness; Outer measures; Carathéodory's theorem; Premeasures and the Carathéodory extension theorem; Vitali set non-measurability and the no-translation-invariant-measure theorem.
Landmark definitions & theorems
- Definition: Sigma-algebras
- Definition: Measurable spaces and measurable sets
- Definition: The sigma-algebra generated by a family of sets
- Theorem: Nonempty intersections of sigma-algebras are sigma-algebras, so the generated sigma-algebra exists and is minimal
- Definition: The Borel sigma-algebra of a topological space
- Theorem: Seven generating families for the Borel sigma-algebra on the real line
- Theorem: Dynkin's pi-lambda theorem
- Theorem: The monotone class generated by an algebra equals the sigma-algebra it generates
- Definition: Measures on sigma-algebras
- Definition: Measure spaces
- Theorem: Measures agreeing on a generating pi-system are equal under an increasing finite-measure exhaustion from that pi-system
- Definition: Outer measures
- Theorem: Carathéodory's theorem: measurable sets form a sigma-algebra carrying a complete measure
- Definition: Premeasures on algebras of sets
- Theorem: Assuming countable choice, a premeasure extends through its induced outer measure
- Theorem: Assuming the Axiom of Choice, a Vitali set is not Lebesgue measurable
- Theorem: Assuming the Axiom of Choice, no translation-invariant measure on P(ℝ) is both finite and nonzero on [0,1]
Section 3: Lebesgue Measure and Measurable Functions
This section builds the Lebesgue measure machinery on that the probability sections later rely on, starting from limits and continuity in real analysis and ending at measurable functions and the standard modes of convergence. It opens with half-open boxes and their volume, then passes to elementary sets and the well-definedness of elementary volume as a finitely additive, sigma-finite premeasure, which is the input to the Carathéodory construction. Lebesgue outer measure is then defined as the induced outer set function (with the countable-choice hypothesis recorded explicitly wherever it is used), and Lebesgue measurable sets and are introduced via the Carathéodory criterion. From there the section develops the structural results: is a complete measure extending elementary volume, every Borel set is measurable, boxes of every face convention have the expected measure, and outer and inner regularity, the Littlewood equivalences, and the agreement of nullity with the covering definitions are established. Metric and geometric properties follow (translation invariance, dilation and linear scaling, uniqueness of the normalised translation-invariant Borel measure, nullity of hyperplanes, and Steinhaus's difference-set theorem). The second page turns to measurable functions: threshold characterisations, the generating-family criterion, closure under arithmetic, lattice and sequential operations, and the explicit increasing simple approximation of nonnegative measurable functions, together with almost-everywhere equality and Doob–Dynkin factorisation. The third page treats modes of convergence — almost everywhere, in measure, almost uniform, and in — and their interrelations, culminating in Riesz's subsequence theorem, Egorov's theorem, Lusin's theorem, and the Vitali convergence theorem. Library gaps: there is no dedicated standalone page for monotone-class/Dynkin arguments or for uniform integrability as its own topic; the relevant material sits inside the listed items.
Landmark items: half-open boxes and volume; elementary sets as finite unions of boxes; well-definedness of elementary volume; elementary volume as a sigma-finite premeasure; Lebesgue outer measure; outer-measure and agreement theorem (under countable choice); Lebesgue measurable sets and ; completeness of Lebesgue measure; dyadic cubes and the countable disjoint dyadic decomposition of open sets; Borel sets are Lebesgue measurable; measure of a box of every kind; outer regularity; Littlewood's four characterisations; inner regularity by compact sets; agreement of nullity with closed-interval and closed-cube covers; Jordan measurability implies Lebesgue measurability with equal content; translation invariance; dilation and reflection scaling; uniqueness of the normalised translation-invariant Borel measure; linear scaling by invertible maps; nullity of affine hyperplanes and proper subspaces; linear change of variables; Steinhaus difference-set theorem; the generating-family criterion; threshold characterisations of measurability; sequential suprema, infima and limits are measurable; increasing simple approximation of nonnegative measurable functions; Doob–Dynkin lemma; Riesz's subsequence theorem; Egorov's theorem; Lusin's theorem; the Vitali convergence theorem.
Landmark definitions & theorems
- Definition: Half-open boxes in ℝⁿ and their volume
- Definition: Elementary sets: the finite unions of half-open boxes in ℝⁿ
- Theorem: The sum of the volumes of a disjoint box decomposition of an elementary set does not depend on the decomposition
- Theorem: Elementary volume is a sigma-finite premeasure on the algebra of elementary sets
- Definition: Lebesgue outer measure on ℝⁿ
- Theorem: Assuming countable choice, Lebesgue outer measure is an outer measure that restricts to elementary volume
- Definition: Lebesgue measurable sets, the family L(ℝⁿ), and the restricted set function λₙ
- Theorem: Assuming countable choice, L(ℝⁿ) is a sigma-algebra containing every elementary set and λₙ is a complete measure extending elementary volume
- Theorem: Every open subset of ℝⁿ is the union of a countable pairwise disjoint family of dyadic cubes
- Theorem: Assuming countable choice, every Borel subset of ℝⁿ is Lebesgue measurable
- Theorem: A box in ℝⁿ with parameters aᵢ≤ bᵢ is Lebesgue measurable of measure ∏_i<n(bᵢ-aᵢ), whichever of its faces are included
- Theorem: Assuming countable choice, the Lebesgue outer measure of an arbitrary subset of ℝⁿ is the infimum of the measures of the open sets containing it
- Theorem: Assuming countable choice, four equivalent descriptions of a Lebesgue measurable subset of ℝⁿ
- Theorem: Assuming countable choice, the Lebesgue measure of a measurable set is the supremum of the measures of its compact subsets
- Theorem: A subset of ℝ has Lebesgue outer measure zero if and only if it has measure zero in the sense of countable closed-interval covers
- Theorem: A subset of ℝᵐ has Lebesgue outer measure zero if and only if it is null in the sense of countable closed-cube covers
- Theorem: Lebesgue outer measure is at most Jordan outer content, and a bounded Jordan measurable set is Lebesgue measurable with Lebesgue measure equal to its Jordan content
- Theorem: Lebesgue outer measure, Lebesgue measurability and Lebesgue measure are unchanged by translation
- Theorem: For a nonzero real c, dilation by c multiplies Lebesgue outer measure by |c|ⁿ, and reflection in the origin preserves it
- Theorem: A translation-invariant measure on the Borel sets of ℝⁿ giving the unit cube measure one is the restriction of Lebesgue measure
- Theorem: An invertible linear map of ℝⁿ scales the Lebesgue measure of every Borel set by a positive constant depending only on the map
- Theorem: Every affine hyperplane of ℝⁿ, and hence every proper linear subspace, is Lebesgue null
- Theorem: A linear map T of ℝⁿ sends Lebesgue measurable sets to Lebesgue measurable sets, with λₙ(T[E])=|det T| λₙ(E) when T is invertible and T[E] Lebesgue null when it is not
- Theorem: If a Lebesgue measurable subset of ℝⁿ has positive measure, its difference set contains an open ball about the origin
- Theorem: A generating family on the codomain suffices to test measurability
- Theorem: Threshold characterisations of real-valued and extended-real-valued measurability
- Theorem: Sequential suprema, infima, limsup, liminf, and pointwise limits of measurable functions are measurable
- Theorem: Every nonnegative measurable function admits an explicit increasing sequence of simple approximations
- Theorem: Doob-Dynkin factorization through the sigma-algebra generated by a function
- Theorem: Riesz's subsequence theorem for convergence in measure
- Theorem: Egorov's theorem
- Theorem: Assuming countable choice, Lusin's theorem on finite-measure subsets of ℝⁿ
- Theorem: Vitali convergence theorem on finite and sigma-finite measure spaces
Section 4: Integration and Convergence Theorems
This section builds the integration machinery needed before a rigorous measure-theoretic introduction to probability. It assumes only single-variable real analysis: limits of sequences and functions, continuity, and differentiability. Starting from extended-real-valued measurable functions, it develops nonnegative simple functions, the simple integral, and the nonnegative Lebesgue integral over a measurable subset. The convergence theorems are the core: monotone convergence, Fatou's lemma, dominated convergence, and the identification of the indefinite integral as a measure with density. These yield additivity, linearity on L¹, the integral triangle inequality, almost-everywhere criteria, Chebyshev–Markov, Jensen, and absolute continuity of the integral. Two comparison pages relate the Lebesgue and Riemann integrals, including Riemann–Stieltjes versus Lebesgue–Stieltjes, and fix the pointwise extended-real product convention. Two library gaps matter: no standalone Lebesgue-measure-on-R page and no monotone class/Dynkin theorem are supplied, so both are left to other sections; elementary probability is also absent by design, as the target is the measure-theoretic route.
Landmark results include monotone convergence for the integral, Fatou's lemma, a nonnegative integral vanishing exactly on almost-everywhere zero functions, dominated convergence, absolute continuity of the integral, Jensen's inequality for probability measures, the agreement of bounded Riemann integrable functions with their Lebesgue integrals, and the Riemann–Stieltjes/Lebesgue–Stieltjes agreement for continuous integrands.
Landmark definitions & theorems
- Theorem: Monotone convergence for the integral
- Theorem: Fatou's lemma
- Theorem: A nonnegative measurable function has integral 0 exactly when it vanishes almost everywhere
- Theorem: Dominated convergence
- Theorem: Absolute continuity of the integral
- Theorem: Jensen's integral inequality for a probability measure
- Theorem: A bounded Riemann integrable function on a closed bounded interval is Lebesgue measurable and has the same integral
- Theorem: For a continuous integrand, the Riemann-Stieltjes and Lebesgue-Stieltjes integrals agree
Section 5: Lp Spaces and Duality
This section builds the Lp machinery needed for a rigorous measure-theoretic introduction to probability. It begins by fixing the standing objects: conjugate exponents (including the endpoint convention 1/∞=0), the essential supremum used to define the p=∞ size of a measurable function, the class L^p(μ) for 0<p<∞ and the space L^∞(μ) of essentially bounded functions, the null subspace N(μ) of functions vanishing almost everywhere, and the quotient L^p(μ) by almost-everywhere equivalence.
With these in place, the core analytic inequalities and completeness results are supplied, so that the Lp scale is available as a family of complete normed spaces for probability-theoretic work.
Landmark definitions & theorems
- Theorem: Holder's inequality for integrals, including the endpoint cases
- Theorem: Minkowski's inequality for integrals, including p = ∞
- Theorem: Riesz-Fischer completeness of Lᵖ for 1 ≤ p ≤ ∞
- Theorem: On a sigma-finite measure space, every bounded linear functional on Lᵖ is integration against a unique L^q function
Section 6: Product Measures, Fubini–Tonelli, and Radon–Nikodym
This section fuses the product-measure machinery with the Hahn–Jordan and Radon–Nikodym theory, providing the two measure-theoretic pillars on which rigorous probability rests: iterated integration for joint laws and density-based conditioning. On the product side, the section defines measurable rectangles, the product sigma-algebra and its finite iterates, and the horizontal and vertical sections of sets and functions; it shows that sections of product-measurable sets and functions remain measurable, that the two section-measure integrals of a product-measurable set agree for sigma-finite factors, and constructs the product measure with its rectangle formula, sigma-finiteness, and uniqueness. Tonelli's theorem then identifies the double integral of a nonnegative measurable function on a sigma-finite product with the two iterated integrals, and Fubini's theorem extends this to L1 functions, showing that almost every section is integrable and the three integrals coincide. Variants for the completed product relax section measurability to hold only almost everywhere. Euclidean consistency is established: Borel products of Euclidean spaces are Euclidean Borel, the product of Lebesgue measures agrees with Lebesgue measure on Borel sets, and Euclidean Lebesgue measure is the completion of that product. The layer-cake formula computes the integral of a power from the distribution function, and polar-coordinate and C1 change-of-variables formulas are available. On the signed side, the section defines signed and complex measures, positive, negative, and null sets, total variation, mutual singularity, and absolute continuity; it proves the Hahn and Jordan decompositions, the finiteness of complex-measure total variation, and the fact that total variation is itself a measure. Integration against signed and complex measures is developed through simple integrals, dominated simple approximations, and the variation bound. Lebesgue decomposition and the Radon–Nikodym theorem supply densities unique up to almost-everywhere equality, together with additivity, chain-rule, epsilon-delta, and polar-decomposition results. A final strand treats absolute continuity of functions on a compact interval: derivatives exist almost everywhere, the sharp fundamental theorem of calculus characterizes absolutely continuous functions, and integration by parts and change of variables are derived. Standard probability tools such as uniform integrability and the monotone class theorem have no dedicated library identifiers here and are not assumed.
Landmark items: the iterated-section-measure agreement for sigma-finite measures; existence, rectangle formula, and uniqueness of the sigma-finite product measure; Tonelli's theorem for nonnegative functions; Fubini's theorem for L1 functions; the Hahn decomposition; the Jordan decomposition; finiteness of complex total variation; the Lebesgue decomposition for sigma-finite signed measures; the Radon–Nikodym density existence and uniqueness; the chain rule for Radon–Nikodym derivatives; the polar decomposition of finite signed and complex measures; the Euclidean Lebesgue measure as the completion of the product; the layer-cake formula; the polar-coordinates formula; the fundamental theorem of calculus for absolutely continuous functions; integration by parts; change of variables for increasing absolutely continuous maps; the Banach–Zarecki characterization; and constancy of absolutely continuous functions with zero derivative almost everywhere.
Landmark definitions & theorems
- Theorem: For sigma-finite measures, the two section-measure integrals of a measurable set agree
- Theorem: For sigma-finite factors, the product measure exists, has the rectangle formula, is sigma-finite, and is unique
- Theorem: Tonelli's theorem for nonnegative measurable functions on a sigma-finite product
- Theorem: Fubini's theorem for L¹ functions on a sigma-finite product
- Theorem: Hahn decomposition for signed measures, unique up to total-variation-null sets
- Theorem: Jordan decomposition of a signed measure into unique mutually singular positive parts
- Theorem: Every complex measure has finite total variation
- Theorem: Every sigma-finite signed measure admits a Lebesgue decomposition relative to a sigma-finite positive measure
- Theorem: A sigma-finite signed measure that is absolutely continuous with respect to a sigma-finite positive measure has a unique almost-everywhere density
- Theorem: Radon-Nikodym derivatives satisfy the chain rule along nu << mu << lambda
- Theorem: Every finite signed or complex measure has a polar decomposition against its total variation
- Theorem: The Euclidean Lebesgue measure is the completion of the product of the factor Lebesgue measures
- Theorem: For 0 < p < ∞, the layer-cake formula computes the integral of |f|ᵖ from the distribution function
- Theorem: Polar coordinates decompose Lebesgue measure into rⁿ⁻¹ dr dσ
- Theorem: Fundamental theorem of calculus for absolutely continuous functions
- Theorem: Integration by parts for absolutely continuous functions
- Theorem: Change of variables for an increasing absolutely continuous function
- Theorem: Banach--Zarecki characterisation of absolute continuity
- Theorem: An absolutely continuous function with zero derivative almost everywhere is constant
Section 7: Differentiation, Covering, and Distribution Functions
This section supplies the measure-theoretic differentiation and distribution-function machinery needed before a rigorous introduction to probability. It works through three library reading pages in order. The first page, Differentiation of Monotone Functions and the Vitali Covering Theorem, develops Dini derivatives, fine and Vitali covers on the line, Riesz's rising-sun lemma, the one-sided Hardy–Littlewood inequalities, and the almost-everywhere differentiability of monotone functions, together with the jump/continuous split and Fubini's term-by-term differentiation for series of increasing functions. The second page, The Maximal Function and Lebesgue Differentiation, moves to R^n: locally integrable functions, ball averages, centered and uncentered maximal functions, weak and strong type (p,q) operators, Lebesgue points, density, families shrinking nicely, the fivefold-dilate Vitali lemma, the weak (1,1) maximal inequality, Marcinkiewicz interpolation, the Lebesgue differentiation theorem, the density theorem, differentiation of Borel measures finite on compact sets, and the L^1 fundamental theorem of calculus. The third page, Lebesgue–Stieltjes Measures and Distribution Functions, constructs the half-open interval algebra, the Stieltjes premeasure, the Lebesgue–Stieltjes measure, uniqueness, normalized distribution functions, interval formulas and atoms, regularity, the Cantor measure, and the atomic-plus-atomless decomposition of finite Borel measures. Missing prerequisites assumed from earlier sections are sigma-algebras, measures, outer measure and Carathéodory extension, measurable functions, the Lebesgue integral with its convergence theorems, L^p spaces, and the Radon–Nikodym and Lebesgue decomposition theorems; these are not re-derived here. No dedicated library page on the monotone class or pi-lambda theorem, and none explicitly on uniform integrability, appears in the supplied catalog; the reader should note these as library gaps when proceeding to probability.
Landmark results to anchor the reading: Dini derivatives always exist in the extended reals and detect finite differentiability; Riesz's rising-sun lemma with its endpoint conclusion; the Vitali covering theorem for fine covers on the line; the monotonicity of monotone functions' almost-everywhere differentiability by the rising-sun and Lebesgue–Stieltjes routes; the derivative of a nondecreasing function is measurable, integrable, and bounded by its total increase; the unique absolutely-continuous plus jump plus singular-continuous decomposition; bounded-variation functions are differentiable almost everywhere; the fivefold-dilate Vitali covering lemma for balls; the centered Hardy–Littlewood maximal operator is weak type (1,1); Marcinkiewicz interpolation; the Lebesgue differentiation theorem on R^n; almost every point is a Lebesgue point; the Lebesgue density theorem; differentiation along families shrinking nicely; differentiation of sigma-finite Borel measures finite on compact sets; the L^1 fundamental theorem of calculus; existence, uniqueness, and the correspondence theorem for Lebesgue–Stieltjes measures; and the atomic-plus-atomless decomposition of finite Borel measures.
Landmark definitions & theorems
- Theorem: Riesz's rising sun lemma with the correct endpoint conclusion
- Theorem: The Vitali covering theorem for fine covers on the real line
- Theorem: A monotone function is differentiable almost everywhere by the rising-sun route
- Theorem: A monotone function is differentiable almost everywhere by the Lebesgue-Stieltjes route
- Theorem: For a nondecreasing function, the derivative is measurable and integrable and its integral is bounded by the total increase
- Theorem: A right-continuous nondecreasing function splits uniquely as absolutely continuous plus jump plus singular continuous
- Theorem: Every function of bounded variation is differentiable almost everywhere
- Theorem: Vitali covering lemma for Euclidean balls with fivefold dilates
- Theorem: The centered Hardy-Littlewood maximal operator is weak type (1,1)
- Theorem: Marcinkiewicz interpolation from weak (1,1) and strong (∞,∞)
- Theorem: Lebesgue differentiation theorem on ℝⁿ
- Theorem: Almost every point is a Lebesgue point of a locally integrable function
- Theorem: Lebesgue density theorem
- Theorem: Differentiation holds along families shrinking nicely
- Theorem: Differentiation of sigma-finite Borel measures finite on compact sets
- Theorem: The indefinite integral of an L¹ function is differentiable almost everywhere
- Theorem: Assuming countable choice, a nondecreasing right-continuous function defines a Borel measure on ℝ
- Theorem: Assuming countable choice, finite-on-compacts Borel measures on ℝ correspond to nondecreasing right-continuous functions modulo constants
Section 8: Measures on Metric Spaces and Regularity
This section supplies the two measure-theoretic pillars that a rigorous introduction to probability leans on, and it presupposes only the real-analysis material already accumulated: limits of sequences and functions, continuity, differentiability, and the earlier sections of this course on measure spaces, integration, Lp spaces, and product measures. The first pillar is the Riesz–Markov–Kakutani theory: positive linear functionals on C_c(X) over a locally compact Hausdorff space are represented by integration against a Radon measure, and the representing measure is unique. The building blocks are the definitions of C_c and C_0, of the cutoff relation f≺U, of positive functionals, and of Radon, regular, and regular complex Borel measures. The construction proceeds through the functional outer content, Carathéodory measurability of open sets, inner regularity on opens, and the representation and uniqueness theorems.
Companion results identify when locally finite Borel measures are regular and record that Lebesgue measure on R^n is Radon, with applications to Lusin's theorem, density of C_c in Lp, and the dual of C_0. The second pillar develops density, separability, and convolution in Lp: simple functions, box steps, and C_c (then C_c^∞) are dense, rational box steps give a countable dense set, countably generated sigma-finite spaces yield separable Lp while L^∞[0,1] is not separable, translation is continuous in Lp, and convolution is treated through existence and the L1 bound, Young's and Minkowski's integral inequalities, smoothness of mollifier convolutions, and convergence of approximate identities in Lp. Library gaps: the catalog has no dedicated page on monotone-class/Dynkin arguments, on uniform integrability as a standalone topic, or on pre-measure-theoretic elementary probability; these would need separate sourcing before the probability sections. No page on Lebesgue measure of the line alone is present, though Euclidean-space material covers it.
Landmark definitions & theorems
- Theorem: Positive functionals on C_c(X) are integration against a Radon measure
- Theorem: Assuming Dependent Choice, uniqueness of the RMK representing measure among Radon measures
- Theorem: The bounded complex dual of C₀(X) is regular complex measures
- Theorem: Lebesgue measure is a Radon measure on Rⁿ
- Theorem: C_c(X) is dense in Lᵖ(μ) for a Radon measure
- Theorem: Simple functions with finite-measure support are dense in Lᵖ(μ) for 1 ≤ p < ∞
- Theorem: ‖τ_h f - f‖ₚ → 0 in Lᵖ(ℝⁿ) as h → 0, for 1 ≤ p < ∞
- Theorem: Young's convolution inequality under Countable Choice
- Theorem: If μ is sigma-finite and A is countably generated, then Lᵖ(μ) is separable for 1 ≤ p < ∞
Section 9: Probability Foundations (Measure-Theoretic)
This section builds the measure-theoretic probability machinery needed for a rigorous introduction to probability theory, starting from the supplied real-analysis prerequisites (limits of sequences, limits of functions, continuity and differentiability) and the preceding measure, integration, Lp, product-measure, and distribution-function material. The three reading pages develop probability spaces, random variables and expectation; independence, Borel–Cantelli and zero-one laws; and the modes of convergence for random variables.
Landmark results anchor each stage: the correspondence between laws and distribution functions, the change-of-variables formula for expectation, Jensen's inequality, the normal equations for best affine L2 prediction, factorization of expectations over independent variables, and the relation between convergence notions. Library gaps are disclosed in the plan: there is no standalone Lebesgue-measure-on-R page, no dedicated monotone-class/Dynkin theorem item, no standalone uniform-integrability page, and advanced Borel–Cantelli and disintegration material is absent; these are not assumed and are not invented.
Landmark definitions & theorems
Section 10: Independence, Infinite Products, and Limit Theorems
This section assembles, from the six listed reading pages, the measure-theoretic machinery that carries the reader from real-analysis limits, continuity and differentiability to a rigorous introduction to probability. It has two arcs. The first constructs probability measures on infinite products: finite-coordinate cylinders, their sigma-algebra, consistent finite-dimensional laws, and Kolmogorov extension for standard-Borel coordinates, so that a stochastic process is pinned down by its finite-dimensional distributions. The second arc develops limit theorems on the resulting spaces: weak laws via Chebyshev and truncation for independent arrays, strong laws via the Kolmogorov maximal inequality, the convergence criterion and three-series theorem, central limit theorems from Lindeberg-Levy through Lindeberg-Feller and the multivariate case, characteristic functions with inversion and the Levy continuity theorem, and weak convergence, tightness, Prokhorov and Skorokhod representation on Polish spaces.
Library gaps are disclosed: the catalog has no dedicated monotone-class/pi-lambda page, no standalone uniform-integrability page, no pre-measure-theoretic discrete-probability page, and treatment of characteristic functions versus weak convergence is distributed across two pages rather than one. Reachability of the stated real-analysis prerequisites from the assumed pages is not verified by this library section, so those prerequisite pages must be read first. Landmark definitions and theorems (non-exhaustive): Kolmogorov extension for standard-Borel coordinates; countable products of probability spaces; process laws determined by finite-dimensional distributions; Kolmogorov maximal inequality and convergence criterion; Kolmogorov three-series theorem; Kolmogorov IID L1 strong law and its necessity of integrability; Lindeberg-Levy and Lindeberg-Feller central limit theorems with the Feller converse; uniqueness of a law from its characteristic function, Levy inversion and the Levy continuity theorem; the Cramer-Wold device; the Portmanteau theorem; Prokhorov tightness theorem; Skorokhod representation; Levy-Prokhorov metric metrizing weak convergence; plus the constituent definitions of cylinders, consistency, IID, truncation, tightness and characteristic functions.
Landmark definitions & theorems
- Theorem: Assuming the Axiom of Choice, Kolmogorov extension for arbitrary families of standard Borel coordinate spaces
- Theorem: Assuming countable and dependent choice, countable products of arbitrary probability spaces
- Theorem: Finite-dimensional distributions determine a process law on the cylinder sigma-algebra
- Theorem: Kolmogorov maximal inequality
- Theorem: Kolmogorov convergence criterion
- Theorem: Kolmogorov three-series theorem
- Theorem: Kolmogorov iid l1 strong law
- Theorem: Integrability is necessary for an iid finite mean strong law
- Theorem: Lindeberg-Levy iid central limit theorem
- Theorem: Lindeberg-Feller central limit theorem: sufficiency
- Theorem: Feller converse to Lindeberg-Feller
- Theorem: Multivariate iid central limit theorem
- Theorem: Uniqueness of a law from its characteristic function
- Theorem: Levy inversion formula
- Theorem: Levy continuity theorem converse
- Theorem: Cramer wold device
- Theorem: Portmanteau theorem
- Theorem: Prokhorov tightness theorem on polish spaces
- Theorem: Skorokhod representation on polish spaces
- Theorem: Levy prokhorov metric metrizes weak convergence
Probability Math library
- Infinite Product Measures and Kolmogorov ExtensionWorked examples
- Weak Laws and Series of Independent Random VariablesWorked examples
- Strong Laws of Large NumbersWorked examples
- Central Limit TheoremsWorked examples
- Characteristic Functions Inversion and ContinuityWorked examples
- Weak Convergence Tightness and RepresentationWorked examples
Section 11: Conditional Expectation and Martingales
This section builds the measure-theoretic machinery for a rigorous introduction to probability, starting from real analysis (limits, continuity, differentiability) and the preceding measure-theory sections. It opens with conditional expectation, defined via the Radon–Nikodym theorem, then develops its algebra, order, convergence, Jensen, and L2-projection properties, together with uniform integrability of conditional expectations. Conditional distributions and regular conditional probability follow, using measure and probability kernels, kernel integration measurability, disintegration of joint laws on standard Borel spaces, conditional density formulas, and Bayes' formula for dominated kernels. Discrete-time martingales are then introduced through filtrations, adapted integrable processes, natural filtrations, martingale differences, convex-function submartingales, predictable processes, martingale transforms, Doob decomposition, and predictable quadratic variation.
Martingale inequalities and convergence cover upcrossing numbers, Doob's submartingale convergence and L1/Lp maximal inequalities, Lp-bounded and uniformly integrable convergence, the closed martingale characterization, reverse martingales, Lévy upward and downward convergence, Azuma–Hoeffding, and the martingale central limit theorem. Stopping times conclude the section with the sigma-algebra at a stopping time, stopped processes, the stopped-martingale theorem, optional sampling for bounded times, and optional stopping under uniform integrability, integrable time with bounded increments, and a dominating integrable variable. Library gaps remain: no dedicated Lebesgue-measure-on-R page, no standalone monotone class or Dynkin pi-lambda page, no standalone uniform integrability page, and limited disintegration and conditional Borel–Cantelli material, so those prerequisites are not assumed as supplied.
Landmark definitions & theorems
- Definition: Conditional expectation given a sigma algebra
- Theorem: Conditional expectation exists by radon nikodym
- Theorem: Tower property of conditional expectation
- Theorem: Conditional jensen inequality
- Theorem: Conditional expectation is the l2 orthogonal projection
- Definition: Regular conditional distribution
- Theorem: Existence of regular conditional distributions for standard borel targets
- Theorem: Disintegration of a joint law on standard borel spaces
- Theorem: Bayes formula for dominated kernels
- Definition: Martingale submartingale and supermartingale
- Theorem: Doob decomposition of an integrable adapted process
- Theorem: Square minus predictable quadratic variation is a martingale
- Theorem: Doob submartingale convergence theorem
- Theorem: Doob L1 maximal inequality
- Theorem: Doob Lp maximal inequality
- Theorem: Uniformly integrable martingale convergence
- Theorem: Closed martingale characterization
- Theorem: Levy upward convergence of conditional expectations
- Theorem: Azuma-Hoeffding inequality
- Theorem: Martingale central limit theorem
- Definition: Discrete stopping time
- Theorem: A stopped martingale is a martingale
- Theorem: Optional sampling for bounded stopping times
- Theorem: Optional stopping under uniform integrability