How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
McDiarmid bounded-differences inequality
Statement
Assume AC. Let , let be independent random elements, meaning measurable maps (Random elements and real random variables), with laws given by pushforward (Law or distribution of a random element). Put on the finite product sigma-algebra (The product sigma-algebra and its finite iterates). Let be product-measurable with . Suppose finite deterministic constants satisfy for every fixed setting of the other coordinates and every . The independent product-law theorem identifies the law of as . Applying change of variables for expectation first to and then to makes integrable and gives . Put . For , if then and if this probability is . The same bound holds for the lower tail, so the two-sided probability is at most when .
Facts & Assumptions
Given: AC, independent random elements , an integrable measurable real function of them, and the deterministic coordinate oscillation bounds in the Statement.
Assume AC, the Axiom of Choice. It is used for the conditional-expectation and conditional-Hoeffding suppliers (The Axiom of Choice).
The product-integral construction gives integrable adapted , with , , event-integral-zero differences, and predictable endpoints of width at most (Doob differences inherit coordinate oscillation widths).
Conditional expectation is the almost-sure class of integrable measurable versions satisfying all event-integral identities (Conditional expectation as an ae class).
Under AC, an integrable adapted process is a martingale when almost surely (Martingale submartingale and supermartingale).
If a martingale difference has predictable finite endpoints of deterministic width , its conditional exponential moment is at most (Conditional Hoeffding bound for bounded martingale differences).
Conditional expectation preserves the unconditional expectation (Basic algebra and order properties of conditional expectation).
A bounded measurable factor known under can be taken outside conditional expectation (Taking out what is known).
For and , (Markov's inequality for random variables).
Probability is subadditive on finite unions (Basic identities for a probability measure).
The joint law of independent random elements is the product of their marginal laws; for measurable with , change of variables applied to gives and applied to gives (Independent random elements have product joint law, Change of variables for expectation).
The real exponential is continuous and strictly increasing, positive, and satisfies and (The exponential function is strictly increasing, The exponential is positive and satisfies , The exponential addition formula ).
Every closed bounded interval with is compact (Heine-Borel by bisection: every closed bounded interval is compact).
A continuous real function is bounded on a compact subset of (A continuous real function on a compact subset of is bounded).
Proof
By [F9], the joint law of is , so the product integral in the statement is . By [F1], take the product-integral sequence and its differences . For every , [F1] gives . By [F2] and AC, is a version of , so [F3] makes a martingale. The same lemma gives finite predictable endpoints with and .
The event-integral identity of [F1] and [F2] give . Applying [F4] to these martingale differences and their endpoints gives for every real . Since the endpoints contain zero and have width at most , almost surely.
Put and . Step 2.1 bounds each difference by , hence for . This closed bounded interval is compact by [F11], and is continuous by [F10] and continuity of scalar multiplication, so [F12] makes bounded. Also is Borel: its open-set preimages are open, and the class of Borel sets whose preimages are Borel is a sigma-algebra containing the opens, hence contains the Borel sigma-algebra (The Borel sigma-algebra of a topological space). For each Borel , the preimage of under is , so this factor is -measurable. By the addition formula in [F10], ; conditional expectation preservation [F5] and taking out the known factor [F6] give . Finite induction yields .
If , all , so step 2.1 gives almost surely and . If and , then is nonnegative and implies by [F10]. Markov [F7] and step 3.1 give by the reciprocal and addition formulas in [F10]. Choosing gives the stated upper-tail bound.
Apply the same argument to for the lower-tail bound. For , [F8] combines the two tails; step 4.1 handles .
Depends on
- A continuous real function on a compact subset of $\mathbb{R}$ is bounded
- Markov's inequality for random variables
- The exponential is positive and satisfies $\exp(-x)=1/\exp(x)$
- The Borel sigma-algebra of a topological space
- Conditional expectation as an ae class
- The Axiom of Choice
- Intervals of $\mathbb{R}$: the nine order-convex forms, nondegeneracy, and length
- Law or distribution of a random element
- Martingale submartingale and supermartingale
- The product sigma-algebra and its finite iterates
- Random elements and real random variables
- The real exponential function and the number $e$ by a power series
- Conditional Hoeffding bound for bounded martingale differences
- Doob differences inherit coordinate oscillation widths
- Basic identities for a probability measure
- Basic algebra and order properties of conditional expectation
- Change of variables for expectation
- The exponential addition formula $\exp(x+y)=\exp(x)\exp(y)$
- The exponential function is strictly increasing
- Heine-Borel by bisection: every closed bounded interval $[a,b]$ is compact
- Independent random elements have product joint law
- Taking out what is known
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
100 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- John Duchi, Lecture Notes on Statistics and Information Theory, Chapter 4, §4.2.2, Proposition 4.2.5 (standard reference, not scraped)
- Colin McDiarmid, On the Method of Bounded Differences, Surveys in Combinatorics 1989, §1 (standard reference, not scraped)