How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Zero information is exactly independence
Statement
Assume AC. Let X,Y,Z be standard-Borel random elements. Then if and only if (independence). Also if and only if X and Y are conditionally independent given in the sense of Conditional independence given a sigma-algebra.
Facts & Assumptions
Given: AC and standard-Borel random elements X,Y,Z with their joint law.
AC is inherited from KL, standard-Borel regular conditional laws, and the conditional-independence convention. The Axiom of Choice
KL divergence is nonnegative and equals zero exactly when the two probability laws agree. Kullback–Leibler divergence is nonnegative
is the KL divergence of the joint law from its same-Z-marginal conditional-product law R. Conditional mutual information by a same-marginal product law
Conditional independence given means almost surely for all bounded measurable real f,g. Conditional independence given a sigma-algebra
Equality of conditional-expectation versions is characterized by their integrals on every conditioning event. Conditional expectation given a sigma algebra
Conditional dominated convergence passes bounded pointwise limits through conditional expectations. Conditional fatou and dominated convergence
Measurable rectangles generate the finite product sigma-algebra and determine probability measures by pi-lambda. The product sigma-algebra and its finite iterates Dynkin's pi-lambda theorem
Proof
Given: The hypotheses in the Statement.
By [F2] and [F1], exactly when , which is the stated independence condition.
By [F3] and [F1], exactly when the joint law of equals the conditional-product reference law R.
Suppose , using the coordinate order of [F3]. For all measurable A,B,C the rectangle formula for R gives By the regular conditional law identities, and are versions of the two conditional expectations in [F4]. The displayed identity says their product is the conditional-expectation version of by [F5]. Thus [F4] holds for indicators. Linearity gives it for bounded simple functions; bounded measurable functions follow by bounded simple approximation and [F6]. Conversely, [F4] applied to indicators gives the same rectangle identity, so and R agree on every rectangle . These rectangles determine the probability law by [F7], hence .
Depends on
- Measure-theoretic mutual information
- Conditional mutual information by a same-marginal product law
- Kullback–Leibler divergence is nonnegative
- Conditional independence given a sigma-algebra
- Conditional expectation given a sigma algebra
- Conditional fatou and dominated convergence
- The same-marginal conditional-product law is well-defined
- The product sigma-algebra and its finite iterates
- Dynkin's pi-lambda theorem
- The Axiom of Choice
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
63 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Robert M. Gray, Entropy and Information Theory, corrected author-hosted first edition, Chapter 2 §2.5 and Chapter 5 §5.5 (standard reference, not scraped)
- Yury Polyanskiy and Yihong Wu, MIT 6.441 Information Theory, Chapter 2 §2.4, Theorem 2.5 (standard reference, not scraped)