Alphabeta Math
LemmaStatement: Literature-sourcedProof: AI-adaptedPipeline-generatedprecheck pending
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

Conditional mutual-information chain rule and data processing for standard-Borel variables

Statement

Assume AC. Let U,V,Y,S take values in standard-Borel spaces. Then I((U,V);Y∣S)=I(U;Y∣S)+I(V;Y∣U,S) and also I((U,V);Y∣S)=I(V;Y∣S)+I(U;Y∣V,S), where these are equalities of extended nonnegative quantities. In particular, if the conditional law of Y given (U,V,S) depends only on (V,S), then I(U;Y∣S)≤I(V;Y∣S).

Facts & Assumptions

Given: AC and standard-Borel variables U,V,Y,S with a joint law.

[A1]

The Axiom of Choice: AC is required by the standard-Borel conditional-law and KL-chain-rule suppliers.

[F1]

Standard Borel spaces and Finite products of standard Borel spaces are standard Borel: the finite product variables and their conditional laws remain standard Borel.

[F2]

Mutual-information chain rule without subtracting infinities: for standard-Borel variables, I((Z,X);Y)=I(Z;Y)+I(X;Y∣Z) as an equality in [0,+∞].

[F3]

Conditional mutual information by a same-marginal product law: conditional mutual information is the KL divergence from the same-marginal conditionally independent product law; it vanishes when that law is the actual joint law.

[F4]

KL chain rule for standard-Borel disintegrations: with a common conditioning marginal, joint KL is the integral of the conditional KLs.

[F5]

Kullback–Leibler divergence is nonnegative: every KL divergence in the statement is nonnegative.

[F6]

KL is invariant under a measurable bijection: permuting coordinates preserves KL, hence conditional mutual information is symmetric in its two unconditioned variables.

Proof

1.1A1F1F2F3F4givenalgebra

For PS-almost every s, apply [F2] to the conditional law of (U,V,Y) given S=s. It gives I((U,V);Y∣S=s)=I(U;Y∣S=s)+I(V;Y∣U,S=s). Integrate over PS; by the conditional-KL definition [F3] and disintegration chain rule [F4], the three integrals are the corresponding conditional mutual informations given S. This proves the first identity without subtracting extended values.

2.1A1F2F3F4F6givenstep 1.1algebra

Exchange the roles of U and V in step 1.1 to obtain the second identity. The symmetry of conditional mutual information between the grouped variables follows from [F6].

3.1F3F5step 1.1step 2.1givenalgebra∎

Suppose the conditional law of Y given (U,V,S) depends only on (V,S). Then U and Y are conditionally independent given (V,S), so [F3] gives I(U;Y∣V,S)=0. The two chain-rule identities in steps 1.1 and 2.1 now give I(U;Y∣S)+I(V;Y∣U,S)=I(V;Y∣S). Since I(V;Y∣U,S)≥0 by [F5], the claimed inequality follows.

Depends on

Used by

Dependency tree · two levels

74 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.

Sources