How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
KL divergence between equal-variance Gaussian location laws
Statement
Assume AC and let and . For the normal location laws with common variance ,
Facts & Assumptions
Given: AC, real means , and a positive scale .
The Axiom of Choice: AC supplies the normal-law construction and the Radon–Nikodym assumptions used by the KL definition.
Standard normal and normal laws: is the law of when has standard normal law, whose density is .
The standard normal density has total mass one: is a probability density on .
AC supplies countable selections and prescribed serial paths: AC supplies countable choice, the axiom required by the change-of-variables supplier.
A C^1 diffeomorphism satisfies the change-of-variables formula for nonnegative Lebesgue measurable functions: for a diffeomorphism and nonnegative measurable , .
Integrating against a density agrees with integrating the product: for nonnegative measurable .
The natural logarithm as the inverse of the exponential function: the natural logarithm is the inverse of the real exponential, so . For positive , (Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm).
Multivariate normal law, including singular covariance: a normal law with mean has expectation ; in dimension one this is the scalar law .
Kullback–Leibler divergence: for , .
Proof
Set . Apply [F4] to with ; since by [F1], for every nonnegative Borel , Thus has Lebesgue density ; the same calculation gives for . Both are strictly positive. Let . By [F5], for every Borel set , so .
For every , cancel the common positive prefactor of and and apply the quotient law and inverse identity in [F6] to obtain This affine function is integrable under , whose mean is by [F7].
By [F8] and step 1.2, The identity also covers , when both sides are zero.
Depends on
- The Axiom of Choice
- The Axiom of Countable Choice ($\mathrm{AC}_\omega$)
- Kullback–Leibler divergence
- Multivariate normal law, including singular covariance
- The natural logarithm as the inverse of the exponential function
- Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm
- Standard normal and normal laws
- AC supplies countable selections and prescribed serial paths
- The standard normal density has total mass one
- Integrating against a density agrees with integrating the product
- A C^1 diffeomorphism satisfies the change-of-variables formula for nonnegative Lebesgue measurable functions
Used by
Dependency tree · two levels
71 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Philippe Rigollet and Jan-Christian Hütter, High-Dimensional Statistics: Lecture Notes, Chapter 4, Example 4.7 (standard reference, not scraped)
- John Duchi, Lecture Notes on Statistics and Information Theory, Chapter 2, Example 2.1.7; Chapter 8, Example 8.4.4 (standard reference, not scraped)