How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Likelihood-ratio change of measure
Statement
Assume AC and let be probability measures on one measurable space. Let be a nonnegative measurable representative of the likelihood-ratio class for versus . If , then
for every nonnegative measurable , and also for every real-valued -integrable measurable . Here means . Without , this identity need not hold because the singular component may be nonzero.
Facts & Assumptions
Given: AC; probability measures on ; a nonnegative representative of their likelihood-ratio class; and, for the identity, the additional hypothesis .
The Axiom of Choice: AC states that every family of nonempty sets has a choice function.
Likelihood ratio as a Radon–Nikodym derivative: the likelihood-ratio class is , where is its Lebesgue decomposition.
The Lebesgue decomposition of a sigma-finite signed measure is unique: two decompositions into an absolutely continuous part and a singular part have identical components.
Lebesgue components of a positive finite measure are positive and The total variation |nu|(E) from countable measurable partitions: for a positive finite , both Lebesgue components are positive; hence is finite and its total variation equals itself.
A sigma-finite signed measure that is absolutely continuous with respect to a sigma-finite positive measure has a unique almost-everywhere density and A sigma-finite positive measure has a nonnegative Radon–Nikodym density version: under AC, a finite positive measure absolutely continuous with respect to the probability has a nonnegative density representative satisfying the setwise integral formula, and every representative of that class agrees with it -almost everywhere.
The measure with density relative to and Measures on sigma-algebras: is the measure when is nonnegative measurable, so its setwise values are additive over measurable partitions.
Integrating against a density agrees with integrating the product: for nonnegative measurable , .
Integrable real and complex functions, and their integrals, The positive and negative parts of a function, Closure properties of measurable functions used by the integral, and The Lebesgue integral is linear on : a real integrable function has integrable measurable positive and negative parts, and the integral is linear on .
A nonnegative integral over a null set vanishes: the integral of a nonnegative measurable function over a -null set is zero.
Proof
The decomposition has absolutely continuous part and singular part , because the hypothesis gives . Comparing it with the decomposition in [F1], uniqueness [F2] gives and .
By [F3], is positive and finite, and is a finite positive measure. Choose a nonnegative representative supplied by [F4], so for every . By step 1.1, . The representative in the statement belongs to this same Radon–Nikodym class, so [F4] gives a measurable -null set outside which . By [F5], both and are measures; their values on are zero by [F8], and their values on agree because the densities agree there. Measure additivity therefore gives for every measurable . Thus the density measure in [F5] equals .
For nonnegative measurable , equality of these measures and [F6] give . This is the asserted expectation identity in the nonnegative case.
Now let be real-valued and integrable under . By [F7], and are measurable and integrable. Applying step 3.1 to each gives ; applying it to also shows . Thus , and linearity from [F7] yields .
Depends on
- The Axiom of Choice
- Probability measures and probability spaces
- The total variation |nu|(E) from countable measurable partitions
- Likelihood ratio as a Radon–Nikodym derivative
- Absolute continuity of a signed or complex measure with respect to a positive measure
- The Lebesgue decomposition of a sigma-finite signed measure is unique
- A sigma-finite signed measure that is absolutely continuous with respect to a sigma-finite positive measure has a unique almost-everywhere density
- Lebesgue components of a positive finite measure are positive
- A sigma-finite positive measure has a nonnegative Radon–Nikodym density version
- Measures on sigma-algebras
- The measure with density $f$ relative to $\mu$
- Integrating against a density agrees with integrating the product
- A nonnegative integral over a null set vanishes
- Integrable real and complex functions, and their integrals
- The positive and negative parts of a function
- Closure properties of measurable functions used by the integral
- The Lebesgue integral is linear on $L^1(\mu)$
Used by
- A singular pair has no full likelihood ratio Counterexample
- Kullback–Leibler divergence Definition
- Mutual information for a finite uniform hypothesis experiment Definition
- Bernoulli likelihood ratio and change of measure Example
- Finite-horizon Brownian change of drift and relative entropy Lemma
- Finite-sample likelihood ratio for iid observations Lemma
- Pathwise relative-entropy error of the Langevin Euler interpolation Lemma
- Common-reference factorization criterion for sufficiency Theorem
- Fano’s packing bound with a reference-distribution KL bound Theorem
- Iid drift conditions imply almost-sure test termination Theorem
- Pinsker’s inequality with event-supremum total variation Theorem
- Terminal error bounds for a sequential likelihood-ratio test Theorem
Dependency tree · two levels
44 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Ryan Martin, Lecture Notes on Advanced Statistical Theory, §3.2, PDF pp. 54–55 (standard reference, not scraped)
- Richard F. Bass, Real Analysis for Graduate Students, Theorem 13.4 and proof, §13.2 (book pp. 100–103) (standard reference, not scraped)
- John K. Hunter, Measure Theory, Theorem 6.27 and proof, §6.8 (notes pp. 75–77) (standard reference, not scraped)