How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Ordinary importance sampling is unbiased
Statement
Let be a measure space, let and be measurable densities with and , and set and . Let be measurable with . Suppose -almost everywhere on and are IID with law . For the ordinary importance sampling estimator in Ordinary importance sampling,
Facts & Assumptions
Given: The densities, integrability, support, and IID sampling hypotheses in the Statement.
Ordinary importance sampling: With when and otherwise, the estimator is .
Change of variables for expectation: For a random element with law , a nonnegative measurable satisfies , possibly with value ; if is integrable, the same identity holds as a finite integral.
The Lebesgue integral is linear on : The Lebesgue integral is linear on integrable functions; in particular, the expectation of a finite average of integrable random variables is the average of their expectations.
Expectation of a nonnegative or integrable random variable: The expectation of an integrable real random variable is its finite Lebesgue integral.
Integrating against a density agrees with integrating the product: for a nonnegative measurable density and nonnegative measurable , , including infinite values. Integrable real and complex functions, and their integrals: an absolutely integrable real function has integral equal to the finite difference of the integrals of its positive and negative parts.
Proof
Given: Use the target expectation and the estimator specified in Ordinary importance sampling.
Use [F5] with density for integration against and with for integration against . For every , apply the nonnegative case of [F2] to . Since has law , Thus is -integrable. For any real measurable whose absolute integral is finite against , apply [F5] separately to and : both product integrals are finite because . Subtracting their finite identities yields , since for (with the density convention ). The integrable case of [F2] therefore gives The support condition makes -almost everywhere on ; hence this last integral equals .
By [F1], . Apply [F3] and step 1.1 to obtain .
Depends on
Used by
- A light-tailed proposal can give ordinary importance sampling infinite variance Counterexample
- An unbiased importance-sampling weight can have infinite second moment Example
- Bootstrap and informed proposals on a two-state particle filter Example
- Ordinary and self-normalized importance sampling on a two-point space Example
- Gaussian tail tilting is logarithmically efficient but not bounded-relative-error Theorem
- Independent cross-entropy production is conditionally unbiased Theorem
- Ordinary importance sampling has finite variance and a CLT under a weighted second moment Theorem
Dependency tree · two levels
23 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Quan Zhou, STAT 689 Unit 1: Introduction, Rejection and Importance Sampling, §1.3, Theorem 1.2 (standard reference, not scraped)
- Thomas B. Schön and Fredrik Lindsten, Learning of dynamical systems: Particle filters and Markov chain methods, Chapter 4 §§4.3.1, 4.3.3 (standard reference, not scraped)
- Data Science and Statistical Modelling, Chapter 5 §5.3.1, Theorem 5.3 (standard reference, not scraped)
- Tuan Anh Le, Importance Sampling, §Importance Sampling (standard reference, not scraped)