How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
The sequential particle estimator is unbiased for Feynman–Kac path integrals
Statement
Assume AC and the finite-horizon setup of Feynman–Kac path targets and normalizers and Sequential importance resampling for Feynman–Kac path targets. Fix with and . Suppose every prefix normalizer satisfies for . For any nonnegative measurable with , define . Then In particular, with , the product-of-average-incremental-weights estimator in the algorithm satisfies . At each time either multinomial or residual offspring resampling may be used. The theorem asserts no unbiasedness for the normalized empirical measure by itself.
Facts & Assumptions
Given: AC, the finite-horizon target/proposal assumptions, , finite positive prefix normalizers, and a nonnegative test function with finite target integral.
The Axiom of Choice: AC is used through the path-law, kernel Radon–Nikodym, and conditional-expectation suppliers.
Sequential importance resampling for Feynman–Kac path targets: The initial and incremental weights, normalized fallback, resampling-propagation order, and product normalizer estimate are specified there.
Conditional expectation given a sigma algebra: A conditional-expectation version is measurable, integrable, and satisfies its defining event-integral identities.
Multinomial and residual resampling have unbiased offspring counts: Conditional expected offspring counts equal times the input normalized weights for either scheme.
Feynman–Kac path measures satisfy the forward recursion: for nonnegative measurable .
Feynman–Kac path Radon–Nikodym weight: Under its support hypotheses, the theorem supplies a nonnegative measurable initial version and jointly measurable nonnegative transition versions for almost every preceding proposal state, with the setwise Radon–Nikodym identities. Each derivative has reference integral one on the relevant conull set.
Change of variables for expectation: Expectation of a nonnegative random element function is integration against its law.
The Lebesgue integral is linear on : Finite sums of integrable random variables have the sum of their expectations.
Conditional expectation exists by radon nikodym: AC and an integrable real random variable give an conditional-expectation version for any sub-sigma-algebra.
Tower property of conditional expectation: For nested sigma-algebras and an variable, iterated conditional expectations agree almost surely.
Conditional expectation as an ae class: Conditional expectations are integrable measurable equivalence classes with the defining event integrals.
Measurability of integration against a kernel: Integrating a nonnegative product-measurable function against a probability kernel gives a measurable section integral.
Ionescu-Tulcea construction of a Markov chain: The finite sequence of conditional particle and proposal kernels has a joint law with the stated iterated integrals.
A nonnegative measurable function has integral exactly when it vanishes almost everywhere: A nonnegative function with zero integral vanishes almost everywhere.
Integrating against a Radon-Nikodym derivative recovers integration against the measure: A setwise Radon–Nikodym identity also gives the corresponding integration identity for nonnegative simple functions whose level sets have finite total variation.
Every nonnegative measurable function is the increasing limit of simple measurable functions: Every nonnegative measurable function is an increasing pointwise limit of nonnegative simple functions.
Monotone convergence for the integral: Integrals commute with increasing limits of nonnegative measurable functions.
Measure kernel and probability kernel: For each measurable set, a probability-kernel evaluation is measurable in its source variable.
The product sigma-algebra and its finite iterates: Coordinate projections from finite product measurable spaces are measurable.
Composition with a Borel measurable outer map preserves measurability: Compositions of measurable maps are measurable.
Arithmetic and lattice operations preserve measurability whenever they are defined: Finite sums and products of measurable functions are measurable.
Finite products of probability kernels are probability kernels: A finite product of probability kernels with a common source is a probability kernel.
Proof
Given: The hypotheses in the Statement. For the induction step at , assume the asserted identity holds at time for every nonnegative test function with finite -integral.
First, extend each setwise density identity needed here to nonnegative measurable integrands. If for every measurable , with , choose simple by [F15]. The simple-function identity [F14] gives for each , and [F16] on both sides yields , allowing infinity. This applies to the initial law pair and, for almost every preceding proposal state, to each transition-kernel pair in [F5]. At time zero, the algorithm gives , with zero-weight terms interpreted by the nonnegative-integral convention . Each has law , so [F6], finite-sum linearity [F7], and the just-proved extension give . The finite target integral makes this random variable integrable.
The finite procedure defines measurable transition kernels. The initial IID draws from form a finite product kernel by [F21]. At each later step, the previous normalized weights are measurable functions of the previous paths by [F17, F18, F19, F20]. The multinomial and residual laws are probability kernels on the finite ancestor-index set: normalization uses division on the Borel branch where the sum is positive, each floor map is Borel since , and the or branches are Borel. Since takes only the values , each residual output-list probability is a finite sum over possible draw vectors of Borel product masses. For a fixed ancestor vector, the proposal law of the next particles is the finite product of the pullbacks of the kernels along measurable coordinate projections; [F17, F18, F19] make each pullback a probability kernel, and [F21] makes their product a probability kernel. The finite mixture over ancestor vectors is again a probability kernel by finite sums and products [F20]. Thus [F12] applies to the particle-system transitions.
Every time-zero particle path has law . Inductively, suppose each previous particle path avoids every fixed -null history set almost surely. If , the pullback of to the history space is a probability kernel by step 1.2, and [F11] makes measurable. The proposal path recursion [F12] and zero-integral criterion [F13] show it vanishes for -almost every history. The kernel-derivative exceptional parent-state set has a null preimage under the last-coordinate marginal of , so every stored path avoids that preimage; resampling copies only existing paths, and propagation therefore avoids . Each initial or kernel derivative has reference integral one by [F5]; it is therefore finite almost everywhere for its reference law. The finite-valued potentials and the finite particle count then make all particle weights finite almost surely.
Write for the previous particle histories and weights. Let be the integral of against the algorithm's conditional finite-step transition law. By [F3], the expected number of children from parent is . The algorithm gives when the new weight sum is positive; when it is zero, both sides are zero. For each parent outside the exceptional proposal-marginal null set, [F18, F19, F20] make nonnegative measurable; apply the simple-approximation extension in step 1.1 to it. The setwise identity in [F5] then gives , including infinite values. Integrating each child's incremental weight and summing the expected counts therefore gives , where . If the previous normalizer estimate is zero, both sides vanish by the algorithm's zero-weight convention. Measurability follows from [F11]. This is initially a nonnegative conditional-kernel integral, not yet an conditional expectation.
By [F4], the target integral of is . The induction hypothesis therefore gives . For every prior event , the ordered joint law of the prior histories and the algorithm's conditional finite-step transition law [F12], integrated with the nonnegative integrand , gives This identity is valid before any integrability assumption, by nonnegative iterated integration. Taking shows that has finite expectation , so it is in ; is also in by its finite expectation. Thus the event identities and measurability make a version of by [F2] and [F10]. The tower property [F9] now yields , completing the induction step.
Apply the established identity at to the constant function . Then , while , proving the stated normalizer unbiasedness.
Remarks
The proof is finite-horizon and uses precisely the specified full resampling-propagation scheme with unbiased expected offspring counts. It does not imply an unbiased normalized empirical target, a particle-count central limit theorem, a finite- error bound, or a bound uniform in time.
Depends on
- The Axiom of Choice
- Feynman–Kac path targets and normalizers
- Sequential importance resampling for Feynman–Kac path targets
- Multinomial and residual resampling have unbiased offspring counts
- Feynman–Kac path measures satisfy the forward recursion
- Feynman–Kac path Radon–Nikodym weight
- Measurability of integration against a kernel
- Measure kernel and probability kernel
- The product sigma-algebra and its finite iterates
- Composition with a Borel measurable outer map preserves measurability
- Arithmetic and lattice operations preserve measurability whenever they are defined
- Finite products of probability kernels are probability kernels
- Conditional expectation exists by radon nikodym
- Tower property of conditional expectation
- Conditional expectation as an ae class
- Conditional expectation given a sigma algebra
- Ionescu-Tulcea construction of a Markov chain
- A nonnegative measurable function has integral $0$ exactly when it vanishes almost everywhere
- Change of variables for expectation
- The Lebesgue integral is linear on $L^1(\mu)$
- Expectation of a nonnegative or integrable random variable
- Integrating against a Radon-Nikodym derivative recovers integration against the measure
- Every nonnegative measurable function is the increasing limit of simple measurable functions
- Monotone convergence for the integral
Used by
Dependency tree · two levels
84 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Arnaud Doucet and Adam M. Johansen, A Tutorial on Particle Filtering and Smoothing: Fifteen Years Later, §§3.3–3.5 (standard reference, not scraped)
- Simo Särkkä and Lennart Svensson, Bayesian Filtering and Smoothing, 2nd ed., §§11.2–11.5 (standard reference, not scraped)
- Nicolas Chopin, Central Limit Theorem for Sequential Monte Carlo Methods and its Application to Bayesian Inference, §§2.1–2.2 (standard reference, not scraped)