How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Particle smoothing, backward simulation, and Rao–Blackwellized filters
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Central Limit Theorems
- Characteristic Functions Inversion and Continuity
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Conditional Distributions and Regular Conditional Probability
- Conditional Expectation
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Conjugate families and Gaussian conditioning
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Cyclic Groups and Direct Products
- Density Separability and Convolution in Lᵖ
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Direct Matrix Factorisations: LU, Cholesky and QR
- Discrete Time Martingales
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- Estimators and Randomized Procedures
- Exact linear-Gaussian Kalman filtering
- Feynman–Kac targets and sequential particle filters
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Foundations of the Real Numbers for Analysis
- Fourier Transform Convolution and Approximate Identities
- Fubini and Change of Variables
- Fundamental Trigonometric Identities
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Hausdorff via the Diagonal
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Improper and Parameter-Dependent Multiple Integrals
- Improper Integrals
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Lebesgue Measure on Euclidean Space
- Lebesgue-Stieltjes Measures and Distribution Functions
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Markov Kernels and Markov Chains
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Mixed effects and longitudinal models
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Partitions of Unity and Paracompactness
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Radon Measures and the Riesz Markov Kakutani Theorem
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Scientific model contracts and applicability
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Splitting Fields
- Standard-Borel Real Codings and Determining Classes
- State-space model laws
- State-space models and exact Bayesian filtering
- Stationary means and sample autocovariance
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Exponential Function
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Galois Correspondence
- The Inverse and Implicit Function Theorems
- The Lebesgue and Riemann Integrals Compared
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Maximal Function and Lebesgue Differentiation
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Urysohn's Lemma and the Tietze Extension Theorem
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
2 · Summary
Backward simulation samples paths from filtering particles by reweighting each past particle with its transition density. The Bayes factorization also supports an exact backward-kernel version when no transition density is available. A required zero or infinite particle denominator leaves the density-based step undefined; it is not repaired with arbitrary weights. Fixed-lag smoothing targets a truncated observation history and can remain biased as the particle count grows. The Rao–Blackwellized filter samples a nonlinear path and updates the conditional linear-Gaussian state with the exact Kalman recursion. Its Gaussian components are exact conditional laws, while a finite particle mixture approximates the nonlinear filtering distribution on histories with finite evidence at every prefix. The consistency theorem is fixed-horizon and states its compactness, continuity, domination, positivity, resampling, and Monte Carlo assumptions explicitly.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Nonlinear path extension is a probability kernel
Statement
Let be finite, let be standard-Borel spaces for , and for let be probability kernels, with the kernel convention of Measure kernel and probability kernel. For , define the path-extension kernel from to by Then is a probability kernel and is standard Borel. Its ordered iterates append the nonlinear states with the original transition law.
Facts & Assumptions
Given: The nonlinear path spaces, transition kernels, and definition in the Statement.
Each is standard Borel, meaning measurably isomorphic to a Polish space, and each is a probability kernel. Standard Borel spaces Measure kernel and probability kernel
Finite products of standard-Borel spaces, with the finite-product sigma-algebra, are standard Borel. Finite products of standard Borel spaces are standard Borel
The finite-product sigma-algebra is generated by measurable coordinate rectangles. The product sigma-algebra and its finite iterates
Kernel sections are measures, probability sections have mass one, and their set evaluations are measurable. Measure kernel and probability kernel
Integrating a nonnegative product-measurable function against a probability kernel gives a measurable function of the source point. Measurability of integration against a kernel
Proof
Given: The hypotheses in the Statement.
By [F2], both finite path spaces carry their stated product sigma-algebras and the target path space is standard Borel. Fix a prefix . The append map is measurable: the inverse image of a generating rectangle is either empty or the final-coordinate measurable set, and [F3] generates the target sigma-algebra from these rectangles. Thus is the pushforward of the probability measure and is a probability measure.
The projection is measurable, so composing each set-evaluation map with this projection gives a probability kernel from the prefix space to . The function is product-measurable. By [F5], its integral against this composed kernel is measurable in the prefix. Together with step 1.1, this proves that has probability-measure sections and measurable set evaluations, hence is a probability kernel. Iterating the definition appends each state using exactly because at each step the indicator is evaluated on the already fixed prefix and the new coordinate.
Conditionally linear-Gaussian state-space model
Definition
Assume AC. Let take values in a standard-Borel space and let for a finite horizon , where each is a positive integer. For , let with each a positive integer; observations begin at time . The nonlinear component has initial probability and transition probability kernels ; its transition does not depend on . Given the entire nonlinear path , write with its finite-product sigma-algebra and specify Borel maps and, for , Require and to be symmetric positive semidefinite, meaning for every matching vector , and to be symmetric positive definite, meaning for every nonzero . Conditional on , the linear component and observations have the finite linear-Gaussian model, with the transition and observation equations for : where the centered Gaussian noises and are mutually independent over time and independent of , under that conditional law. For every fixed path these are exactly the hypotheses of Linear-Gaussian state-space models with independent noises with deterministic matrices.
This hierarchical conditionally linear-Gaussian model is the input class for the Rao–Blackwellized filter below: it samples the nonlinear path and keeps the conditional Gaussian law of analytically. It does not include a nonlinear transition whose law depends on , nor does it assert that the marginal nonlinear process remains Markov after conditioning on all observations. Such models need their own marginal transition and backward kernels. A state-space filtering or smoothing law is a data-indexed regular conditional-distribution version as in Filtering, predictive, and smoothing laws in a finite-horizon state-space model; no pointwise uniqueness on null data histories is imposed.
The Kalman filter is exact conditional on a nonlinear path
Statement
Assume the model of Conditionally linear-Gaussian state-space model and fix a nonlinear path . Run Exact linear-Gaussian Kalman filter on the resulting deterministic linear-Gaussian model for a fixed observation path . Write and for its predicted and updated moments, and define Then has the Gaussian version for every . At time , the conditional observation density given the nonlinear path and earlier observations is Each is positive definite, each is positive semidefinite, and is finite, strictly positive, and Borel in the nonlinear path. For every whose observation evidence is finite positive, the conditional density of given the nonlinear path is . Consequently the conditional law of given is the normalized Feynman–Kac path measure with path-extension transitions induced by , initial potential , and potentials . At it is the initial nonlinear law .
Facts & Assumptions
Given: AC, the fixed path and observations, and the conditional model in the Statement.
AC is inherited from the Gaussian-law and Kalman conditional-law conventions. The Axiom of Choice
Conditional on a fixed nonlinear path, the initial state and all state and observation noises are mutually independent Gaussian vectors with the displayed positive-semidefinite covariances; the coefficient matrices are deterministic for that path. Conditionally linear-Gaussian state-space model
The finite-horizon linear-Gaussian model with independent noises has an exact Kalman filtering version whenever every innovation covariance is positive definite; state and noise covariances may be singular. The finite-horizon linear-Gaussian Kalman filter is exact
One prediction and observation step from a Gaussian state with positive-semidefinite covariance produces a jointly Gaussian state-observation pair with innovation covariance , and when is positive definite the conditional state law has the stated Kalman update. One-step Gaussian prediction and conditioning
A positive-definite covariance matrix gives the multivariate normal law its Lebesgue density . A positive-definite multivariate normal law has its Gaussian density
A joint probability with a product-measurable density has the normalized conditional-density kernel on finite-positive evidence fibers. Conditional density formula
A normalized Feynman–Kac path measure is the Markov path law weighted by the product of its nonnegative potentials, and it is normalized only at finite positive normalizer. Feynman–Kac path targets and normalizers
Extending a nonlinear prefix by its transition kernel gives a probability kernel on the standard-Borel path spaces, and the ordered extensions give the nonlinear path law. Nonlinear path extension is a probability kernel
Proof
Given: The hypotheses in the Statement.
Initially is positive semidefinite. If is positive semidefinite, then is positive semidefinite because . For every nonzero observation vector , , since the first term is nonnegative and is positive definite. Induction proves all innovation matrices meet the Kalman algorithm's domain.
By [F1], for this fixed path the conditional model is the deterministic finite-horizon model of [F2]. Step 1.1 verifies its positive-innovation hypothesis, so [F2] gives the exact conditional Gaussian filter at every observation history, including singular state covariances. At each time, [F3] gives the marginal observation law ; applying [F4] yields the displayed density.
The coefficient functions are Borel by [F1]. Finite sums and products preserve Borel measurability, and matrix inversion and determinant are continuous on the positive-definite matrices established in step 1.1. The Kalman moment recursion and the displayed density are therefore Borel functions of the path. The covariance determinant is finite and positive and the exponential is finite and strictly positive, so has the claimed range.
For a fixed nonlinear path, step 2.1 gives the one-step conditional density of given . By the defining event-integral identity for conditional densities, on finite-positive fibers; induction from the empty history, whose density is one, gives the product . By [F7], the ordered path-extension kernels are probability kernels on the standard-Borel path spaces and give the nonlinear path law. The joint law of and therefore has this product as its observation-density factor relative to that path law and Lebesgue observation measure. By [F5], conditioning on a history with finite positive evidence weights the nonlinear path law by this product and divides by its integral. Comparing with [F6] gives exactly the stated normalized Feynman–Kac path measure. This assertion is restricted to those finite-positive evidence fibers; null and infinite fibers are not normalized.
Bayes factorization of the smoothing backward kernel
Statement
Assume AC, a finite-horizon Markov state-space model with standard-Borel states, dominated observation kernels, and data-indexed filtering and smoothing kernels as in Filtering, predictive, and smoothing laws in a finite-horizon state-space model. Fix an observation history in the full-measure set where the dominated filtering recursion Exact state-space filtering recursion under dominated observations applies. Write for the filtering law of given . Suppose the transition kernel from time to has a product-measurable density with respect to a sigma-finite measure , meaning for every state and measurable set . Put The backward conditional kernel is It is a probability-kernel version of the conditional law of given and . The finite-horizon smoothing kernel factors as for observation-almost every full history, with the product interpreted as successive backwards kernel integration. If the transition is supplied only as a probability kernel, the same factorization uses a supplied regular conditional kernel of given ; no transition density is asserted in that case. Null-history values remain version-dependent.
Facts & Assumptions
Given: AC; the finite-horizon Markov state-space model; the stated filtering, predictive, and smoothing kernels; dominated observation laws; and the transition density or supplied backward conditional kernels.
AC supports the finite-horizon kernel law and the regular conditional-law interfaces used below. The Axiom of Choice
Filtering and smoothing kernels are data-indexed probability kernels and are regular conditional distributions after composition with the observed histories; conditional versions can differ on null histories. Filtering, predictive, and smoothing laws in a finite-horizon state-space model
For standard-Borel state and observation spaces the finite-horizon filtering, predictive, and smoothing kernels exist. Filtering and finite-horizon smoothing laws exist
Under dominated observations, the recursive normalized update gives the exact filtering kernels and their predictive laws. Exact state-space filtering recursion under dominated observations
A joint probability with a product-measurable density has a conditional-density kernel equal to the normalized density on finite positive marginal-density fibers and a supplied probability filler elsewhere. Conditional density formula
The finite-horizon state-space path law has the ordered Markov-kernel factorization; future transitions and observations depend on the past through the current state. Finite-horizon state-space kernel law exists and is unique
Nonnegative product-measurable functions integrate measurably against probability kernels. Measurability of integration against a kernel
Equality of finite measures on generating measurable rectangles extends to the generated history sigma-algebra. Dynkin's pi-lambda theorem
Proof
Given: The hypotheses in the Statement.
Fix and condition on . The conditional pair law of is the ordered kernel integral by [F3] and [F5]. In the density case this pair law has density with respect to , and its second marginal has density . Applying [F4] gives the displayed on and the supplied filler off it. The conditional-density result proves that is an everywhere probability kernel and the conditional law of given on its predictive support.
In the full path factorization [F5], after fixing and the observations through time , every factor after time depends only on and the future states. Those factors cancel from the conditional distribution of ; the observation factor at time is also constant in . The remaining factors are exactly the conditional pair law in step 1.1, so the conditional distribution of given equals almost surely. With a general transition kernel the same cancellation leaves the supplied regular conditional kernel, without evaluating a density or particle-point singleton.
Apply the conditional chain rule successively from down to . Step 2.1 identifies each conditional factor with , while the terminal factor is the filtering law . Integrating first over rectangles in the finite product state space gives the displayed product kernel; [F6] makes each iterated kernel measurable, and [F7] extends the conditional identities to all Borel path events. Thus the product is a version of the finite-horizon smoothing kernel. The argument concerns histories under their actual observation law and makes no pointwise uniqueness claim on null histories.
Particle backward simulator
Definition
Fix a finite horizon and a requested path count , used in either mode below. In the particle mode, the inputs include a particle count and normalized filtering clouds for , produced, for example, by Sequential importance resampling for Feynman–Kac path targets. Each is the time- coordinate of its stored particle path. Write for the model transition kernel and require a product-measurable density relative to a declared sigma-finite measure , meaning for each measurable . For each , define the predictive score with zero-weight terms omitted: For particle-mode path sampling, define the set of reachable indices recursively by . Descending from to , require for every , and put These are exactly the indices that can be drawn with positive probability at the corresponding backward step. For the all-marginals mode below, require instead that whenever the current smoothing weight is positive. Thus no denominator is required for an omitted zero-weight term. At there are no denominator conditions.
In particle mode, repeat independently for :
- Draw from with probabilities and set .
- For , set without evaluating the density whenever . For , set Draw from this probability vector, and set .
- Return the tuple This is a draw from the particle backward approximation to the smoothing path law. The coordinates are selected by separate backward indices and need not be the stored forward ancestor history of any one particle. The particle path-sampling output is the list .
If an exact filtering kernel and supplied backward conditional kernels from Bayes factorization of the smoothing backward kernel are available for general transition kernels, there is a separate exact-kernel mode: draw conditionally independent paths, each by drawing and then drawing successively backward. This mode uses the actual kernels; it does not evaluate a transition density or a kernel on particle singletons. It returns exact smoothing paths under the supplied conditional versions wherever their factorization holds.
An optional all-marginals mode computes particle smoothing weights instead of drawing paths. Initialize . For , let . For each and with , set set without evaluating the density if or . Update For every active , is a probability vector, so the raw updated values are nonnegative and already sum to one; explicit normalization leaves them unchanged. Return as the approximate smoothed marginal at time . The algorithm makes no finite-particle accuracy, consistency, or long-time stability claim.
Remarks
When a required density denominator is zero or infinite, the corresponding mode is inadmissible; the algorithm does not replace it with uniform weights. Zero filtering or smoothing weights are omitted before density evaluation, so no term evaluates or . For a general transition kernel, use an exact supplied backward conditional kernel as in the second mode, or provide a valid dominating-density interface. A fixed-lag target remains a truncated-observation target; see Fixed-lag particle smoother.
Rao–Blackwellized particle filter
Definition
Use the conditionally linear-Gaussian model of Conditionally linear-Gaussian state-space model and a fixed observation path . For each , let be the nonlinear path law generated by and the path-extension kernels from Nonlinear path extension is a probability kernel, and put Here is the conditional observation density supplied by The Kalman filter is exact conditional on a nonlinear path. For the claim that the procedure targets the nonlinear filtering law at every prefix, assume for every ; this is the finite-positive normalizer condition for the normalized Feynman–Kac target. The Kalman likelihood factorization identifies with the observation evidence density and the normalized path target with the exact conditional law of given . The particle procedure itself uses finite positive per-particle likelihoods, so each of its empirical weight normalizers is finite positive. The particle state at time is the full nonlinear history ; finite products of the standard-Borel state spaces are standard Borel. Its transition appends a draw ; the resulting path-extension probability kernel and standard-Borel path space are supplied by Nonlinear path extension is a probability kernel. Set the initial Feynman–Kac potential to and the time- potential to the conditional observation density from The Kalman filter is exact conditional on a nonlinear path. Use the same path-extension kernel as target and proposal, so the initial and transition Radon–Nikodym weights are identically one. Run Sequential importance resampling for Feynman–Kac path targets with multinomial resampling to approximate the filtering law of the nonlinear path. Each particle stores alongside its path the conditional Gaussian moments of .
Initialize particles by drawing independently, setting , , and . For each :
- Draw ancestor indices independently with probabilities and append independent transitions .
- For each particle, abbreviate its appended path by and compute Form and .
- Set the incremental weight to the finite positive Gaussian density and normalize .
- Update the conditional Gaussian moments by
The procedure returns the weighted nonlinear particle paths and the Gaussian mixture Its conditional mean is and its conditional covariance is , where . These are moments of the finite mixture approximation; for finite the algorithm remains an approximation to the full nonlinear filter. It makes no general variance-reduction, convergence-rate, or long-time accuracy claim.
Remarks
For every particle, is positive semidefinite and is positive definite, so is positive definite and the Kalman update and Gaussian density are defined. Conditional exactness of each Gaussian component is supplied by The Kalman filter is exact conditional on a nonlinear path. More precisely, each stored component is the conditional law of given its prefix and . This follows by induction: at time zero it is the specified Gaussian law; at each later step the appended nonlinear transition is and does not depend on , so conditioning on the appended state does not change the parent Gaussian component, after which the Kalman prediction and observation update give the stated component. Equivalently, the Kalman lemma's conditional law given the full nonlinear path depends through time only on ; future nonlinear transitions are independent of and given the prefix, depend only on the current nonlinear state, and integrate to one. Integrating over therefore leaves that same Gaussian law given the prefix. The mixture over nonlinear paths is still represented by finitely many particles.
Finite-horizon bootstrap particle filters are weakly consistent
Statement
Assume AC. Let be compact metric spaces, let be a probability on , and let be a Feller probability kernel from to . Here Feller means that is continuous for every bounded continuous real on . Let each potential be continuous and satisfy fixed bounds . Let be the Markov path law and the Feynman–Kac normalizer from Feynman–Kac path targets and normalizers. Since is a probability, , so the normalized path target exists. For the initial law and transitions use the bootstrap proposals , , initial potential , and multinomial resampling in Sequential importance resampling for Feynman–Kac path targets. Write for the last-state marginal of and for the particle filter's current weighted empirical measure. For every fixed , where convergence in probability means that for every bounded continuous , in probability. This is a fixed-horizon, positive-bounded-potential result; it asserts no time-uniform bound and no particle central limit theorem.
Facts & Assumptions
Given: The hypotheses in the Statement, a finite horizon, and the multinomial bootstrap particle system.
AC is assumed by the finite-horizon Feynman–Kac path-law convention used to define the target. The Axiom of Choice
The bootstrap specialization of the sequential importance-resampling algorithm uses IID initial particles, multinomial parent indices, conditionally independent propagation through , and incremental weights . Sequential importance resampling for Feynman–Kac path targets
Multinomial parent indices are conditionally IID with the normalized input weights. Multinomial and residual offspring resampling
The normalized current-state marginals of the Feynman–Kac path measures obey and . Feynman–Kac path targets and normalizers Feynman–Kac path measures satisfy the forward recursion
Weak convergence of probability measures is convergence of integrals against every bounded continuous function. Weak convergence of borel probability measures
For nonnegative measurable and , on any measure space. Chebyshev-Markov inequality for the integral
Proof
Given: The hypotheses in the Statement. The empirical measure before potential weighting at time is denoted .
At time zero, for any bounded continuous , put . Expanding the squared centered sample average, the cross terms vanish by independence and the diagonal terms give . The same calculation with gives the denominator bound . Applying [F5] to each squared error shows both averages converge in probability to their integrals. The denominator limit is at least , so the ratio converges in probability to .
Suppose in probability for every bounded continuous . Conditional on the previous particles, [F1]–[F2] make IID with common law . For bounded continuous , the squared error of their empirical average under this product law is the sum of diagonal centered terms divided by ; the cross terms vanish by independence, and each diagonal term is at most . Thus its integral is at most . Applying [F5] under the conditional product law and then integrating over the previous particles gives in probability. The Feller hypothesis makes bounded continuous, so the induction hypothesis gives .
Apply step 1.2 to and , both bounded continuous. Then ; the denominator converges to . The ratio therefore converges in probability to by [F3]. Induction from step 1.1 proves the assertion for each fixed . The lower bound rules out zero normalizers, while the upper bound gives the finite variance bounds used above.
Fixed-lag particle smoother
Definition
For a finite horizon , fix an integer lag , a path count , and the normalized filtering particle clouds and transition inputs required by Particle backward simulator. For each time , put . Independently for each , run the particle backward simulator using only the filtering clouds at times and request paths. Retain their time- coordinates and return the empirical measure In particle mode this empirical law approximates not the full smoothing law unless or the two conditional laws happen to agree. The same procedure can use supplied exact backward kernels when the model has no transition density; for each it uses the supplied filtering kernel at and the backward kernels for the corresponding prefix histories. On histories where these kernels factor the truncated smoother, it samples that exact conditional law.
The procedure returns one truncated smoothing marginal per . It does not assert a bound on the lag bias, a forgetting rate, or convergence to the full-data smoother for fixed . Those conclusions require separate conditions on the model.
Normalization and operation counts for particle backward smoothing
Statement
Assume the finite particle-mode inputs and denominator conditions of Particle backward simulator. The backward index probabilities at each step are nonnegative and sum to one. In the all-marginals recursion, the raw updated smoothing weights also sum to one, so the optional explicit normalization in the algorithm leaves them unchanged. Count one transition density evaluation and a bounded number of real arithmetic operations as unit cost, and sample from a categorical vector by a linear scan of its entries. Then drawing backward paths costs operations, including terminal draws, and computing all smoothed marginal weights costs , including initialization and output. For these are respectively and ; for fixed , path sampling costs .
Facts & Assumptions
Given: Normalized filtering weights , finite positive backward denominators, the all-marginals update in the algorithm, and the unit-cost convention in the Statement.
For each reachable child value , the particle backward probabilities omit indices with and divide the remaining scores by the finite positive score sum . Particle backward simulator
The all-marginals recursion forms a probability vector for each child with positive smoothing weight, omits zero filtering and smoothing weights before evaluating transition densities, and updates by mixing those vectors with , initialized by . Particle backward simulator
Proof
Given: The hypotheses in the Statement.
For any child value at which a backward weight vector is required, the mode's admissibility condition gives . For each index with the algorithm sets its backward probability to zero without evaluating its density; for each positive-weight index the score is finite and nonnegative. Summing over therefore gives . Thus each required backward vector is a probability vector.
Suppose . For every with , admissibility makes its score sum finite positive, and the associated vector sums to one by step 1.1. The raw update is . Summing over gives . Since sums to one, backward induction proves every update is already normalized; zero smoothing-weight terms are never evaluated.
At each of the backward times for one sampled path, the algorithm evaluates transition scores and scans probabilities; terminal sampling also scans entries. Storing the path costs , so paths take operations. In the all-marginals recursion, initialization and output cost , while each backward time evaluates one transition score and performs bounded arithmetic for each of the past/future particle pairs. The total is because . For fixed this gives path cost, and when the bounds reduce to and .
Fixed-horizon particle backward smoothing is consistent under stated conditions
Statement
Assume AC and a finite-horizon state-space model with compact metric state spaces , dominated observation kernels, and an observation history in the full-measure finite-positive set where Bayes factorization of the smoothing backward kernel applies. Let be the specified product-measurable observation density relative to its sigma-finite observation measure, as in Exact state-space filtering recursion under dominated observations, and set for and . Suppose each is continuous and there are constants such that for every state and time. For each , let be the state transition from time to time and suppose it has a jointly continuous density relative to a Borel probability measure , meaning for measurable , with uniform bounds for all . Write for the exact filtering-kernel value at and for the exact smoothing-kernel value at . Use the model initial law as the initial proposal, these same as transition proposals, and these as potentials in the multinomial bootstrap particle filter. With particles, independently draw backward paths conditional on the resulting clouds, where as . Let be the conditional law of one backward-simulated path given the clouds. For every continuous , For a fixed number of simulated paths, their conditional path law is consistent but the empirical path average retains its Monte Carlo error. No time-uniform-in- convergence claim is made.
Facts & Assumptions
Given: The assumptions above, fixed observations with finite positive evidence, and a bounded continuous test function on the compact path space.
AC is used through the finite-horizon Feynman–Kac and conditional smoothing-law constructions. The Axiom of Choice
The filtering empirical measures converge weakly in probability under the bounded positive-potential, Feller, multinomial bootstrap assumptions. Finite-horizon bootstrap particle filters are weakly consistent
The exact smoother factors into its terminal filtering law and the exact backward conditional kernels. Bayes factorization of the smoothing backward kernel
Given filtering particles, the particle backward kernel weights each candidate state by its filter weight times the transition density and normalizes by the predictive density. Particle backward simulator
Weak convergence tests against bounded continuous functions. Weak convergence of borel probability measures
The nonnegative integral inequality bounds probabilities of squared deviations. Chebyshev-Markov inequality for the integral
The observation-density recursion identifies each filtering kernel with the normalized Feynman–Kac update using on finite-positive evidence histories. Exact state-space filtering recursion under dominated observations
Proof
Given: The hypotheses in the Statement.
For each , let be bounded continuous and let . Uniform continuity of on the compact product gives . Since is a probability measure, Thus each transition is Feller.
By [F1] and [F6], for every the random filtering measure converges weakly in probability to the exact filtering law at the fixed observation history. For each , put and . The density bounds imply for every , so every backward denominator used by the algorithm is finite positive.
Fix and a continuous on . The families and indexed by are uniformly bounded and equicontinuous: joint continuity on the compact product is uniformly continuous. For any , a finite -net of the compact parameter space gives a finite sup-norm net for each family. Weak convergence in probability from step 2.1 gives convergence of the integrals for every function in each finite net; since all measures have mass one, replacing a family member by a net function changes either integral by at most . Letting proves uniform-in- convergence of both numerators and denominators. Division is stable because all denominators are at least , so in probability for the empirical and exact backward kernels. The exact function is continuous by dominated convergence.
For each , set , which tends to zero by uniform continuity. The exact and empirical backward kernels have densities relative to and relative to , respectively. Using [F2]–[F3], from step 2.1, and that both filtering measures have mass one, their total-variation distance at is at most . Indeed, if is a continuous integrand indexed by remaining coordinates , and denotes the next-state coordinate in , then the difference of its integrals at is bounded by ; uniform continuity of and the displayed kernel bound make this tend uniformly to zero as . Thus each backward integration preserves a common bound and modulus of equicontinuity over the remaining compact coordinates, uniformly over all particle clouds. Since is finite, iterating this estimate yields one such class for every section in the finite telescoping sum.
Telescope the finite backward product by replacing one empirical kernel at a time with its exact counterpart. The uniform moduli from step 3.2 put every possible section, over all clouds and remaining coordinates, in a uniformly bounded equicontinuous class on a compact metric space. Such a class has a finite sup-norm net: choose a finite -net of the domain at a scale given by equicontinuity, quantize the bounded function values on those finitely many points, and retain one representative for each nonempty quantized pattern. Step 3.1 gives convergence for each fixed test in this finite net; since kernels are probabilities, the sup-norm approximation changes an integral difference by at most twice the net radius. The same finite-net argument and [F1] give convergence of the terminal empirical integrals uniformly over the resulting class. Thus every term in the finite telescoping sum tends to zero in probability, and the conditional path law converges weakly in the sense of [F4] to the exact product law in [F2].
Conditional on the particle clouds, the backward paths are IID with law . Their conditional sample mean has variance at most . Applying [F5] to its squared centered deviation shows that its difference from converges to zero in probability because . Combining this with step 4.1 proves the second limit. If is fixed, this variance bound need not vanish, so no convergence of the path average is asserted.
Exact-kernel fixed-lag smoothing targets the truncated conditional law
Statement
Assume AC and a finite-horizon Markov state-space model with standard-Borel state and observation spaces. Supply the exact filtering and backward conditional kernels of Bayes factorization of the smoothing backward kernel. Fix an observation history in the full-measure set on which their factorization holds for every prefix horizon . In the exact-kernel mode of Fixed-lag particle smoother, fix an integer lag and , and set . Each returned path's time- coordinate has conditional law (for the supplied conditional versions), so, for any requested , the empirical measure of its returned time- coordinates is a Monte Carlo estimate of that marginal. The target equals the full smoothing marginal only when later observations do not change the conditional law; increasing the particle count cannot remove a difference caused by truncating the observation history.
Facts & Assumptions
Given: A finite-horizon state-space model with supplied exact filtering and backward conditional kernels, integer lag , and target time .
AC is inherited through the finite-horizon conditional-law construction that supplies the filtering and backward kernels. The Axiom of Choice
The fixed-lag algorithm sets , requests paths using observations only through time , and returns their time- empirical measure. Fixed-lag particle smoother
The exact terminal filter and backward conditional kernels factor the finite-horizon smoothing law. Bayes factorization of the smoothing backward kernel
Proof
Given: The hypotheses in the Statement.
Since and , the integer satisfies . Apply [F2] at horizon to the observation history . Its terminal filtering kernel followed by the supplied backward conditional kernels gives a path with law .
Each exact-kernel draw in [F1] has the path law from step 1.1 and returns its coordinate projection . A coordinate projection of a random element with the path conditional law has the corresponding marginal conditional law, hence each draw has law ; averaging the point masses gives the stated Monte Carlo estimate. If conditioning on additional observations changes this marginal, the exact branch still conditions only on , so increasing either the particle count or the number of backward draws cannot change its target.
5 · Examples, counterexamples and false statements
None yet.
Sources
- Simo Särkkä, Bayesian Filtering and Smoothing, Chapter 7, §7.5
- Arnaud Doucet and Adam M. Johansen, A Tutorial on Particle Filtering and Smoothing: Fifteen Years Later, §3.3
- Simo Särkkä, Bayesian Filtering and Smoothing, Chapter 11, §11.4
- Fredrik Lindsten, Pete Bunch, Simo Särkkä, Thomas B. Schön, and Simon J. Godsill, Rao-Blackwellized particle smoothers for conditionally linear Gaussian models, §3.2
- Simo Särkkä, Bayesian Filtering and Smoothing, Chapter 11, §11.2
- Arnaud Doucet and Adam M. Johansen, A Tutorial on Particle Filtering and Smoothing: Fifteen Years Later, §2.3.1
- Arnaud Doucet and Adam M. Johansen, A Tutorial on Particle Filtering and Smoothing: Fifteen Years Later, §5.2
- Simo Särkkä, Bayesian Filtering and Smoothing, Chapter 7, §§7.3–7.4
- Arnaud Doucet and Adam M. Johansen, A Tutorial on Particle Filtering and Smoothing: Fifteen Years Later, §§3.4–3.5
- Arnaud Doucet and Adam M. Johansen, A Tutorial on Particle Filtering and Smoothing: Fifteen Years Later, §5.1
- Simo Särkkä, Bayesian Filtering and Smoothing, Chapter 11, §§11.2–11.3
- Fredrik Lindsten, Pete Bunch, Simo Särkkä, Thomas B. Schön, and Simon J. Godsill, Rao-Blackwellized particle smoothers for conditionally linear Gaussian models, §3.1