Alphabeta Math
Pipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

Particle smoothing, backward simulation, and Rao–Blackwellized filters

1 · Prerequisites

2 · Summary

Backward simulation samples paths from filtering particles by reweighting each past particle with its transition density. The Bayes factorization also supports an exact backward-kernel version when no transition density is available. A required zero or infinite particle denominator leaves the density-based step undefined; it is not repaired with arbitrary weights. Fixed-lag smoothing targets a truncated observation history and can remain biased as the particle count grows. The Rao–Blackwellized filter samples a nonlinear path and updates the conditional linear-Gaussian state with the exact Kalman recursion. Its Gaussian components are exact conditional laws, while a finite particle mixture approximates the nonlinear filtering distribution on histories with finite evidence at every prefix. The consistency theorem is fixed-horizon and states its compactness, continuity, domination, positivity, resampling, and Monte Carlo assumptions explicitly.

3 · Logical flowchart

4 · Definitions, theorems and proofs

LemmaStatement: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Nonlinear path extension is a probability kernel

Statement

Let T≥0 be finite, let (Zt,Zt) be standard-Borel spaces for 0≤t≤T, and for 1≤t≤T let Mt:Zt−1⇝Zt be probability kernels, with the kernel convention of Measure kernel and probability kernel. For 1≤t≤T, define the path-extension kernel from Z0:t−1 to Z0:t by M‾t(z0:t−1,A)=∫Zt1A(z0:t−1,zt)Mt(zt−1,dzt). Then M‾t is a probability kernel and Z0:t is standard Borel. Its ordered iterates append the nonlinear states with the original transition law.

Facts & Assumptions

Given: The nonlinear path spaces, transition kernels, and definition in the Statement.

[F1]

Each Zt is standard Borel, meaning measurably isomorphic to a Polish space, and each Mt is a probability kernel. Standard Borel spaces Measure kernel and probability kernel

[F2]

Finite products of standard-Borel spaces, with the finite-product sigma-algebra, are standard Borel. Finite products of standard Borel spaces are standard Borel

[F3]

The finite-product sigma-algebra is generated by measurable coordinate rectangles. The product sigma-algebra and its finite iterates

[F4]

Kernel sections are measures, probability sections have mass one, and their set evaluations are measurable. Measure kernel and probability kernel

[F5]

Integrating a nonnegative product-measurable function against a probability kernel gives a measurable function of the source point. Measurability of integration against a kernel

Proof

Given: The hypotheses in the Statement.

1.1F1F2F3F4given

By [F2], both finite path spaces carry their stated product sigma-algebras and the target path space is standard Borel. Fix a prefix z0:t−1. The append map jz0:t−1(zt)=(z0:t−1,zt) is measurable: the inverse image of a generating rectangle is either empty or the final-coordinate measurable set, and [F3] generates the target sigma-algebra from these rectangles. Thus A↦Mt(zt−1,jz0:t−1−1(A)) is the pushforward of the probability measure Mt(zt−1,⋅) and is a probability measure.

2.1F1F3F4F5step 1.1∎

The projection z0:t−1↦zt−1 is measurable, so composing each set-evaluation map zt−1↦Mt(zt−1,B) with this projection gives a probability kernel from the prefix space to Zt. The function (z0:t−1,zt)↦1A(z0:t−1,zt) is product-measurable. By [F5], its integral against this composed kernel is measurable in the prefix. Together with step 1.1, this proves that M‾t has probability-measure sections and measurable set evaluations, hence is a probability kernel. Iterating the definition appends each state using exactly Mt because at each step the indicator is evaluated on the already fixed prefix and the new coordinate.

DefinitionDefinition: Literature-sourcedProof: Not applicableOpen item page →

Conditionally linear-Gaussian state-space model

Definition

Assume AC. Let Zt take values in a standard-Borel space (Zt,Zt) and let Ut∈Rdt for a finite horizon 0≤t≤T, where each dt is a positive integer. For 1≤t≤T, let Yt∈Rpt with each pt a positive integer; observations begin at time 1. The nonlinear component has initial probability μ0 and transition probability kernels Mt(zt−1,dzt); its transition does not depend on Ut−1. Given the entire nonlinear path z0:T, write Z0:t=∏s=0tZs with its finite-product sigma-algebra and specify Borel maps m0:Z0→Rd0,P0:Z0→Rd0×d0, and, for 1≤t≤T, At:Z0:t→Rdt×dt−1,Qt:Z0:t→Rdt×dt,Ct:Z0:t→Rpt×dt,Rt:Z0:t→Rpt×pt. Require P0(z0) and Qt(z0:t) to be symmetric positive semidefinite, meaning vTPv≥0 for every matching vector v, and Rt(z0:t) to be symmetric positive definite, meaning vTRtv>0 for every nonzero v. Conditional on Z0:T=z0:T, the linear component and observations have the finite linear-Gaussian model, with the transition and observation equations for 1≤t≤T: U0∼N(m0(z0),P0(z0)),Ut=At(z0:t)Ut−1+ξt,Yt=Ct(z0:t)Ut+εt, where the centered Gaussian noises ξt∼N(0,Qt(z0:t)) and εt∼N(0,Rt(z0:t)) are mutually independent over time and independent of U0, under that conditional law. For every fixed path z0:T these are exactly the hypotheses of Linear-Gaussian state-space models with independent noises with deterministic matrices.

This hierarchical conditionally linear-Gaussian model is the input class for the Rao–Blackwellized filter below: it samples the nonlinear path and keeps the conditional Gaussian law of Ut analytically. It does not include a nonlinear transition whose law depends on Ut−1, nor does it assert that the marginal nonlinear process remains Markov after conditioning on all observations. Such models need their own marginal transition and backward kernels. A state-space filtering or smoothing law is a data-indexed regular conditional-distribution version as in Filtering, predictive, and smoothing laws in a finite-horizon state-space model; no pointwise uniqueness on null data histories is imposed.

LemmaStatement: Literature-sourcedProof: AI-adaptedOpen item page →

The Kalman filter is exact conditional on a nonlinear path

Statement

Assume the model of Conditionally linear-Gaussian state-space model and fix a nonlinear path z0:T. Run Exact linear-Gaussian Kalman filter on the resulting deterministic linear-Gaussian model for a fixed observation path y1:T. Write mt∣t−1,Pt∣t−1 and mt∣t,Pt∣t for its predicted and updated moments, and define vt=yt−Ct(z0:t)mt∣t−1,St=Ct(z0:t)Pt∣t−1Ct(z0:t)T+Rt(z0:t). Then L(Ut∣Z0:T=z0:T,Y1:t=y1:t) has the Gaussian version N(mt∣t,Pt∣t) for every 0≤t≤T. At time t≥1, the conditional observation density given the nonlinear path and earlier observations is ℓt(z0:t;y1:t)=(2π)−pt/2det⁡(St)−1/2exp⁡ ⁣(−12vtTSt−1vt). Each St is positive definite, each Pt∣t is positive semidefinite, and ℓt is finite, strictly positive, and Borel in the nonlinear path. For every 1≤t≤T whose observation evidence is finite positive, the conditional density of Y1:t given the nonlinear path is ∏s=1tℓs(z0:s;y1:s). Consequently the conditional law of Z0:t given Y1:t=y1:t is the normalized Feynman–Kac path measure with path-extension transitions induced by Ms, initial potential G0≡1, and potentials Gs(z0:s)=ℓs(z0:s;y1:s). At t=0 it is the initial nonlinear law μ0.

Facts & Assumptions

Given: AC, the fixed path and observations, and the conditional model in the Statement.

[A1]

AC is inherited from the Gaussian-law and Kalman conditional-law conventions. The Axiom of Choice

[F1]

Conditional on a fixed nonlinear path, the initial state and all state and observation noises are mutually independent Gaussian vectors with the displayed positive-semidefinite covariances; the coefficient matrices are deterministic for that path. Conditionally linear-Gaussian state-space model

[F2]

The finite-horizon linear-Gaussian model with independent noises has an exact Kalman filtering version whenever every innovation covariance is positive definite; state and noise covariances may be singular. The finite-horizon linear-Gaussian Kalman filter is exact

[F3]

One prediction and observation step from a Gaussian state with positive-semidefinite covariance produces a jointly Gaussian state-observation pair with innovation covariance S, and when S is positive definite the conditional state law has the stated Kalman update. One-step Gaussian prediction and conditioning

[F4]

A positive-definite covariance matrix gives the multivariate normal law its Lebesgue density (2π)−p/2det⁡(S)−1/2exp⁡(−vTS−1v/2). A positive-definite multivariate normal law has its Gaussian density

[F5]

A joint probability with a product-measurable density has the normalized conditional-density kernel on finite-positive evidence fibers. Conditional density formula

[F6]

A normalized Feynman–Kac path measure is the Markov path law weighted by the product of its nonnegative potentials, and it is normalized only at finite positive normalizer. Feynman–Kac path targets and normalizers

[F7]

Extending a nonlinear prefix by its transition kernel gives a probability kernel on the standard-Borel path spaces, and the ordered extensions give the nonlinear path law. Nonlinear path extension is a probability kernel

Proof

Given: The hypotheses in the Statement.

1.1A1F1givenalgebra

Initially P0∣0=P0(z0) is positive semidefinite. If Pt−1∣t−1 is positive semidefinite, then Pt∣t−1=AtPt−1∣t−1AtT+Qt is positive semidefinite because uTPt∣t−1u=(AtTu)TPt−1∣t−1(AtTu)+uTQtu≥0. For every nonzero observation vector a, aTSta=(CtTa)TPt∣t−1(CtTa)+aTRta>0, since the first term is nonnegative and Rt is positive definite. Induction proves all innovation matrices meet the Kalman algorithm's domain.

2.1F1F2F3F4givenstep 1.1

By [F1], for this fixed path the conditional model is the deterministic finite-horizon model of [F2]. Step 1.1 verifies its positive-innovation hypothesis, so [F2] gives the exact conditional Gaussian filter at every observation history, including singular state covariances. At each time, [F3] gives the marginal observation law N(Ctmt∣t−1,St); applying [F4] yields the displayed density.

3.1F1step 1.1step 2.1algebra

The coefficient functions are Borel by [F1]. Finite sums and products preserve Borel measurability, and matrix inversion and determinant are continuous on the positive-definite matrices established in step 1.1. The Kalman moment recursion and the displayed density are therefore Borel functions of the path. The covariance determinant is finite and positive and the exponential is finite and strictly positive, so ℓt has the claimed range.

4.1F1F5F6F7step 2.1step 3.1given∎

For a fixed nonlinear path, step 2.1 gives the one-step conditional density ℓs of Ys given Y1:s−1. By the defining event-integral identity for conditional densities, p(y1:s∣z)=p(y1:s−1∣z)ℓs(z0:s;y1:s) on finite-positive fibers; induction from the empty history, whose density is one, gives the product ∏s=1tℓs. By [F7], the ordered path-extension kernels are probability kernels on the standard-Borel path spaces and give the nonlinear path law. The joint law of Z0:t and Y1:t therefore has this product as its observation-density factor relative to that path law and Lebesgue observation measure. By [F5], conditioning on a history with finite positive evidence weights the nonlinear path law by this product and divides by its integral. Comparing with [F6] gives exactly the stated normalized Feynman–Kac path measure. This assertion is restricted to those finite-positive evidence fibers; null and infinite fibers are not normalized.

LemmaStatement: Literature-sourcedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Bayes factorization of the smoothing backward kernel

Statement

Assume AC, a finite-horizon Markov state-space model with standard-Borel states, dominated observation kernels, and data-indexed filtering and smoothing kernels as in Filtering, predictive, and smoothing laws in a finite-horizon state-space model. Fix an observation history y1:T in the full-measure set where the dominated filtering recursion Exact state-space filtering recursion under dominated observations applies. Write ηt for the filtering law of Xt given y1:t. Suppose the transition kernel Mt+1 from time t to t+1 has a product-measurable density ft+1(x′∣x) with respect to a sigma-finite measure λt+1, meaning Mt+1(x,A)=∫Aft+1(x′∣x) λt+1(dx′) for every state x and measurable set A. Put qt+1(x′)=∫ft+1(x′∣x) ηt(dx),Dt+1={x′:0<qt+1(x′)<∞}. The backward conditional kernel is Bt(x′,A)={∫Aft+1(x′∣x) ηt(dx)qt+1(x′),x′∈Dt+1,ηt(A),x′∉Dt+1. It is a probability-kernel version of the conditional law of Xt given Xt+1=x′ and y1:t. The finite-horizon smoothing kernel factors as ψT(dx0:T)=ηT(dxT)∏t=T−10Bt(xt+1,dxt) for observation-almost every full history, with the product interpreted as successive backwards kernel integration. If the transition is supplied only as a probability kernel, the same factorization uses a supplied regular conditional kernel of Xt given (Xt+1,Y1:t); no transition density is asserted in that case. Null-history values remain version-dependent.

Facts & Assumptions

Given: AC; the finite-horizon Markov state-space model; the stated filtering, predictive, and smoothing kernels; dominated observation laws; and the transition density or supplied backward conditional kernels.

[A1]

AC supports the finite-horizon kernel law and the regular conditional-law interfaces used below. The Axiom of Choice

[F1]

Filtering and smoothing kernels are data-indexed probability kernels and are regular conditional distributions after composition with the observed histories; conditional versions can differ on null histories. Filtering, predictive, and smoothing laws in a finite-horizon state-space model

[F2]

For standard-Borel state and observation spaces the finite-horizon filtering, predictive, and smoothing kernels exist. Filtering and finite-horizon smoothing laws exist

[F3]

Under dominated observations, the recursive normalized update gives the exact filtering kernels and their predictive laws. Exact state-space filtering recursion under dominated observations

[F4]

A joint probability with a product-measurable density has a conditional-density kernel equal to the normalized density on finite positive marginal-density fibers and a supplied probability filler elsewhere. Conditional density formula

[F5]

The finite-horizon state-space path law has the ordered Markov-kernel factorization; future transitions and observations depend on the past through the current state. Finite-horizon state-space kernel law exists and is unique

[F6]

Nonnegative product-measurable functions integrate measurably against probability kernels. Measurability of integration against a kernel

[F7]

Equality of finite measures on generating measurable rectangles extends to the generated history sigma-algebra. Dynkin's pi-lambda theorem

Proof

Given: The hypotheses in the Statement.

1.1A1F3F4F5F6given

Fix t<T and condition on Y1:t=y1:t. The conditional pair law of (Xt,Xt+1) is the ordered kernel integral ηt(dx)Mt+1(x,dx′) by [F3] and [F5]. In the density case this pair law has density ft+1(x′∣x) with respect to ηt×λt+1, and its second marginal has density qt+1(x′). Applying [F4] gives the displayed Bt on Dt+1 and the supplied filler ηt off it. The conditional-density result proves that Bt is an everywhere probability kernel and the conditional law of Xt given (Xt+1,y1:t) on its predictive support.

2.1F1F2F5step 1.1given

In the full path factorization [F5], after fixing Xt+1=x′ and the observations through time T, every factor after time t+1 depends only on x′ and the future states. Those factors cancel from the conditional distribution of Xt; the observation factor at time t+1 is also constant in Xt. The remaining factors are exactly the conditional pair law in step 1.1, so the conditional distribution of Xt given (Xt+1:T,Y1:T) equals Bt(Xt+1,⋅) almost surely. With a general transition kernel the same cancellation leaves the supplied regular conditional kernel, without evaluating a density or particle-point singleton.

3.1F1F2F6F7step 2.1given∎

Apply the conditional chain rule successively from t=T−1 down to 0. Step 2.1 identifies each conditional factor with Bt(Xt+1,⋅), while the terminal factor is the filtering law ηT. Integrating first over rectangles in the finite product state space gives the displayed product kernel; [F6] makes each iterated kernel measurable, and [F7] extends the conditional identities to all Borel path events. Thus the product is a version of the finite-horizon smoothing kernel. The argument concerns histories under their actual observation law and makes no pointwise uniqueness claim on null histories.

AlgorithmAlgorithm: Literature-sourcedProof: Not applicablejudge pass (gpt-6-luna)Open item page →

Particle backward simulator

Definition

Fix a finite horizon T≥0 and a requested path count S≥1, used in either mode below. In the particle mode, the inputs include a particle count N≥1 and normalized filtering clouds {(xti,wti):1≤i≤N},wti≥0,∑i=1Nwti=1, for 0≤t≤T, produced, for example, by Sequential importance resampling for Feynman–Kac path targets. Each xti is the time-t coordinate of its stored particle path. Write Mt+1 for the model transition kernel and require a product-measurable density ft+1(x′∣x) relative to a declared sigma-finite measure λt+1, meaning Mt+1(x,A)=∫Aft+1(x′∣x) λt+1(dx′) for each measurable A. For each t<T, define the predictive score with zero-weight terms omitted: qt+1N(x′)=∑i:wti>0wtift+1(x′∣xti). For particle-mode path sampling, define the set of reachable indices recursively by RT={j:wTj>0}. Descending from t=T−1 to 0, require qt+1N(xt+1j)∈(0,∞) for every j∈Rt+1, and put Rt=⋃j∈Rt+1{i:wti>0, ft+1(xt+1j∣xti)>0}. These are exactly the indices that can be drawn with positive probability at the corresponding backward step. For the all-marginals mode below, require instead that qt+1N(xt+1j)∈(0,∞) whenever the current smoothing weight wˉt+1∣Tj is positive. Thus no denominator is required for an omitted zero-weight term. At T=0 there are no denominator conditions.

In particle mode, repeat independently for s=1,…,S:

  1. Draw ITs from {1,…,N} with probabilities wTi and set X~Ts=xTITs.
  2. For t=T−1,T−2,…,0, set bti=0 without evaluating the density whenever wti=0. For wti>0, set bti(X~t+1s)=wtift+1(X~t+1s∣xti)qt+1N(X~t+1s). Draw Its from this probability vector, and set X~ts=xtIts.
  3. Return the tuple X~0:Ts=(x0I0s,…,xTITs). This is a draw from the particle backward approximation to the smoothing path law. The coordinates are selected by separate backward indices and need not be the stored forward ancestor history of any one particle. The particle path-sampling output is the list X~0:T1,…,X~0:TS.

If an exact filtering kernel ηT and supplied backward conditional kernels Bt from Bayes factorization of the smoothing backward kernel are available for general transition kernels, there is a separate exact-kernel mode: draw S conditionally independent paths, each by drawing XT∼ηT and then drawing Xt∼Bt(Xt+1,⋅) successively backward. This mode uses the actual kernels; it does not evaluate a transition density or a kernel on particle singletons. It returns exact smoothing paths under the supplied conditional versions wherever their factorization holds.

An optional all-marginals mode computes particle smoothing weights instead of drawing paths. Initialize wˉT∣Tj=wTj. For t=T−1,…,0, let Jt+1={j:wˉt+1∣Tj>0}. For each j∈Jt+1 and i with wti>0, set bti,j=wtift+1(xt+1j∣xti)qt+1N(xt+1j); set bti,j=0 without evaluating the density if j∉Jt+1 or wti=0. Update wˉt∣Ti=∑j∈Jt+1wˉt+1∣Tjbti,j. For every active j, (bti,j)i=1N is a probability vector, so the raw updated values are nonnegative and already sum to one; explicit normalization leaves them unchanged. Return ∑iwˉt∣Tiδxti as the approximate smoothed marginal at time t. The algorithm makes no finite-particle accuracy, consistency, or long-time stability claim.

Remarks

When a required density denominator is zero or infinite, the corresponding mode is inadmissible; the algorithm does not replace it with uniform weights. Zero filtering or smoothing weights are omitted before density evaluation, so no term evaluates 0⋅∞ or 0/0. For a general transition kernel, use an exact supplied backward conditional kernel as in the second mode, or provide a valid dominating-density interface. A fixed-lag target remains a truncated-observation target; see Fixed-lag particle smoother.

AlgorithmAlgorithm: Literature-sourcedProof: Not applicableOpen item page →

Rao–Blackwellized particle filter

Definition

Use the conditionally linear-Gaussian model of Conditionally linear-Gaussian state-space model and a fixed observation path y1:T. For each 0≤t≤T, let Pˉt be the nonlinear path law generated by μ0 and the path-extension kernels from Nonlinear path extension is a probability kernel, and put ct(y1:t)=∫Z0:t∏s=1tℓs(z0:s;y1:s) Pˉt(dz0:t),c0=1. Here ℓs is the conditional observation density supplied by The Kalman filter is exact conditional on a nonlinear path. For the claim that the procedure targets the nonlinear filtering law at every prefix, assume 0<ct(y1:t)<∞ for every t; this is the finite-positive normalizer condition for the normalized Feynman–Kac target. The Kalman likelihood factorization identifies ct with the observation evidence density and the normalized path target with the exact conditional law of Z0:t given Y1:t=y1:t. The particle procedure itself uses finite positive per-particle likelihoods, so each of its empirical weight normalizers is finite positive. The particle state at time t is the full nonlinear history z0:t; finite products of the standard-Borel state spaces are standard Borel. Its transition appends a draw zt∼Mt(zt−1,⋅); the resulting path-extension probability kernel and standard-Borel path space are supplied by Nonlinear path extension is a probability kernel. Set the initial Feynman–Kac potential to G0≡1 and the time-t potential to the conditional observation density Gt(z0:t)=ℓt(z0:t;y1:t) from The Kalman filter is exact conditional on a nonlinear path. Use the same path-extension kernel as target and proposal, so the initial and transition Radon–Nikodym weights are identically one. Run Sequential importance resampling for Feynman–Kac path targets with multinomial resampling to approximate the filtering law of the nonlinear path. Each particle stores alongside its path the conditional Gaussian moments of Ut.

Initialize N≥1 particles by drawing z0i∼μ0 independently, setting w0i=1/N, m0∣0i=m0(z0i), and P0∣0i=P0(z0i). For each t=1,…,T:

  1. Draw ancestor indices Jt1,…,JtN independently with probabilities (wt−11,…,wt−1N) and append independent transitions zti∼Mt(zt−1Jti,⋅).
  2. For each particle, abbreviate its appended path by z0:ti and compute mt∣t−1i=At(z0:ti)mt−1∣t−1Jti,Pt∣t−1i=At(z0:ti)Pt−1∣t−1JtiAt(z0:ti)T+Qt(z0:ti). Form vti=yt−Ct(z0:ti)mt∣t−1i and Sti=Ct(z0:ti)Pt∣t−1iCt(z0:ti)T+Rt(z0:ti).
  3. Set the incremental weight to the finite positive Gaussian density ati=(2π)−pt/2det⁡(Sti)−1/2exp⁡ ⁣(−12(vti)T(Sti)−1vti), and normalize wti=ati/∑jatj.
  4. Update the conditional Gaussian moments by Kti=Pt∣t−1iCt(z0:ti)T(Sti)−1,mt∣ti=mt∣t−1i+Ktivti,Pt∣ti=Pt∣t−1i−KtiSti(Kti)T.

The procedure returns the weighted nonlinear particle paths and the Gaussian mixture π^tN(dut,dz0:t)=∑i=1NwtiN(dut;mt∣ti,Pt∣ti) δz0:ti(dz0:t). Its conditional mean is ∑iwtimt∣ti and its conditional covariance is ∑iwti[Pt∣ti+(mt∣ti−mˉt)(mt∣ti−mˉt)T], where mˉt=∑iwtimt∣ti. These are moments of the finite mixture approximation; for finite N the algorithm remains an approximation to the full nonlinear filter. It makes no general variance-reduction, convergence-rate, or long-time accuracy claim.

Remarks

For every particle, Pt∣t−1i is positive semidefinite and Rt(z0:ti) is positive definite, so Sti is positive definite and the Kalman update and Gaussian density are defined. Conditional exactness of each Gaussian component is supplied by The Kalman filter is exact conditional on a nonlinear path. More precisely, each stored component is the conditional law of Ut given its prefix Z0:t=z0:ti and Y1:t=y1:t. This follows by induction: at time zero it is the specified Gaussian law; at each later step the appended nonlinear transition is Mt(zt−1,⋅) and does not depend on Ut−1, so conditioning on the appended state does not change the parent Gaussian component, after which the Kalman prediction and observation update give the stated component. Equivalently, the Kalman lemma's conditional law given the full nonlinear path depends through time t only on z0:t; future nonlinear transitions are independent of U0:t and Y1:t given the prefix, depend only on the current nonlinear state, and integrate to one. Integrating over zt+1:T therefore leaves that same Gaussian law given the prefix. The mixture over nonlinear paths is still represented by finitely many particles.

LemmaStatement: Literature-sourcedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Finite-horizon bootstrap particle filters are weakly consistent

Statement

Assume AC. Let E0,…,ET be compact metric spaces, let μ0 be a probability on E0, and let Mt be a Feller probability kernel from Et−1 to Et. Here Feller means that x↦Mth(x):=∫h(x′)Mt(x,dx′) is continuous for every bounded continuous real h on Et. Let each potential Gt:Et→R be continuous and satisfy fixed bounds 0<c≤Gt(x)≤C<∞. Let PtM be the Markov path law and Zt=∫∏s=0tGs(xs) PtM(dx0:t) the Feynman–Kac normalizer from Feynman–Kac path targets and normalizers. Since PtM is a probability, ct+1≤Zt≤Ct+1, so the normalized path target exists. For the initial law and transitions use the bootstrap proposals ν0=μ0, Rt=Mt, initial potential G0, and multinomial resampling in Sequential importance resampling for Feynman–Kac path targets. Write ηt for the last-state marginal of γt/Zt and ηtN=∑iwtiδXti for the particle filter's current weighted empirical measure. For every fixed t≤T, ηtN⇒ηtin probability as N→∞, where convergence in probability means that for every bounded continuous h:Et→R, ∫h dηtN→∫h dηt in probability. This is a fixed-horizon, positive-bounded-potential result; it asserts no time-uniform bound and no particle central limit theorem.

Facts & Assumptions

Given: The hypotheses in the Statement, a finite horizon, and the multinomial bootstrap particle system.

[A1]

AC is assumed by the finite-horizon Feynman–Kac path-law convention used to define the target. The Axiom of Choice

[F1]

The bootstrap specialization of the sequential importance-resampling algorithm uses IID initial particles, multinomial parent indices, conditionally independent propagation through Mt, and incremental weights Gt(Xti). Sequential importance resampling for Feynman–Kac path targets

[F2]

Multinomial parent indices are conditionally IID with the normalized input weights. Multinomial and residual offspring resampling

[F3]

The normalized current-state marginals of the Feynman–Kac path measures obey η0(h)=μ0(G0h)/μ0(G0) and ηt(h)=ηt−1(Mt(Gth))/ηt−1(MtGt). Feynman–Kac path targets and normalizers Feynman–Kac path measures satisfy the forward recursion

[F4]

Weak convergence of probability measures is convergence of integrals against every bounded continuous function. Weak convergence of borel probability measures

[F5]

For nonnegative measurable F and a>0, μ(F≥a)≤a−1∫F dμ on any measure space. Chebyshev-Markov inequality for the integral

Proof

Given: The hypotheses in the Statement. The empirical measure before potential weighting at time t is denoted νtN=N−1∑iδXti.

1.1A1F1F3F5given

At time zero, for any bounded continuous h, put Vi=G0(X0i)h(X0i). Expanding the squared centered sample average, the cross terms vanish by independence and the diagonal terms give E[(ν0N(G0h)−μ0(G0h))2]≤C2∥h∥∞2/N. The same calculation with Vi=G0(X0i) gives the denominator bound C2/N. Applying [F5] to each squared error shows both averages converge in probability to their μ0 integrals. The denominator limit is at least c, so the ratio η0N(h)=ν0N(G0h)/ν0N(G0) converges in probability to μ0(G0h)/μ0(G0)=η0(h).

1.2F1F2F4F5given

Suppose ηt−1N(g)→ηt−1(g) in probability for every bounded continuous g. Conditional on the previous particles, [F1]–[F2] make Xt1,…,XtN IID with common law ηt−1NMt. For bounded continuous h, the squared error of their empirical average under this product law is the sum of N diagonal centered terms divided by N2; the cross terms vanish by independence, and each diagonal term is at most ∥h∥∞2. Thus its integral is at most ∥h∥∞2/N. Applying [F5] under the conditional product law and then integrating over the previous particles gives νtN(h)−ηt−1N(Mth)→0 in probability. The Feller hypothesis makes Mth bounded continuous, so the induction hypothesis gives ηt−1N(Mth)→ηt−1(Mth).

2.1A1F1F3step 1.1step 1.2givenalgebra∎

Apply step 1.2 to h and Gth, both bounded continuous. Then ηtN(h)=νtN(Gth)/νtN(Gt); the denominator converges to ηt−1(MtGt)≥c. The ratio therefore converges in probability to ηt−1(Mt(Gth))/ηt−1(MtGt)=ηt(h) by [F3]. Induction from step 1.1 proves the assertion for each fixed t≤T. The lower bound c rules out zero normalizers, while the upper bound C gives the finite variance bounds used above.

AlgorithmAlgorithm: Literature-sourcedProof: Not applicablejudge pass (gpt-6-luna)Open item page →

Fixed-lag particle smoother

Definition

For a finite horizon T≥0, fix an integer lag L≥0, a path count S≥1, and the normalized filtering particle clouds and transition inputs required by Particle backward simulator. For each time t∈{0,…,T}, put st=min⁡(t+L,T). Independently for each t, run the particle backward simulator using only the filtering clouds at times 0,…,st and request S paths. Retain their time-t coordinates X~tt,1,…,X~tt,S and return the empirical measure η^t∣stS=1S∑r=1SδX~tt,r. In particle mode this empirical law approximates L(Xt∣Y1:st), not the full smoothing law L(Xt∣Y1:T) unless st=T or the two conditional laws happen to agree. The same procedure can use supplied exact backward kernels when the model has no transition density; for each st it uses the supplied filtering kernel at y1:st and the backward kernels for the corresponding prefix histories. On histories where these kernels factor the truncated smoother, it samples that exact conditional law.

The procedure returns one truncated smoothing marginal per t. It does not assert a bound on the lag bias, a forgetting rate, or convergence to the full-data smoother for fixed L. Those conclusions require separate conditions on the model.

TheoremStatement: Literature-sourcedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Normalization and operation counts for particle backward smoothing

Statement

Assume the finite particle-mode inputs and denominator conditions of Particle backward simulator. The backward index probabilities at each step are nonnegative and sum to one. In the all-marginals recursion, the raw updated smoothing weights also sum to one, so the optional explicit normalization in the algorithm leaves them unchanged. Count one transition density evaluation and a bounded number of real arithmetic operations as unit cost, and sample from a categorical vector by a linear scan of its N entries. Then drawing S backward paths costs O(SN(T+1)) operations, including terminal draws, and computing all smoothed marginal weights costs O(N+N2T), including initialization and output. For T≥1 these are respectively O(SNT) and O(N2T); for fixed S, path sampling costs O(N(T+1)).

Facts & Assumptions

Given: Normalized filtering weights wti, finite positive backward denominators, the all-marginals update in the algorithm, and the unit-cost convention in the Statement.

[F1]

For each reachable child value x′, the particle backward probabilities omit indices with wti=0 and divide the remaining scores by the finite positive score sum qt+1N(x′). Particle backward simulator

[F2]

The all-marginals recursion forms a probability vector for each child with positive smoothing weight, omits zero filtering and smoothing weights before evaluating transition densities, and updates by mixing those vectors with wˉt+1∣T, initialized by wˉT∣T=wT. Particle backward simulator

Proof

Given: The hypotheses in the Statement.

1.1F1F2givenalgebra

For any child value x′ at which a backward weight vector is required, the mode's admissibility condition gives 0<qt+1N(x′)<∞. For each index with wti=0 the algorithm sets its backward probability to zero without evaluating its density; for each positive-weight index the score is finite and nonnegative. Summing over i therefore gives ∑i:wti>0wtift+1(x′∣xti)/qt+1N(x′)=1. Thus each required backward vector is a probability vector.

2.1F2givenstep 1.1algebra

Suppose ∑jwˉt+1∣Tj=1. For every j with wˉt+1∣Tj>0, admissibility makes its score sum finite positive, and the associated vector (bti,j)i sums to one by step 1.1. The raw update is wˉt∣Ti=∑j:wˉt+1∣Tj>0wˉt+1∣Tjbti,j. Summing over i gives ∑j:wˉt+1∣Tj>0wˉt+1∣Tj=1. Since wˉT∣T=wT sums to one, backward induction proves every update is already normalized; zero smoothing-weight terms are never evaluated.

3.1F1F2given∎

At each of the T backward times for one sampled path, the algorithm evaluates N transition scores and scans N probabilities; terminal sampling also scans N entries. Storing the path costs O(T+1), so S paths take O(SN(T+1)) operations. In the all-marginals recursion, initialization and output cost O(N(T+1)), while each backward time evaluates one transition score and performs bounded arithmetic for each of the N2 past/future particle pairs. The total is O(N(T+1)+N2T)=O(N+N2T) because N≥1. For fixed S this gives O(N(T+1)) path cost, and when T≥1 the bounds reduce to O(SNT) and O(N2T).

TheoremStatement: Literature-sourcedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Fixed-horizon particle backward smoothing is consistent under stated conditions

Statement

Assume AC and a finite-horizon state-space model with compact metric state spaces E0,…,ET, dominated observation kernels, and an observation history y1:T in the full-measure finite-positive set where Bayes factorization of the smoothing backward kernel applies. Let gt(x,y) be the specified product-measurable observation density relative to its sigma-finite observation measure, as in Exact state-space filtering recursion under dominated observations, and set Gt(x)=gt(x,yt) for 1≤t≤T and G0≡1. Suppose each Gt is continuous and there are constants 0<c≤1≤C<∞ such that c≤Gt(x)≤C for every state and time. For each 0≤t<T, let Mt+1 be the state transition from time t to time t+1 and suppose it has a jointly continuous density ft+1(x′∣x) relative to a Borel probability measure λt+1, meaning Mt+1(x,A)=∫Aft+1(x′∣x) λt+1(dx′) for measurable A, with uniform bounds 0<a≤ft+1(x′∣x)≤b<∞ for all x,x′. Write ηt for the exact filtering-kernel value at y1:t and ψT for the exact smoothing-kernel value at y1:T. Use the model initial law as the initial proposal, these same Mt as transition proposals, and these Gt as potentials in the multinomial bootstrap particle filter. With N≥1 particles, independently draw SN≥1 backward paths conditional on the resulting clouds, where SN→∞ as N→∞. Let ψ^TN be the conditional law of one backward-simulated path given the clouds. For every continuous Φ:E0×⋯×ET→R, ψ^TN(Φ)→ψT(Φ)in probability,1SN∑s=1SNΦ(X~0:Ts)→ψT(Φ)in probability. For a fixed number of simulated paths, their conditional path law is consistent but the empirical path average retains its Monte Carlo error. No time-uniform-in-T convergence claim is made.

Facts & Assumptions

Given: The assumptions above, fixed observations with finite positive evidence, and a bounded continuous test function Φ on the compact path space.

[A1]

AC is used through the finite-horizon Feynman–Kac and conditional smoothing-law constructions. The Axiom of Choice

[F1]

The filtering empirical measures converge weakly in probability under the bounded positive-potential, Feller, multinomial bootstrap assumptions. Finite-horizon bootstrap particle filters are weakly consistent

[F2]

The exact smoother factors into its terminal filtering law and the exact backward conditional kernels. Bayes factorization of the smoothing backward kernel

[F3]

Given filtering particles, the particle backward kernel weights each candidate state by its filter weight times the transition density and normalizes by the predictive density. Particle backward simulator

[F4]

Weak convergence tests against bounded continuous functions. Weak convergence of borel probability measures

[F5]

The nonnegative integral inequality bounds probabilities of squared deviations. Chebyshev-Markov inequality for the integral

[F6]

The observation-density recursion identifies each filtering kernel with the normalized Feynman–Kac update using Gt(x)=gt(x,yt) on finite-positive evidence histories. Exact state-space filtering recursion under dominated observations

Proof

Given: The hypotheses in the Statement.

1.1givenalgebra

For each 0≤t<T, let h be bounded continuous and let xn→x. Uniform continuity of ft+1 on the compact product gives sup⁡x′∣ft+1(x′∣xn)−ft+1(x′∣x)∣→0. Since λt+1 is a probability measure, ∣Mt+1h(xn)−Mt+1h(x)∣≤∥h∥∞sup⁡x′∣ft+1(x′∣xn)−ft+1(x′∣x)∣→0. Thus each transition is Feller.

2.1A1F1F2F3F6step 1.1given

By [F1] and [F6], for every 0≤t≤T the random filtering measure ηtN converges weakly in probability to the exact filtering law ηt at the fixed observation history. For each 0≤t<T, put qt+1(x′)=∫ft+1(x′∣x)ηt(dx) and qt+1N(x′)=∫ft+1(x′∣x)ηtN(dx). The density bounds imply a≤qt+1(x′),qt+1N(x′)≤b for every x′, so every backward denominator used by the algorithm is finite positive.

3.1F1F2F3step 2.1given

Fix 0≤t<T and a continuous h on Et. The families x↦ft+1(x′∣x) and x↦h(x)ft+1(x′∣x) indexed by x′∈Et+1 are uniformly bounded and equicontinuous: joint continuity on the compact product is uniformly continuous. For any ϵ>0, a finite ϵ-net of the compact parameter space gives a finite sup-norm net for each family. Weak convergence in probability from step 2.1 gives convergence of the integrals for every function in each finite net; since all measures have mass one, replacing a family member by a net function changes either integral by at most ϵ. Letting ϵ↓0 proves uniform-in-x′ convergence of both numerators and denominators. Division is stable because all denominators are at least a, so sup⁡x′∣BtNh(x′)−Bth(x′)∣→0 in probability for the empirical and exact backward kernels. The exact function Bth is continuous by dominated convergence.

3.2F2F3step 2.1givenalgebra

For each 0≤t<T, set ωf(δ)=sup⁡x,x′,x′′:d(x′,x′′)≤δ∣ft+1(x′∣x)−ft+1(x′′∣x)∣, which tends to zero by uniform continuity. The exact and empirical backward kernels have densities ft+1(x′∣x)/qt+1(x′) relative to ηt and ft+1(x′∣x)/qt+1N(x′) relative to ηtN, respectively. Using [F2]–[F3], q,qN∈[a,b] from step 2.1, and that both filtering measures have mass one, their total-variation distance at x′,x′′ is at most ωf(δ)(a−1+ba−2). Indeed, if H(u,x) is a continuous integrand indexed by remaining coordinates u, and xu′ denotes the next-state coordinate in u, then the difference of its integrals at u,u′ is bounded by sup⁡x∣H(u,x)−H(u′,x)∣+∥H∥∞∥B(⋅∣xu′)−B(⋅∣xu′′)∥TV; uniform continuity of H and the displayed kernel bound make this tend uniformly to zero as u′→u. Thus each backward integration preserves a common bound and modulus of equicontinuity over the remaining compact coordinates, uniformly over all particle clouds. Since T is finite, iterating this estimate yields one such class for every section in the finite telescoping sum.

4.1A1F1F2F3F4step 2.1step 3.1step 3.2given

Telescope the finite backward product by replacing one empirical kernel at a time with its exact counterpart. The uniform moduli from step 3.2 put every possible section, over all clouds and remaining coordinates, in a uniformly bounded equicontinuous class on a compact metric space. Such a class has a finite sup-norm net: choose a finite δ-net of the domain at a scale given by equicontinuity, quantize the bounded function values on those finitely many points, and retain one representative for each nonempty quantized pattern. Step 3.1 gives convergence for each fixed test in this finite net; since kernels are probabilities, the sup-norm approximation changes an integral difference by at most twice the net radius. The same finite-net argument and [F1] give convergence of the terminal empirical integrals uniformly over the resulting class. Thus every term in the finite telescoping sum tends to zero in probability, and the conditional path law ψ^TN converges weakly in the sense of [F4] to the exact product law ψT in [F2].

5.1F3F5step 4.1given∎

Conditional on the particle clouds, the SN backward paths are IID with law ψ^TN. Their conditional sample mean has variance at most ∥Φ∥∞2/SN. Applying [F5] to its squared centered deviation shows that its difference from ψ^TN(Φ) converges to zero in probability because SN→∞. Combining this with step 4.1 proves the second limit. If SN is fixed, this variance bound need not vanish, so no convergence of the path average is asserted.

TheoremStatement: Literature-sourcedProof: AI-adaptedOpen item page →

Exact-kernel fixed-lag smoothing targets the truncated conditional law

Statement

Assume AC and a finite-horizon Markov state-space model with standard-Borel state and observation spaces. Supply the exact filtering and backward conditional kernels of Bayes factorization of the smoothing backward kernel. Fix an observation history in the full-measure set on which their factorization holds for every prefix horizon s≤T. In the exact-kernel mode of Fixed-lag particle smoother, fix an integer lag L≥0 and t∈{0,…,T}, and set s=min⁡(t+L,T). Each returned path's time-t coordinate has conditional law L(Xt∣Y1:s) (for the supplied conditional versions), so, for any requested S≥1, the empirical measure of its S returned time-t coordinates is a Monte Carlo estimate of that marginal. The target equals the full smoothing marginal only when later observations do not change the conditional law; increasing the particle count cannot remove a difference caused by truncating the observation history.

Facts & Assumptions

Given: A finite-horizon state-space model with supplied exact filtering and backward conditional kernels, integer lag L≥0, and target time t∈{0,…,T}.

[A1]

AC is inherited through the finite-horizon conditional-law construction that supplies the filtering and backward kernels. The Axiom of Choice

[F1]

The fixed-lag algorithm sets s=min⁡(t+L,T), requests S≥1 paths using observations only through time s, and returns their time-t empirical measure. Fixed-lag particle smoother

[F2]

The exact terminal filter and backward conditional kernels factor the finite-horizon smoothing law. Bayes factorization of the smoothing backward kernel

Proof

Given: The hypotheses in the Statement.

1.1A1F2givenalgebra

Since L≥0 and 0≤t≤T, the integer s=min⁡(t+L,T) satisfies 0≤t≤s≤T. Apply [F2] at horizon s to the observation history Y1:s. Its terminal filtering kernel followed by the supplied backward conditional kernels gives a path with law L(X0:s∣Y1:s).

2.1A1F1F2step 1.1given∎

Each exact-kernel draw in [F1] has the path law from step 1.1 and returns its coordinate projection Xt. A coordinate projection of a random element with the path conditional law has the corresponding marginal conditional law, hence each draw has law L(Xt∣Y1:s); averaging the S point masses gives the stated Monte Carlo estimate. If conditioning on additional observations changes this marginal, the exact branch still conditions only on Y1:s, so increasing either the particle count or the number of backward draws cannot change its target.

5 · Examples, counterexamples and false statements

None yet.

Sources