How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Fixed-interval Gaussian smoothing and RTS recursion
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Central Limit Theorems
- Characteristic Functions Inversion and Continuity
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Conditional Distributions and Regular Conditional Probability
- Conditional Expectation
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Conjugate families and Gaussian conditioning
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Cyclic Groups and Direct Products
- Density Separability and Convolution in Lᵖ
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Direct Matrix Factorisations: LU, Cholesky and QR
- Discrete Time Martingales
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- Estimators and Randomized Procedures
- Exact linear-Gaussian Kalman filtering
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Foundations of the Real Numbers for Analysis
- Fourier Transform Convolution and Approximate Identities
- Fubini and Change of Variables
- Fundamental Trigonometric Identities
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Hausdorff via the Diagonal
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Improper and Parameter-Dependent Multiple Integrals
- Improper Integrals
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Lebesgue Measure on Euclidean Space
- Lebesgue-Stieltjes Measures and Distribution Functions
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Markov Kernels and Markov Chains
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Mixed effects and longitudinal models
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Partitions of Unity and Paracompactness
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Radon Measures and the Riesz Markov Kakutani Theorem
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Scientific model contracts and applicability
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Splitting Fields
- Standard-Borel Real Codings and Determining Classes
- State-space model laws
- State-space models and exact Bayesian filtering
- Stationary means and sample autocovariance
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Exponential Function
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Galois Correspondence
- The Inverse and Implicit Function Theorems
- The Lebesgue and Riemann Integrals Compared
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Maximal Function and Lebesgue Differentiation
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Urysohn's Lemma and the Tietze Extension Theorem
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
2 · Summary
Objective
This page defines the marginal law of a state given the full finite observation interval, proves the backward Gaussian conditional kernel, and states the Rauch–Tung–Striebel (RTS) algorithm and its exactness theorem. The forward filter may have singular state and noise covariances, and the conditional laws may be degenerate. Each innovation covariance solved by the forward filter and each one-step forecast covariance inverted by the RTS pass must be positive definite. A singular forecast is outside the stated RTS recursion; this page asserts no pseudoinverse extension or numerical stability result.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Fixed-interval smoothing law in a linear-Gaussian model
Definition
Assume AC and fix a finite-horizon linear-Gaussian state-space model (Linear-Gaussian state-space models with independent noises) with states , observations , and Borel observation space , with the empty product a singleton when . For , a fixed-interval smoothing kernel for is an everywhere-defined probability kernel whose composition with the full observation vector is a regular conditional distribution of given . Thus it is the single-time marginal smoothing law after all observations through time are supplied. The full-path smoothing kernel and its version convention are defined in Filtering, predictive, and smoothing laws in a finite-horizon state-space model.
This definition does not assert that such a kernel exists or is unique at observation values in a null set. The theorem on this page constructs a Gaussian version under its explicit forecast and innovation assumptions.
The backward Gaussian kernel remains valid after future observations
Statement
Assume AC. Let follow a finite-horizon linear-Gaussian model as in Linear-Gaussian state-space models with independent noises. Suppose the Kalman filter of Exact linear-Gaussian Kalman filter is admissible: every innovation covariance it solves is positive definite. Fix , and let and be the corresponding filtered and one-step predicted quantities. Assume in addition that . Put Then , and the formula defines an everywhere probability kernel. It is a conditional law of given and also a version of the conditional law of given under the full finite-horizon model. Thus future observations do not change this backward kernel once is also given. The inverse is the ordinary inverse of the positive-definite forecast covariance; no singular-forecast extension is asserted.
Facts & Assumptions
Given: AC, the finite-horizon model in the Statement, admissible filter histories, and .
AC is the Axiom of Choice assumed by the Gaussian-law and conditional-Gaussian suppliers. The Axiom of Choice.
The model has affine state and observation equations; its initial, process, and measurement Gaussian vectors are mutually independent, and the process covariance is positive semidefinite. Linear-Gaussian state-space models with independent noises.
The Kalman algorithm predicts and . Exact linear-Gaussian Kalman filter.
For every observation history, the filtered law of is the probability kernel ; its covariance is positive semidefinite. The finite-horizon linear-Gaussian Kalman filter is exact.
An independent process noise extends the supplied filtering kernel to the joint conditional law, and measurable pushforwards remain conditional laws. Independent noise extends and pushes forward a conditional law.
A finite independent stack of Gaussian vectors is jointly Gaussian even when covariance blocks are singular. A finite stack of independent Gaussian vectors is jointly Gaussian.
For a jointly Gaussian pair with positive-semidefinite block covariance and positive-definite observed covariance , the everywhere conditional kernel is Gaussian with the Schur-complement covariance, which is positive semidefinite. Conditional law of a jointly Gaussian block with positive-definite observed covariance.
The finite linear-Gaussian path law is the ordered product of its transition and observation kernels. The finite linear-Gaussian state-space path is jointly Gaussian.
Integration of a nonnegative product-measurable function against a finite probability kernel is measurable in its parameter. Measurability of integration against a kernel.
A data-indexed state-space conditional law is an everywhere probability kernel whose composition with the data vector is an RCD; its values on null-data sets may vary. Filtering, predictive, and smoothing laws in a finite-horizon state-space model.
Under AC, is defined for every finite-dimensional symmetric positive-semidefinite , including singular . Multivariate normal law, including singular covariance.
Proof
Given: The hypotheses in the Statement.
Fix a history . By [F3], the conditional law of is . The next process noise is independent of the past by [F1], so [F4] extends this filtering kernel by and pushes it forward through . By [F5], is jointly Gaussian, and the projection characterization in [F10] makes its linear image jointly Gaussian. Its mean is , its state covariance is , its cross-covariance is , and its next-state covariance is . The latter block is positive definite by hypothesis. Apply [F6] with that observed block: the conditional mean and covariance are exactly the displayed parameters, so . The history mean is affine by [F2], and representing each Gaussian section as a translate of fixed plus [F8] gives joint measurability in . Thus is an everywhere probability kernel.
Write , , and . By [F7], the full path law factors by taking the law of , applying the transition kernel at , and then a future observation kernel formed by the remaining transition and observation kernels. The first two factors disintegrate as by step 1.1, where is the one-step predictive law. Substitution gives the joint factorization as the law of followed by , , and . The future kernel depends on the past only through , and its iterated integrals are measurable by [F8].
For any Borel set of and any Borel set in the product space of , integrate in the factorization from step 2.1. This gives . This is the RCD event identity for given ; its kernel properties were established in step 1.1. Since , it is also a version of the conditional law given . The factorization uses model kernels rather than observation densities, and the only inverse is of .
Rauch–Tung–Striebel fixed-interval Gaussian smoother
Definition
Fix a finite-horizon linear-Gaussian model from Linear-Gaussian state-space models with independent noises and data for which Exact linear-Gaussian Kalman filter is admissible. Its forward output contains filtered means and covariances and predicted means and covariances . Assume each forecast covariance used below is positive definite, meaning for every nonzero . Positive semidefinite means the same quadratic form is nonnegative for every .
The algorithm takes that forward output as input, initializes and for performs the following steps:
- Form the backward gain For the computation, factor with the unique positive-diagonal Cholesky factor from A matrix admits a Cholesky factorisation with positive diagonal exactly when it is Hermitian positive definite, and that factor is unique, then compute the rows of in increasing order by and compute the rows of in decreasing order by These recurrences give and , so ; no inverse is formed in the procedure.
- Update the smoothed mean and covariance:
Return . For the loop is empty and the output is the initial filtered pair. The algorithm is undefined if a forecast covariance to be solved is singular; it makes no pseudoinverse, complexity, rounding-error, or numerical-stability claim. The theorem on this page proves that the outputs are moments of the fixed-interval conditional laws under these hypotheses.
The Rauch–Tung–Striebel recursion gives fixed-interval Gaussian smoothing laws
Statement
Assume AC and fix a finite-horizon linear-Gaussian model (Linear-Gaussian state-space models with independent noises) with . Run the forward Kalman filter on data , with every innovation covariance positive definite. Also assume that every one-step forecast covariance is positive definite for . Let be the output of Rauch–Tung–Striebel fixed-interval Gaussian smoother applied to that forward output. Then, for every , is an everywhere-defined fixed-interval smoothing kernel for in the sense of Fixed-interval smoothing law in a linear-Gaussian model. In particular, . Singular initial, process, measurement, filtered, and smoothed covariances are allowed; only the innovation matrices solved by the filter and the forecast matrices inverted by this smoother must be positive definite. The formulas select a conditional-law version at every data value; other versions may differ on a set of observation data of probability zero. No pseudoinverse result for a singular forecast is asserted.
Facts & Assumptions
Given: AC, the finite linear-Gaussian model, positive-definite innovation covariances, and positive-definite forecast covariances as in the Statement.
AC is the Axiom of Choice assumed by the finite-dimensional Gaussian and conditional-law suppliers. The Axiom of Choice.
The model uses affine state and observation equations and permits positive-semidefinite, possibly singular, Gaussian covariance matrices. Linear-Gaussian state-space models with independent noises.
The forward procedure returns the filtered and predicted means and covariances used in the statement, and its linear solves are defined when the innovation covariances are positive definite. Exact linear-Gaussian Kalman filter.
For every observation history, is an exact filtering-kernel version, with . The finite-horizon linear-Gaussian Kalman filter is exact.
A fixed-interval smoothing kernel is a probability kernel whose composition with the complete observation vector is an RCD of given that vector. Fixed-interval smoothing law in a linear-Gaussian model.
The Gaussian backward kernel is an RCD of given , with mean affine in and fixed positive-semidefinite conditional covariance . The backward Gaussian kernel remains valid after future observations.
Integrating a nonnegative product-measurable function against a probability kernel gives a measurable function of the conditioning data. Measurability of integration against a kernel.
Increasing limits commute with nonnegative integrals; this yields countable additivity for measures defined by integrating a probability kernel. Monotone convergence for the integral.
Product Borel sigma-algebras are generated by measurable rectangles, and finite measures agreeing on a generating pi-system agree everywhere. The product sigma-algebra and its finite iterates, Dynkin's pi-lambda theorem.
Finite products of probability measures exist and satisfy the iterated integral formula on rectangles. For sigma-finite factors, the product measure exists, has the rectangle formula, is sigma-finite, and is unique.
A finite independent stack of Gaussian vectors is jointly Gaussian, including when its covariance blocks are singular. A finite stack of independent Gaussian vectors is jointly Gaussian.
Under AC, exists for every finite-dimensional symmetric positive-semidefinite matrix . Multivariate normal law, including singular covariance.
Coordinate projections under a product probability measure are independent random elements. Independent random elements.
The RTS algorithm computes its gain by the increasing-row and decreasing-row recurrences in its Definition. Rauch–Tung–Striebel fixed-interval Gaussian smoother.
Proof
Given: The hypotheses in the Statement.
At time , the conditioning data for the forward filter are exactly . By [F3], the terminal filter kernel is an everywhere conditional-law version of given these data, with . It is therefore the base case for the fixed-interval smoothing kernels in [F4].
Suppose the Gaussian kernel is an RCD of given . Define for each Borel state set . This is a probability kernel by [F5]–[F6]. To verify its RCD identity, define for Borel in the product of data and state spaces. Measurability follows from [F6]; for pairwise disjoint , monotone convergence gives countable additivity, and has total mass one. Its rectangle values equal those of the actual joint law of by the RCD identity for . By [F8], the measures agree on every Borel set. Thus for any Borel data set and state set , , where the last equality is [F5] applied to the conditioning event . Hence is the required RCD.
Write and as in [F5]. By [F13], row substitution gives and . Since , these equations yield and hence , exactly the gain in [F5]. On the product probability space carrying independent and , the integral in step 2.1 is the law of by [F9]. The covariance matrices of and are positive semidefinite by [F5] and the induction hypothesis, so both Gaussian laws exist by [A1, F11]. The product coordinates are independent by [F12]; [F10] makes their stack jointly Gaussian, and its affine image is Gaussian by the projection characterization in [F11]. Independence makes the cross-covariance terms vanish, so its mean is and its covariance is . This is exactly the smoother update in the statement and algorithm. The first covariance expression is positive semidefinite, so the updated covariance is positive semidefinite as well.
Starting from step 1.1, apply steps 2.1–3.1 for . The induction constructs an everywhere smoothing kernel at each time and identifies its mean and covariance with the algorithm output. When only the base case is needed. Positive definiteness is used only for the forecast inverses in [F5] and the forward innovation solves in [F2]; no singular forecast is inverted.
5 · Examples, counterexamples and false statements
None yet.