How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Identifiability and approximation bias in computational inference
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Binary Operations, Monoids, Groups and Subgroups
- Compactness in Metric Spaces
- Completeness, Completion, and Uniform Continuity
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Determinants of Matrices over a Commutative Ring
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Domination and Likelihood Ratios
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Foundations of the Real Numbers for Analysis
- Fubini and Change of Variables
- Fundamental Trigonometric Identities
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Improper and Parameter-Dependent Multiple Integrals
- Improper Integrals
- Independence Borel Cantelli and Zero One Laws
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Stationary Markov Chains and Ergodic Limits
- Statistical Experiments, Models and Identifiability
- Statistical, resampling, simulation, and numerical error ledger
- Suprema and Infima
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Inverse and Implicit Function Theorems
- The Lebesgue Integral and the Convergence Theorems
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
Objective
This page separates the full-data inferential target from changes introduced by algorithms, summaries, asymptotic approximations, and numerical computation. It defines a fixed-data posterior only after a measurable likelihood version and finite positive evidence have been supplied, then places that target in a declared metric space with a finite approximation chain.
Identifiability is a property of the full sampling laws: equal laws must give equal values of the estimand. The examples show that this property does not prevent a summary from discarding information, a positive ABC tolerance from changing the conditional target, a mean-field ELBO optimizer from losing correlation, a Gaussian synthetic likelihood from changing a posterior, or a local Laplace mode from missing another global mode. The total-variation expectation bounds use the event-supremum convention: factor two for functions bounded in absolute value by , and the sharper bound for nonnegative functions between and .
For scalar chains, the pathwise signed identity is exact. For probability laws or other objects, the metric theorem gives a triangle bound only when every adjacent comparison uses the same metric on the same space. Neither result supplies independence, variance addition, global optimizer convergence, posterior consistency, or calibration. In particular, a model's identifiability does not imply that an approximation procedure preserves its exact inferential target.
The Gaussian mean-field calculation takes its reference area measure as supplied and obtains the needed length measure from a fixed unit-height strip. A local Darboux comparison proves its density normalizers and moments without adding a choice axiom or constructing those measures.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Total variation controls expectations of bounded functions
Statement
Let be a measurable space, let and be probability measures on it, and let be measurable with pointwise for some finite . With the convention one has For every measurable with pointwise, one also has Both integral differences are zero when .
Facts & Assumptions
Given: A measurable space , probability measures , and measurable real functions satisfying and .
A probability measure has total mass one. Probability measures and probability spaces
Total variation here is the event supremum and has no half-factor. Total variation distance for probability laws
On nonnegative simple functions, the nonnegative Lebesgue integral agrees with the simple integral. The nonnegative integral agrees with the simple integral on simple functions
The simple integral is the sum of the coefficients times the measures of the level sets; in particular, an indicator integrates to the measure of its set. The integral of a nonnegative simple function
The nonnegative integral is additive, monotone, and nonnegatively homogeneous. Additivity of the nonnegative Lebesgue integral Monotonicity and nonnegative homogeneity of the nonnegative integral
A real measurable function is integrable when its absolute value has finite nonnegative integral; the integral is linear on integrable functions. Integrable real and complex functions, and their integrals The Lebesgue integral is linear on
For every there is an integer with . For every in a complete ordered field there is a natural with
Proof
Given: The hypotheses in the Statement.
If , then and pointwise, so both claims hold. To prove the nonnegative claim for an arbitrary finite bound , let be measurable with , fix an integer , put , and define for and . The sets are measurable, is nonnegative simple, and pointwise.
By [F3]–[F5], and likewise for , so . Also and , because and both measures have mass one. The triangle inequality therefore gives .
Given any , choose by [F7] with . The estimate in step 2.1 then gives . If the bound by failed, choosing to be half the positive excess would contradict this inequality. Taking and proves the stated nonnegative case when .
For the signed case with , let . Then is measurable and , so step 3.1 with and gives . Also , so [F1], [F3]–[F5] give and ; hence is integrable under both measures by [F6]. The constant has integral under each probability measure, so linearity [F6] gives . This proves the signed case.
Exact inferential targets and approximation chains
Definition
Fix a measurable parameter space , a prior probability measure on it, observed data , and an explicitly supplied -measurable likelihood version . Define the evidence When , the exact inferential target is the probability measure The measure is well-defined by the indefinite-integral construction The indefinite integral of a nonnegative measurable function is a measure. This is a fixed-data definition: Likelihood densities selects, under AC, a measurable data-space density representative for each parameter , but does not guarantee measurability of . Here the fixed-data likelihood version and its parameter measurability are supplied explicitly; no posterior is assigned when the evidence is zero or infinite.
For approximation accounting, declare a metric space and a finite chain of elements , where and whenever the exact target is included. The first distance is the declared reference-to-target discrepancy; later adjacent distances and are approximation and computation discrepancies on the same metric scale. For probability measures on a common measurable space, total variation may be used with the event-supremum convention of Total variation distance for probability laws. For scalar random quantities on one probability space, the statistical and computational stages are the same-scale signed differences defined in Successive statistical and computational error targets. This notation does not assert independence, unbiasedness, convergence, or that any numerical method attains a global optimum.
Metric approximation error decomposes along a finite reference chain
Statement
Let be a metric space, let be an integer, and take . Then where the sum is empty when . If and is the exact target from Exact inferential targets and approximation chains, the first term is the declared reference-to-target discrepancy and subsequent terms quantify adjacent approximation changes in the same metric. The scalar identity and absolute bound of Pathwise error decomposition along a reference chain are exact telescoping statements. No independence or default variance-addition rule follows; the MSE identity in MSE of a sum of error components includes covariance terms retains total bias and covariance terms.
Facts & Assumptions
Given: A metric space , an integer , and points .
A metric is symmetric and satisfies . Metric space: iff , symmetry, and the triangle inequality; pseudometric and ultrametric
Scalar ledger stages are adjacent signed differences on one stated scale; the definition alone asserts no independence, centering, or unbiasedness. Successive statistical and computational error targets
A finite scalar ledger chain satisfies the signed telescoping identity and its absolute-value bound without an independence assumption. Pathwise error decomposition along a reference chain
For square-integrable scalar error terms, the MSE of their sum includes squared total bias and covariance terms; summing component variances alone is generally not the identity. MSE of a sum of error components includes covariance terms
Proof
Given: The hypotheses in the Statement.
We prove by induction on that . For both sides are zero; for this is equality. If it holds through , then the triangle inequality [F1] gives .
Apply the triangle inequality once more to and then step 1.1 to bound by the displayed sum. For a scalar chain, [F2] specifies the same-scale adjacent errors and [F3] gives their exact signed telescope; when the terms are square-integrable, [F4] explains why squaring them retains bias and covariance terms rather than giving an automatic variance sum.
Gaussian density integrals for supplied length measures
Statement
For , suppose a countably additive measure on is supplied and satisfies No assertion about constructing these measures is made.
- If is a nondegenerate compact box and is bounded, Borel measurable and Riemann integrable, then its integral against the supplied measure equals its proper Riemann integral. Nonnegative Borel functions on the whole space are computed from increasing compact-box cutoffs by monotone convergence.
- For the supplied , every , and satisfy The signed first moment is absolutely integrable. These are density-integral statements and require no choice axiom in addition to the supplied measures.
Facts & Assumptions
Given: The supplied Borel measures and their half-open-box volumes in the Statement.
Borel sets form the sigma-algebra generated by open sets. A continuous real function is Borel measurable: its inverse images of open sets are open, and the sets whose inverse images are Borel form a sigma-algebra. The Borel sigma-algebra of a topological space
Measures are monotone; nonnegative simple integrals are finite sums of coefficients times cell measures and agree with the nonnegative integral. Measures are monotone, The integral of a nonnegative simple function, The nonnegative integral agrees with the simple integral on simple functions
Nonnegative integrals are monotone and homogeneous, and integrals are linear on absolutely integrable functions. Monotonicity and nonnegative homogeneity of the nonnegative integral, The Lebesgue integral is linear on
A bounded Riemann integrand has equal upper and lower Darboux integrals; continuous one-variable functions on compact intervals are Riemann integrable. The multidimensional Darboux and tagged-mesh definitions of the Riemann integral agree, A continuous function on is Riemann integrable, by Heine-Cantor and Riemann's criterion
Monotone convergence and dominated convergence apply on a supplied measure space. Monotone convergence for the integral, Dominated convergence
The improper Riemann Gaussian integral is ; proper substitution and integration by parts hold on compact intervals. The Gaussian integral , Substitution: if is differentiable on with integrable and is continuous on an interval containing , then , If are differentiable on with integrable, then
The exponential is continuously differentiable with derivative itself, and the chain rule applies. Exponential growth dominates each fixed polynomial, and a positive real has a positive square root. The exponential function is smooth and , The chain rule, in one line from Carathéodory: if is differentiable at and is differentiable at , then is differentiable at with , The exponential dominates every fixed nonnegative integer power at , Square roots exist: a unique with ; the positives are
Proof
Every compact box has finite supplied measure, since it is contained in a larger half-open box. A bounded coordinate face has measure zero: enclose it in a half-open slab of arbitrary positive thickness , with the other side lengths fixed and positive. Its measure is at most by the given volume formula and [F2], and so must be zero. In dimension one this says that singletons are null. Consequently compact boxes have their usual volumes, and disjointifying a finite grid of closed cells only removes null faces.
For a nonnegative bounded Borel Riemann integrand on , take the infimum and supremum of on each cell of any finite grid. The corresponding disjoint-cell simple functions bound , and [F2] and step 1.1 make their integrals exactly the lower and upper Darboux sums. By [F3] and [F4], the integral of is squeezed to its Riemann value. For signed bounded , add a finite constant to make it nonnegative and subtract that constant's finite integral using [F3]. This proves the compact comparison. For nonnegative Borel on the whole space, , so [F5] gives the cutoff assertion. The grids, extrema, and cutoff sequence are finite or explicitly specified; no countable selection is used.
Put . It is continuous and Borel by [F1] and [F7]. On , proper substitution in [F6] computes its Riemann integral. As , [F6]'s improper Gaussian value makes this tend to one. Step 2.1 identifies each compact integral with its supplied-measure integral, and [F5] gives .
Since by [F7], compact integration by parts [F6] gives All functions and derivatives here are continuous, so the proper integral hypotheses hold by [F4]. Also : for , , hence by [F7]. Apply step 2.1 and monotone convergence [F5] to the nonnegative cutoffs. Step 3.1 then gives .
The bound and steps 3.1, 4.1 make integrable. On each symmetric compact interval, the Riemann integral of is zero by oddness, using the proper substitution . Step 2.1 transfers these compact integrals to the supplied measure. Dominated convergence [F5], with majorant , yields .
Fix and . On the explicitly specified intervals , proper substitution gives compact integrals of , and equal to the corresponding integrals of , and on . Step 2.1 and monotone convergence give mass one and centered second moment . Since , the centered first moment is absolutely integrable, and the same dominated-cutoff argument as step 5.1 gives centered mean zero. Linearity then gives raw mean . This proves both claims for the supplied measures without constructing any new measure or invoking a choice-dependent normal-law supplier.
5 · Examples, counterexamples and false statements
None yet.
Sources
- Alison L. Gibbs and Francis E. Su, On Choosing and Bounding Probability Metrics, International Statistical Review 70(3), 419–435 (2002)
- David A. Levin, Yuval Peres, and Elizabeth L. Wilmer, Markov Chains and Mixing Times, 2nd ed.
- Anthony Davison and David Hinkley, Bootstrap Methods and Their Application (1997), Chapter 2 §2.5
- John K. Hunter, Measure Theory, Chapter4, Theorem4.28 and simple integration definitions
- Terence Tao, An Introduction to Measure Theory, Darboux integral and compatibility with the Riemann integral
- Rick Durrett, Probability: Theory and Examples, fifth edition, Gaussian density and moments