How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Learned reconstruction targets and risk
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Bayesian models, priors, and posterior laws
- Binary Operations, Monoids, Groups and Subgroups
- Bounded Linear Operators and Quotient Spaces
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Norms and Realification
- Complexification, Realification and Real Structures
- Conditional Distributions and Regular Conditional Probability
- Conditional Expectation
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Convergence: Nets and Filters
- Convexity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Darboux, L'Hôpital, and Taylor's Theorem
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Domination and Likelihood Ratios
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Estimators and Randomized Procedures
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Foundations of the Real Numbers for Analysis
- Function-space priors and sample regularity
- Hilbert Space Geometry and Riesz Representation
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Infinite Product Measures and Kolmogorov Extension
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Inverse maps, identifiability, and stability
- Lebesgue-Stieltjes Measures and Distribution Functions
- Likelihood potentials and posterior propriety
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Loss, Risk and Decision Theory
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Normed and Banach Spaces
- Norming and Separation under Hahn–Banach
- Order, Zorn's Lemma, and the Axiom of Choice
- Orthonormal Bases, Parseval and Fourier Series
- Outer Measure and the Caratheodory Extension Theorem
- Polynomial Rings, the Division Algorithm and Roots
- Posterior Prediction, Credible Sets, and Bayes Actions
- Posterior propriety and dominated Bayes formula
- Power Series and Real-Analytic Functions
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Standard-Borel Real Codings and Determining Classes
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Suprema and Infima
- The Analytic Hahn Banach Theorem
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral: Definition and Integrability
- The Topology of Euclidean Space
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
2 · Logical flowchart
3 · Definitions, theorems and proofs
The posterior mean is the unique squared-loss Bayes action in a Hilbert target
Statement
Assume the Axiom of Choice. Let be a measurable data space, let be a separable real Hilbert space, and fix a complete orthonormal basis , where is either finite with its supplied ordering or . A complex Hilbert signal space is included by viewing it as a real Hilbert space with inner product the real part of its complex inner product and supplying a real orthonormal basis. Let be a probability kernel from to with its norm Borel sigma-algebra. Define For every and , define where the last sum is the norm limit of its finite partial sums. Then , the sum defining exists for every , and is measurable. For every and every action , Thus is the unique finite-risk action minimizing posterior squared-error risk over all of , and it is a measurable Bayes action rule on . The minimization is over the full Hilbert space: the mean need not belong to a nonconvex admissible signal subset, and no perceptual-representativeness claim is made. For a probability space , let and be measurable random elements with . If the same is a supplied regular conditional law of given , write for the law of . Then has full -measure. Extend by zero to a measurable map ; the coordinates of are versions of , and is square-integrable. Any square-integrable -valued random variable whose basis coordinates are versions of those same conditional expectations equals almost surely. The RCD's values on -null data sets remain version choices.
For this measurability assertion, equip with the trace sigma-algebra inherited from .
Statement references
A measurable data space is a set with a specified sigma-algebra.
A probability kernel has measurable evaluations and probability-measure sections.
Kernel integrands are measurable on the product sigma-algebra.
A real Hilbert space is complete for its inner-product norm.
Separability supplies a countable dense subset.
The inner product induces the Hilbert norm and scalar coordinate functionals.
A Hilbert basis is a complete orthonormal family.
Under Countable Choice, basis coordinates satisfy Parseval's identity.
Under AC, scalar conditional expectation is the unique L2 projection.
A measurable rule with finite posterior risk attaining the minimum is a Bayes action rule.
Kernel integrals of scalar tests give conditional-expectation versions.
Scalar conditional-expectation versions agree almost surely.
Martin, §5.3.1, complete lecture notes
Facts & Assumptions
Given: AC; a measurable data space; a separable real Hilbert target with a supplied finite or countable complete orthonormal basis; and a supplied probability kernel on . The theorem is applied on the data domain of finite posterior second moment.
The Axiom of Choice gives a choice function for every family of nonempty sets. The Axiom of Choice
Countable Choice is the restriction of AC to countable families; it is assumed by the Parseval supplier below. The Axiom of Countable Choice ()
A probability kernel has a measurable evaluation for every Borel target set and a probability measure at every data point. Measure kernel and probability kernel
The product sigma-algebra makes the continuous norm and coordinate functions into product-measurable kernel integrands. The product sigma-algebra and its finite iterates, Real and complex inner-product spaces and their induced length, Cauchy–Schwarz: , with equality exactly for dependent pairs
Separability supplies an at-most-countable dense subset of . Separability: the existence of an at most countable dense subset
A real Hilbert space is complete for its inner-product norm, and a Hilbert basis is a complete orthonormal family. Hilbert space, Orthonormal families, complete orthonormal systems and Hilbert bases
For a complete orthonormal family, Parseval's identity equates the squared norm with the sum of squared coordinates; this supplier assumes Countable Choice. Parseval equivalences for an orthonormal family
A scalar conditional-expectation version is integrable, measurable with respect to its conditioning sigma-algebra, and satisfies the conditioning-event integral identities. Conditional expectation given a sigma algebra
Under AC, a scalar conditional expectation of an input is its orthogonal projection onto ; in particular its residual is orthogonal to constant random variables. Conditional expectation is the l2 orthogonal projection
Integrating a product-measurable nonnegative function against a probability kernel gives a measurable function; signed integrals are measurable on their absolute-integrability domain. Measurability of integration against a kernel
Increasing nonnegative measurable functions pass through their integrals by monotone convergence. Monotone convergence for the integral
A measurable action rule with finite posterior risk attaining the pointwise minimum is a Bayes action rule. Finite posterior risk and Bayes action rule
A conditional law is a probability kernel indexed by the conditioning random element; changing its values on a marginal-null set preserves the conditional identities. Conditional law given a random element
Integrals of measurable nonnegative or integrable scalar tests against an RCD are conditional-expectation versions. Conditional integration through a regular conditional law
Two integrable scalar versions of the same conditional expectation agree almost surely. Conditional expectation is unique almost surely
A product of two at-most-countable sets is at most countable. A product of two at most countable sets is at most countable
Cauchy–Schwarz gives for each unit basis vector , so each coordinate functional is continuous; it also gives continuity of the inner product in either argument. Cauchy–Schwarz: , with equality exactly for dependent pairs
A measurable space has a sigma-algebra of measurable subsets. Measurable spaces and measurable sets
Proof
The function is product-measurable because the norm is continuous, so kernel integration [F8] makes measurable and measurable. For each , is continuous by [F15] and . The decomposition is orthogonal, so ; hence . Thus each signed coordinate integral defining is finite on , and the signed-kernel clause of [F8] makes measurable there.
Fix . Under the probability space , each is square-integrable. The constant satisfies the conditional-expectation identities for the trivial sigma-algebra by [F6], so [F7] makes it the projection of onto constants and gives . For every real , expand ; the cross term integrates to zero, yielding . Taking gives . Let be the first basis indices, taking all indices once reaches the finite endpoint when is finite. Summing over and applying Parseval [F5] pointwise, followed by monotone convergence [F9], yields . Orthonormality gives ; for , the squared norm of the difference of the two partial sums is , which tends to zero as because the series converges. Thus the partial sums are Cauchy, and completeness [F4] gives their norm limit . Since the sum in the statement is over those same initial segments, it is this norm limit. By continuity of the inner product [F15], for every .
Let be a countable dense subset of from [F3]. The balls with centers in and radii form a countable base by [F14]: for any point in an open set, choose with smaller than the radius of a ball about that point contained in the open set, then choose a center in within of the point. The resulting radius- ball contains the point and lies in the open set. For and a basis ball radius , the finite sums are measurable by step 1.1. By Parseval [F5] and step 2.1, , where finite bases use the full sum once all coordinates are included. The preimage of the open ball is the countable union ; this equals . Hence every basis-ball preimage is measurable, and the countable base makes measurable on .
Fix and . Write . Applying the scalar identity established in step 2.1 with gives . Sum over the initial segments from step 2.1 and pass to their increasing limits with [F9]; Parseval [F5] identifies the three sums as , , and , respectively. The first integral is finite because ; the same bound with gives finite risk at the mean. The resulting identity proves that only attains the minimum. By [F10] and step 3.1, is a measurable Bayes action rule on .
Now suppose is a supplied RCD of the measurable random element given , with . Applying [F12] to shows that has finite expectation ; a nonnegative random variable with finite expectation is finite almost surely, so . By [F15], , and , so every coordinate is integrable. For every , [F12] now identifies as a version of . Extend by zero outside ; because is measurable by step 1.1 and is measurable on by step 3.1, this piecewise extension is measurable, and step 4.1 at gives on , so the extension evaluated at is square-integrable. If another square-integrable -valued random variable has each basis coordinate as a version of the corresponding scalar conditional expectation, [F13] makes each coordinate equal to outside a null set. There are at most countably many coordinates, so the union of these exceptional null sets is null; completeness of the basis [F4] then makes the two vectors equal there. The RCD's values on -null data sets remain version choices by [F11].
Learned inverse estimators and reconstruction targets
Definition
Let and be metric parameter and data spaces, let be a nonempty admissible truth class, let be a forward map, and let be a metric target space. All metric spaces in this definition carry their Borel sigma-algebras. Give the subspace Borel sigma-algebra , and assume that is measurable from to . The target is the recovery object assigned to truth ; may be the parameter space itself or a quotient solution-class space. A point reconstruction rule is a Borel map , and its output at data is . A learned point estimator is such a map with a fitted parameter in a specified parameter set. A complete training description names the probability law of all variables used to fit ; those variables may be paired or unpaired. A complete test description names a probability law for evaluation pairs . No equality between fitting and test laws is assumed.
A finite unrolled learned update consists of an integer , a Borel initialization , and maps measurable from to for , with . Here the layer domain uses the product sigma-algebra, not an assumed identification with the Borel sigma-algebra of the product topology. Its output is a point reconstruction rule: if is Borel, the preimage of a measurable rectangle under is , so this pairing is product-measurable; composing it with and applying finite induction proves that every is Borel. An amortized inverse map is a learned point estimator applied to multiple data inputs after a single fit; this term adds a reuse convention, not an accuracy guarantee.
For a real Hilbert signal space , a denoiser is a Borel map trained under a specified signal-corruption law and used to transform a corrupted signal into a signal estimate or an update. A denoiser is the exact minimum mean-square error map only when it equals the conditional mean for the specified signal and corruption laws. A learned prior is a supplied Borel probability measure on ; one construction is the pushforward law for , where is a specified probability measure on a measurable source space and is measurable. The law or generator alone is not a data-to-target estimator.
For a finite horizon , a specified parameter set , and , a score field model in a finite-dimensional signal space is a Borel map intended to approximate the target field for a specified family of positive continuously differentiable probability densities for which is jointly Borel. Its complete description names a probability law for all variables used to fit and a probability law on for evaluation inputs ; the target on those inputs is . These laws need not agree, and no approximation guarantee under either law is implied. A score field is not itself a posterior law, posterior sample, or point reconstruction rule. A posterior sampler is a probability kernel ; relative to a supplied posterior target kernel , it is exact on a data domain when as probability measures for every . A draw from is random; obtaining a point estimate from it requires an additional summary rule. The name “learned” by itself asserts no exact recovery, stability, convergence, calibration, or train-to-test guarantee.
Definition references
Metric parameter/data model, admissible truths, forward map, and target-class map
Deterministic data-only estimator interface and its exactness convention
Evidence-normalized inverse posterior and data-indexed kernel convention
Real Hilbert signal spaces are complete real inner-product spaces
Measurable spaces and their sigma-algebras
Probability measures used for fitting and signal laws
Borel measurability of reconstruction maps
Probability kernels for posterior samplers
Product-measurable layer inputs for finite unrolling
Ongie et al., §§3.1 and 4.1–4.2.1, full paper
Inverse reconstruction risk under train and test laws
Definition
Let and be measurable data and target spaces, with the Borel sigma-algebra of the target metric space. Let be a probability measure on the product space , and let be product-measurable, where is the loss for target and action . For a point reconstruction rule measurable with respect to the stated sigma-algebras, its risk under is the extended nonnegative integral For a randomized reconstruction rule given by a probability kernel from to , define The inner integral is measurable in by kernel integration; a deterministic rule is the special case . When and are specified joint laws on the same input-target space, the corresponding training-law risk and test-law risk are and . Either value may be . This definition imposes no inequality between the two risks: any such comparison requires an additional assumption relating the joint laws or the rule's behavior under them.
Definition references
Forward map, admissible truths, target map, and target metric space
Data-only point-estimator convention
Learned point rules, posterior samplers, and fitting/test-law distinction
Measurable spaces for data and targets
Product sigma-algebra for joint input-target laws and losses
A joint evaluation law is a probability measure
Measurability of losses and point rules
Randomized reconstruction rules are probability kernels
Kernel integration gives a measurable conditional risk
Statistical risk is expected nonnegative loss under the observation law
Martin, §5.3.1, complete lecture notes
4 · Examples, counterexamples and false statements
None yet.
Sources
- Ryan Martin, Lecture Notes on Advanced Statistical Theory, §5.3.1, printed pp. 104–105 (PDF pp. 105–106)
- Giannis Daras et al., A Survey on Diffusion Models for Inverse Problems, arXiv:2410.00083v1
- Masoumeh Dashti and Andrew M. Stuart, The Bayesian Approach to Inverse Problems, arXiv:1302.6989v4
- Gregory Ongie, Ajil Jalal, Christopher A. Metzler, Richard G. Baraniuk, Alexandros G. Dimakis, and Rebecca Willett, Deep Learning Techniques for Inverse Problems in Imaging, arXiv:2005.06001v1
- Peter Hoff, Statistical Decision Problems, §§4.1–4.2, PDF pp. 7–8
- Hongkai Zheng et al., InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences, ICLR 2025