How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
The posterior mean is the unique squared-loss Bayes action in a Hilbert target
Statement
Assume the Axiom of Choice. Let be a measurable data space, let be a separable real Hilbert space, and fix a complete orthonormal basis , where is either finite with its supplied ordering or . A complex Hilbert signal space is included by viewing it as a real Hilbert space with inner product the real part of its complex inner product and supplying a real orthonormal basis. Let be a probability kernel from to with its norm Borel sigma-algebra. Define For every and , define where the last sum is the norm limit of its finite partial sums. Then , the sum defining exists for every , and is measurable. For every and every action , Thus is the unique finite-risk action minimizing posterior squared-error risk over all of , and it is a measurable Bayes action rule on . The minimization is over the full Hilbert space: the mean need not belong to a nonconvex admissible signal subset, and no perceptual-representativeness claim is made. For a probability space , let and be measurable random elements with . If the same is a supplied regular conditional law of given , write for the law of . Then has full -measure. Extend by zero to a measurable map ; the coordinates of are versions of , and is square-integrable. Any square-integrable -valued random variable whose basis coordinates are versions of those same conditional expectations equals almost surely. The RCD's values on -null data sets remain version choices.
For this measurability assertion, equip with the trace sigma-algebra inherited from .
Statement references
A measurable data space is a set with a specified sigma-algebra.
A probability kernel has measurable evaluations and probability-measure sections.
Kernel integrands are measurable on the product sigma-algebra.
A real Hilbert space is complete for its inner-product norm.
Separability supplies a countable dense subset.
The inner product induces the Hilbert norm and scalar coordinate functionals.
A Hilbert basis is a complete orthonormal family.
Under Countable Choice, basis coordinates satisfy Parseval's identity.
Under AC, scalar conditional expectation is the unique L2 projection.
A measurable rule with finite posterior risk attaining the minimum is a Bayes action rule.
Kernel integrals of scalar tests give conditional-expectation versions.
Scalar conditional-expectation versions agree almost surely.
Martin, §5.3.1, complete lecture notes
Facts & Assumptions
Given: AC; a measurable data space; a separable real Hilbert target with a supplied finite or countable complete orthonormal basis; and a supplied probability kernel on . The theorem is applied on the data domain of finite posterior second moment.
The Axiom of Choice gives a choice function for every family of nonempty sets. The Axiom of Choice
Countable Choice is the restriction of AC to countable families; it is assumed by the Parseval supplier below. The Axiom of Countable Choice ()
A probability kernel has a measurable evaluation for every Borel target set and a probability measure at every data point. Measure kernel and probability kernel
The product sigma-algebra makes the continuous norm and coordinate functions into product-measurable kernel integrands. The product sigma-algebra and its finite iterates, Real and complex inner-product spaces and their induced length, Cauchy–Schwarz: , with equality exactly for dependent pairs
Separability supplies an at-most-countable dense subset of . Separability: the existence of an at most countable dense subset
A real Hilbert space is complete for its inner-product norm, and a Hilbert basis is a complete orthonormal family. Hilbert space, Orthonormal families, complete orthonormal systems and Hilbert bases
For a complete orthonormal family, Parseval's identity equates the squared norm with the sum of squared coordinates; this supplier assumes Countable Choice. Parseval equivalences for an orthonormal family
A scalar conditional-expectation version is integrable, measurable with respect to its conditioning sigma-algebra, and satisfies the conditioning-event integral identities. Conditional expectation given a sigma algebra
Under AC, a scalar conditional expectation of an input is its orthogonal projection onto ; in particular its residual is orthogonal to constant random variables. Conditional expectation is the l2 orthogonal projection
Integrating a product-measurable nonnegative function against a probability kernel gives a measurable function; signed integrals are measurable on their absolute-integrability domain. Measurability of integration against a kernel
Increasing nonnegative measurable functions pass through their integrals by monotone convergence. Monotone convergence for the integral
A measurable action rule with finite posterior risk attaining the pointwise minimum is a Bayes action rule. Finite posterior risk and Bayes action rule
A conditional law is a probability kernel indexed by the conditioning random element; changing its values on a marginal-null set preserves the conditional identities. Conditional law given a random element
Integrals of measurable nonnegative or integrable scalar tests against an RCD are conditional-expectation versions. Conditional integration through a regular conditional law
Two integrable scalar versions of the same conditional expectation agree almost surely. Conditional expectation is unique almost surely
A product of two at-most-countable sets is at most countable. A product of two at most countable sets is at most countable
Cauchy–Schwarz gives for each unit basis vector , so each coordinate functional is continuous; it also gives continuity of the inner product in either argument. Cauchy–Schwarz: , with equality exactly for dependent pairs
A measurable space has a sigma-algebra of measurable subsets. Measurable spaces and measurable sets
Proof
The function is product-measurable because the norm is continuous, so kernel integration [F8] makes measurable and measurable. For each , is continuous by [F15] and . The decomposition is orthogonal, so ; hence . Thus each signed coordinate integral defining is finite on , and the signed-kernel clause of [F8] makes measurable there.
Fix . Under the probability space , each is square-integrable. The constant satisfies the conditional-expectation identities for the trivial sigma-algebra by [F6], so [F7] makes it the projection of onto constants and gives . For every real , expand ; the cross term integrates to zero, yielding . Taking gives . Let be the first basis indices, taking all indices once reaches the finite endpoint when is finite. Summing over and applying Parseval [F5] pointwise, followed by monotone convergence [F9], yields . Orthonormality gives ; for , the squared norm of the difference of the two partial sums is , which tends to zero as because the series converges. Thus the partial sums are Cauchy, and completeness [F4] gives their norm limit . Since the sum in the statement is over those same initial segments, it is this norm limit. By continuity of the inner product [F15], for every .
Let be a countable dense subset of from [F3]. The balls with centers in and radii form a countable base by [F14]: for any point in an open set, choose with smaller than the radius of a ball about that point contained in the open set, then choose a center in within of the point. The resulting radius- ball contains the point and lies in the open set. For and a basis ball radius , the finite sums are measurable by step 1.1. By Parseval [F5] and step 2.1, , where finite bases use the full sum once all coordinates are included. The preimage of the open ball is the countable union ; this equals . Hence every basis-ball preimage is measurable, and the countable base makes measurable on .
Fix and . Write . Applying the scalar identity established in step 2.1 with gives . Sum over the initial segments from step 2.1 and pass to their increasing limits with [F9]; Parseval [F5] identifies the three sums as , , and , respectively. The first integral is finite because ; the same bound with gives finite risk at the mean. The resulting identity proves that only attains the minimum. By [F10] and step 3.1, is a measurable Bayes action rule on .
Now suppose is a supplied RCD of the measurable random element given , with . Applying [F12] to shows that has finite expectation ; a nonnegative random variable with finite expectation is finite almost surely, so . By [F15], , and , so every coordinate is integrable. For every , [F12] now identifies as a version of . Extend by zero outside ; because is measurable by step 1.1 and is measurable on by step 3.1, this piecewise extension is measurable, and step 4.1 at gives on , so the extension evaluated at is square-integrable. If another square-integrable -valued random variable has each basis coordinate as a version of the corresponding scalar conditional expectation, [F13] makes each coordinate equal to outside a null set. There are at most countably many coordinates, so the union of these exceptional null sets is null; completeness of the basis [F4] then makes the two vectors equal there. The RCD's values on -null data sets remain version choices by [F11].
Depends on
- Measurable spaces and measurable sets
- The product sigma-algebra and its finite iterates
- Measure kernel and probability kernel
- Hilbert space
- Separability: the existence of an at most countable dense subset
- Real and complex inner-product spaces and their induced length
- Cauchy–Schwarz: $|\langle x,y\rangle|\le\|x\|\,\|y\|$, with equality exactly for dependent pairs
- Orthonormal families, complete orthonormal systems and Hilbert bases
- A product of two at most countable sets is at most countable
- The Axiom of Choice
- The Axiom of Countable Choice ($\mathrm{AC}_\omega$)
- Parseval equivalences for an orthonormal family
- Conditional expectation given a sigma algebra
- Conditional expectation is the l2 orthogonal projection
- Measurability of integration against a kernel
- Monotone convergence for the integral
- Finite posterior risk and Bayes action rule
- Conditional law given a random element
- Conditional integration through a regular conditional law
- Conditional expectation is unique almost surely
Used by
Dependency tree · two levels
87 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Ryan Martin, Lecture Notes on Advanced Statistical Theory, §5.3.1, printed pp. 104–105 (PDF pp. 105–106) (standard reference, not scraped)
- Giannis Daras et al., A Survey on Diffusion Models for Inverse Problems, arXiv:2410.00083v1 (standard reference, not scraped)
- Masoumeh Dashti and Andrew M. Stuart, The Bayesian Approach to Inverse Problems, arXiv:1302.6989v4 (standard reference, not scraped)