How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite Gaussian MAP, posterior mean, and support-restricted Tikhonov minimizer coincide
Statement
Assume AC and let , , symmetric with for all , , and symmetric with for all nonzero . Let and be independent, and observe . Put and . The -dimensional Euclidean Lebesgue measure on is the pushforward of Lebesgue measure on under any affine isometry onto ; this measure is independent of the chosen orthonormal coordinates. A MAP point means a maximizer of the posterior density with respect to this measure; for , the unique point of is the MAP point. The Moore–Penrose pseudoinverse satisfies and and are symmetric. The optimization below is restricted to . Then for every , the unique MAP point equals the posterior mean and the unique minimizer over of All objects are finite-dimensional; no minimization over points outside the prior support is asserted when is singular.
Statement references
Facts & Assumptions
Given: AC; the finite linear Gaussian inverse model with , , and the support and MAP conventions in the Statement.
AC is inherited from the finite Gaussian posterior and multivariate-normal interfaces. The Axiom of Choice
The posterior update is the finite Gaussian law with the stated mean and covariance, defined for every datum. Finite linear Gaussian inverse posterior with singular prior covariance
There are orthonormal range coordinates , , and the prior support is . Support and pseudoinverse coordinates of a finite singular Gaussian
The Moore–Penrose pseudoinverse is characterized by the four Penrose equations. The Moore--Penrose pseudoinverse as the solution of the four Penrose equations
A finite-dimensional non-negative matrix has a unique non-negative square root, and a non-negative self-adjoint matrix has an orthonormal eigenbasis. A non-negative operator has a unique non-negative square root, A non-negative operator is equivalently self-adjoint with nonnegative eigenvalues, a positive semidefinite matrix in an orthonormal basis, or an operator of the form S^*S
The Tikhonov objective is for . The Tikhonov regularised least-squares objective for
For this objective the unique minimizer is . For every , the Tikhonov objective is strictly convex and has the unique minimiser
A positive-definite Gaussian law has a density proportional to its positive quadratic exponential. A positive-definite multivariate normal law has its Gaussian density
Proof
Given: The hypotheses in the Statement.
If , [F2] gives and . The posterior is the point mass at by [F1], so its mean and unique MAP point are . The objective has only this admissible point, hence it has the same unique minimizer on .
Suppose . By [F2], choose with , , and write . The map is a bijection from onto . For , .
Let be the non-negative square root of . Since , is symmetric positive definite and by [F4]. Set and . Substituting into the objective in the Statement gives . This is the Tikhonov objective in [F5] with , so [F6] gives the unique minimizer .
By the Gaussian representation in [F2], the prior coordinate has standard Gaussian density. The likelihood is proportional to by [F7]. Thus the posterior density in is proportional to . Its precision matrix is positive definite, and completing the square gives a Gaussian density with mean and covariance . This density has its unique maximum at its mean. The affine bijection in step 1.2 has constant positive Jacobian in orthonormal coordinates on , so its image has the unique MAP point . Its posterior mean is also , and step 2.1 makes this point the unique minimizer of on .
Depends on
- The Axiom of Choice
- Finite linear Gaussian inverse posterior with singular prior covariance
- Support and pseudoinverse coordinates of a finite singular Gaussian
- The Moore--Penrose pseudoinverse $A^+$ as the solution of the four Penrose equations
- A non-negative operator is equivalently self-adjoint with nonnegative eigenvalues, a positive semidefinite matrix in an orthonormal basis, or an operator of the form S^*S
- A non-negative operator has a unique non-negative square root
- A positive-definite multivariate normal law has its Gaussian density
- The Tikhonov regularised least-squares objective $\|Ax-b\|_2^2+\lambda\|x\|_2^2$ for $\lambda>0$
- For every $\lambda>0$, the Tikhonov objective is strictly convex and has the unique minimiser $(A^*A+\lambda I)^{-1}A^*b$
Used by
Dependency tree · two levels
45 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Christian Clason, Regularization of Inverse Problems: Lecture Notes, arXiv:2001.00617v2 (2021) (standard reference, not scraped)
- M. Dashti and A. M. Stuart, The Bayesian Approach to Inverse Problems (full lecture notes, arXiv:1302.6989) (standard reference, not scraped)