How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Langevin algorithms: ULA bias and MALA exactness — Examples
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Central Limit Theorems
- Characteristic Functions Inversion and Continuity
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Computational foundations: factorization, KL, and optimization
- Conditional Distributions and Regular Conditional Probability
- Conformal Prediction and Exchangeable Ranks
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Conjugate families and Gaussian conditioning
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Cyclic Groups and Direct Products
- Density Separability and Convolution in Lᵖ
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Direct Matrix Factorisations: LU, Cholesky and QR
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Domination and Likelihood Ratios
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Foundations of the Real Numbers for Analysis
- Fourier Transform Convolution and Approximate Identities
- Fubini and Change of Variables
- Fundamental Trigonometric Identities
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- General-state Markov kernels, invariance, and reversibility
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Hausdorff via the Diagonal
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Improper and Parameter-Dependent Multiple Integrals
- Improper Integrals
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Langevin algorithms: ULA bias and MALA exactness
- Lebesgue Measure on Euclidean Space
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Loss, Risk and Decision Theory
- Markov Kernels and Markov Chains
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Matrix Differentiation and First-order Spectral Perturbation
- Matrix Norms, Condition Numbers and Numerical Stability
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Metropolis–Hastings kernels
- Mixed effects and longitudinal models
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Partitions of Unity and Paracompactness
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Radon Measures and the Riesz Markov Kakutani Theorem
- Recurrence Transience and Hitting Times for Markov Chains
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Splitting Fields
- Stationary Markov Chains and Ergodic Limits
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Exponential Function
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Galois Correspondence
- The Inverse and Implicit Function Theorems
- The Lebesgue and Riemann Integrals Compared
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Maximal Function and Lebesgue Differentiation
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Urysohn's Lemma and the Tietze Extension Theorem
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
2 · Summary
The examples exhibit three complementary outcomes: the quadratic ULA chain has no invariant probability at its critical step size ; at the interior step size it has invariant law instead of the standard Gaussian target; and MALA corrects the same Gaussian proposal with the forward/reverse Hastings ratio while preserving the target exactly.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
At the critical quadratic ULA step size, no invariant law exists
Example
Let on and set in ULA. Then the update is for a fresh independent . This Markov kernel has no invariant probability law.
Facts & Assumptions
Given: AC; the ULA update for at .
AC is assumed in the standard-normal construction. The Axiom of Choice Standard normal and normal laws
For , , so the ULA update at is , with fresh independent . Unadjusted Langevin algorithm (ULA) Standard normal and normal laws
Affine maps and sums of independent variables transform characteristic functions by and by multiplication. Characteristic functions under affine maps and independent sums
Every characteristic function has , is continuous, and satisfies . Characteristic function of a real random variable Basic properties of characteristic functions
The standard normal characteristic function is . Characteristic function of a normal law
Verification
Given: The update and facts above.
Suppose for contradiction that an invariant probability exists and write for its characteristic function. Invariance of the kernel in [F1], together with the affine characteristic-function identity [F2] and the standard-normal characteristic function [F4], gives for every real ,
By [F3], . For each , the displayed identity implies , and forces . Thus vanishes at every nonzero , contradicting continuity at zero and from [F3]. No invariant probability can exist.
ULA has a biased invariant variance for a standard Gaussian target
Example
Assume AC. Take the standard Gaussian target , potential , and ULA step size . Its invariant law is , so the unadjusted chain does not preserve the target variance.
Facts & Assumptions
Given: AC, the standard Gaussian target, and ULA with .
AC is assumed in the standard-normal target and fresh ULA-noise construction. The Axiom of Choice
Under this potential, and the update is , independent of the current state, where . Unadjusted Langevin algorithm (ULA) Standard normal and normal laws
For every , the Gaussian ULA invariant law is , and its variance is . The Gaussian ULA invariant law has variance
The target has variance . Characteristic function of a normal law
Verification
Given: AC; the standard Gaussian target and .
Substituting in [F2] gives the invariant law and variance . Equivalently, [F1] shows every transition row equals , so this law is invariant directly.
By [F3], the target has variance . Since the invariant law in step 1.1 has variance , the two laws differ. The choice is interior to , the regime of the invariant-law theorem.
MALA corrects the Gaussian ULA proposal with a Hastings ratio
Example
Let and on . For every , the MALA proposal is , and its logarithmic Hastings ratio is Thus the acceptance probability is , and the resulting rejected-self-transition kernel preserves .
Facts & Assumptions
Given: AC, the standard Gaussian target, and the MALA construction.
AC is assumed for the Gaussian law and the general Metropolis–Hastings construction. The Axiom of Choice Metropolis-adjusted Langevin algorithm (MALA)
The ULA Gaussian proposal has density . The ULA Gaussian proposal is a probability kernel with a positive density
The standard Gaussian target density is proportional to . Standard normal and normal laws
The MALA accept/reject kernel uses and places every rejected proposal at its current state; this common-density ratio is a version of the accepted-flow derivative. Metropolis-adjusted Langevin algorithm (MALA) The common-density Metropolis–Hastings ratio
The MALA kernel is reversible with respect to its target and therefore invariant. MALA preserves its target probability exactly
Verification
Given: , , and [F1]–[F4].
Write . The Gaussian normalizing constants cancel, and direct expansion gives The target log-density ratio is , so adding the two terms yields .
By [F3], the acceptance probability is and rejected proposals remain at . At , the proposal is independent , but its reverse-to-forward density ratio is still and is included in the computed exponent.
The proposal is a probability kernel with positive density by [F1], and [F3] identifies the displayed acceptance rule with the MALA specialization of Metropolis–Hastings. Applying [F4] proves exact invariance of for every .
Sources
- Alain Durmus and Éric Moulines, Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithm, §3.3
- Gautam Iyer, Lecture 20: Langevin Monte Carlo, course notes, §3.1
- Gareth O. Roberts and Jeffrey S. Rosenthal, General State Space Markov Chains and MCMC Algorithms, §2.1 and Proposition 2, printed pp. 5–6
- Gautam Iyer, Lecture 20: Langevin Monte Carlo, course notes, §4