How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Synthetic likelihood and indirect inference — Examples
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Central Limit Theorems
- Characteristic Functions Inversion and Continuity
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Cyclic Groups and Direct Products
- Density Separability and Convolution in Lᵖ
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Direct Matrix Factorisations: LU, Cholesky and QR
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Domination and Likelihood Ratios
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- Estimators and Randomized Procedures
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Foundations of the Real Numbers for Analysis
- Fourier Transform Convolution and Approximate Identities
- Fubini and Change of Variables
- Fundamental Trigonometric Identities
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Hausdorff via the Diagonal
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Improper and Parameter-Dependent Multiple Integrals
- Improper Integrals
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Lebesgue Measure on Euclidean Space
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Matrix Differentiation and First-order Spectral Perturbation
- Matrix Norms, Condition Numbers and Numerical Stability
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Mixed effects and longitudinal models
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Partitions of Unity and Paracompactness
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Radon Measures and the Riesz Markov Kakutani Theorem
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Splitting Fields
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- Synthetic likelihood and indirect inference
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Exponential Function
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Galois Correspondence
- The Inverse and Implicit Function Theorems
- The Lebesgue and Riemann Integrals Compared
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Maximal Function and Lebesgue Differentiation
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Urysohn's Lemma and the Tietze Extension Theorem
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
- Weak Laws and Series of Independent Random Variables
2 · Summary
Examples
A Bernoulli summary has a non-Gaussian two-point law even though its mean and variance define a positive-variance Gaussian synthetic likelihood. A finite model shows how a non-injective summary binding map can lose parameter identification and how the declared tie rule still selects a target. A two-dimensional Rademacher summary has a positive-definite population covariance, while its two-simulation covariance is random and always singular.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
A Gaussian synthetic likelihood for a Bernoulli summary is not exact
Example
Let , let be Bernoulli with and , and use the identity summary .
Facts & Assumptions
Given: The Bernoulli model and statistic above, with .
AC is assumed only to use the Gaussian synthetic-likelihood density interface. The Axiom of Choice
The synthetic likelihood uses the Gaussian density with the exact summary mean and covariance when that covariance is positive definite. Ideal and finite-simulation synthetic likelihood
A positive-definite multivariate-normal law has the stated Lebesgue density. A positive-definite multivariate normal law has its Gaussian density
A statistic is a measurable map, and its law is the pushforward law. Statistics and estimators Law or distribution of a random element
Means and variances are expectations and centered second moments. Expectation of a nonnegative or integrable random variable Moments, variance, and covariance on a probability space
Verification
The identity summary has mean and variance , so its ideal Gaussian synthetic likelihood is the density .
For and , . Hence . The Gaussian law therefore assigns probability at least , since this interval has Lebesgue length .
The true summary law is supported on , so it assigns probability zero. It differs from the Gaussian law in step 2.1. Thus the Gaussian synthetic likelihood is not the exact likelihood of this non-Gaussian summary model.
A non-injective binding map cannot recover a sign
Example
Let , with its full sigma-algebra, and let be the point mass at . Take the statistic .
Facts & Assumptions
Given: The finite experiment, statistic and moment-binding target above.
The binding function is , and the target minimizes with the declared lexicographic tie-break. Binding function and indirect-inference target
The compact-domain minimum and its lexicographic selector exist under the definition’s stated continuity hypotheses. The compact binding target exists and has a unique lexicographic tie-break
The parameter identity is identifiable exactly when distinct parameter labels give distinct sampling laws. Identifiability of an estimand
In a parametric model, identifiability is equivalent to constancy on observational-equivalence classes; for the identity target this is injectivity of the model map. Identifiability is constancy on observational classes
The summary law assigns to each Borel set the probability . Law or distribution of a random element
Verification
Under either point-mass law, surely. Thus .
The original laws differ: but . Therefore the parameter identity is identifiable in the original experiment.
For the observed summary , is the constant continuous function zero on the finite compact set , so . The target’s lexicographic rule selects .
By the pushforward-law definition [F5], both summary laws assign probability one to , so the summary-law map is not injective and the parameter identity is not identifiable from this summary. The moment target therefore does not recover the sign, even though the raw experiment distinguishes it.
Two simulated square summaries give a random singular covariance
Example
Let the summary vector be uniform on the four points . For one parameter value, simulate independently from this law and use the two-simulation covariance formula of Finite-simulation plug-in synthetic-likelihood evaluation.
Facts & Assumptions
Given: Two independent draws from the stated four-point summary law.
AC is inherited through the procedure’s Gaussian-density branch; it is not used in the finite probability calculations. The Axiom of Choice
IID means a common law and mutual independence. Identical distribution and IID families
The covariance matrix uses centered second moments; the finite plug-in covariance is the Bessel-corrected matrix in the algorithm. Moments, variance, and covariance on a probability space Finite-simulation plug-in synthetic-likelihood evaluation
For any two two-dimensional vectors, that sample covariance is not positive definite. A two-simulation covariance in two dimensions is singular
The algorithm returns unavailable when its plug-in covariance is not positive definite. Finite-simulation plug-in synthetic-likelihood evaluation
The ideal synthetic likelihood uses the population summary mean and covariance, when the latter is positive definite. Ideal and finite-simulation synthetic likelihood
Verification
Each coordinate has mean zero and variance one, while the cross moment is zero. Hence the population summary covariance is , positive definite.
By independence and the four equally likely support points, . On this event the sample covariance is the zero matrix.
The event and has probability . On it, and , which differs from the zero matrix in step 1.2. Thus the sample covariance is a nonconstant random matrix.
By [F3], every two-simulation covariance here is not positive definite, so [F4] makes the finite plug-in synthetic likelihood unavailable for every outcome despite the positive-definite population covariance in step 1.1.
Sources
- Victor M.-H. Ong et al., Variational Bayes with Synthetic Likelihood, Statistics and Computing 28(4), 971–988 (2018)
- Christopher C. Drovandi et al., Approximating the Likelihood in Approximate Bayesian Computation, Handbook of Approximate Bayesian Computation (2020)
- Christian Gouriéroux, Alain Monfort, and Eric Renault, Indirect Inference, Journal of Applied Econometrics 8, Supplement, S85–S118 (1993)
- Thomas J. Sargent and John Stachurski, Intermediate Quantitative Economics with Python, Chapter 38: Which Moments to Match?
- David T. Frazier et al., Bayesian Inference Using Synthetic Likelihood: Asymptotics and Adjustments, Journal of the American Statistical Association 118(544), 2821–2832 (2023)