How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Rare event importance sampling and multilevel splitting — Examples
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Central Limit Theorems
- Characteristic Functions Inversion and Continuity
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Conditional Distributions and Regular Conditional Probability
- Conditional Expectation
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Darboux, L'Hôpital, and Taylor's Theorem
- Density Separability and Convolution in Lᵖ
- Determinants of Matrices over a Commutative Ring
- Discrete Time Martingales
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Estimators and Randomized Procedures
- Feynman–Kac targets and sequential particle filters
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Finite Probability Spaces and Random Variables
- Foundations of the Real Numbers for Analysis
- Fourier Transform Convolution and Approximate Identities
- Fubini and Change of Variables
- Fundamental Trigonometric Identities
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Hausdorff via the Diagonal
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- IID Monte Carlo integration and error
- Improper and Parameter-Dependent Multiple Integrals
- Improper Integrals
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Lebesgue Measure on Euclidean Space
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Markov Kernels and Markov Chains
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Ordinary and self-normalized importance sampling
- Outer Measure and the Caratheodory Extension Theorem
- Partitions of Unity and Paracompactness
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Radon Measures and the Riesz Markov Kakutani Theorem
- Rare event importance sampling and multilevel splitting
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Scientific model contracts and applicability
- SCM, DAGs, adjustment
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Standard-Borel Real Codings and Determining Classes
- State-space model laws
- State-space models and exact Bayesian filtering
- Stationary means and sample autocovariance
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Suprema and Infima
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Inverse and Implicit Function Theorems
- The Lebesgue and Riemann Integrals Compared
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Maximal Function and Lebesgue Differentiation
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Urysohn's Lemma and the Tietze Extension Theorem
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
- Weak Laws and Series of Independent Random Variables
2 · Summary
These worked cases calculate a Gaussian tail-tilt contribution, compare independent splitting allocations at equal work for a two-period queue, and show that a cross-entropy pilot can miss a positive-probability event. The counterexamples separate correct level marginals from independent level samples and distinguish a zero SIR particle prefix from a zero event probability. A deterministic path shows a finite grid can miss a crossing. The discrete importance-sampling example has finite mean and infinite second moment.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
Gaussian barrier under the prescribed exponential tilt
Example
Assume AC. Take , target , and proposal . The likelihood contribution is . The one-draw estimator is unbiased with finite second moment, with and .
Facts & Assumptions
Given: The standard-normal target, barrier , translated-normal proposal, and likelihood contribution above.
Gaussian tail tilting is logarithmically efficient but not bounded-relative-error: For and , the event contribution has mean and second moment .
Verification
Set in [F1]. Then , , and the density ratio on the event is , giving the displayed contribution and moments.
Since and , the mean is positive and finite and the second moment is finite. Thus the example has finite variance, while the asymptotic divergence in relative error concerns the family , not this single barrier.
Two-stage queue overflow and a redundant split at equal work
Example
Consider a two-period single-server queue with no service during these two periods and independent Bernoulli arrivals , each with probability . Capacity is one, so overflow occurs when both arrivals occur. Let and . Then , , and .
Under unit cost per conditional draw, use two draws at each of the two levels for work . Compare with an augmented chain having two repeated levels before , and one draw at each of four levels, also work . The added levels have conditional probability one but the estimator has larger relative variance.
Facts & Assumptions
Given: The two independent Bernoulli arrivals, nested events , unit draw cost, and the two stated independent-splitting designs.
Independent fixed-level splitting: The estimator is a product of independent sample means of level indicators, with conditional draws per level.
Independent splitting estimator moments and work: Its relative variance is , and unit-cost work for levels is .
Verification
The four arrival outcomes are equiprobable. Exactly three have at least one arrival and exactly one has two arrivals; hence , , and .
The two designs use the product estimator specified in [F1]. With two levels and , [F2] gives relative variance The work is .
In the augmented chain, the conditional probabilities are , and . The two unit-probability factors in [F2] equal one, while the other factors are and ; the relative variance is , with work .
Since , equal work does not make the redundant-level design equally precise. Its unit-probability stages add cost without reducing the one-draw randomness left in the two nontrivial levels.
A pilot with no rare-event hit returns failure
Example
Let be Bernoulli on with , set , and use the one-member proposal family . A pilot of size misses with positive probability even though the target probability is positive.
Facts & Assumptions
Given: are IID Bernoulli, the target event is , and the pilot rule in Independent-pilot cross-entropy proposal fitting and production is used.
Independent-pilot cross-entropy proposal fitting and production: If no pilot sample lies in , the algorithm returns the status pilot-no-hit.
Independent cross-entropy production is conditionally unbiased: Conditional unbiasedness applies only after a successful pilot and admissible production proposal.
Verification
By the IID assumption, Also .
On this positive-probability pilot event, [F1] returns pilot-no-hit, so no fitted proposal or production estimate is returned. The positive target probability therefore does not imply pilot success; [F2] makes no production-unbiasedness assertion on this failure branch.
Correct level marginals do not justify a dependent product
Statement refuted
Correct marginal success probabilities at every level suffice for the product of level sample means to be unbiased when the level samples are dependent.
Facts & Assumptions
Given: Let with uniform , , , and use one sample at each level.
Nested rare-event levels and conditional laws: The level probabilities are , , and the target is .
Independent fixed-level splitting: The two-level product estimator is the product of the two level indicator means; the prescribed algorithm requires independent level arrays.
Independent splitting estimator moments and work: Under level independence, the product estimator has expectation .
Counterexample
Let be independent Bernoulli. Construct the level-one sample by if , and if ; then . Construct if , and if ; then .
The correct marginal success probabilities are and . But the two indicators both equal , so their product has expectation , while . Thus dependence biases the product despite both correct marginals, and it violates the independence condition in [F2].
The unbiasedness conclusion in [F3] has the stated independence hypothesis; it cannot be applied to this coupling. The target counterexample refutes the proposed implication.
A zero-particle prefix does not prove a zero event probability
Example
Take with uniform law, a single level , and SIR particles. The event probability is positive, but the all-zero first event-potential branch has positive probability and returns the zero estimate.
Facts & Assumptions
Given: is uniform on , , and the full-resampling SIR splitting algorithm is used with .
Nested rare-event levels and conditional laws: A one-level target has probability .
Full-resampling fixed-level SIR splitting with invariant mutations: If any incremental event-weight average is zero, the algorithm returns status zero-particle-prefix and estimate zero.
Fixed-level full-resampling SIR splitting is unbiased: The estimator is unbiased in expectation under the theorem's positive-prefix model.
Verification
. The two initial particles are IID from , so the probability that both equal and therefore both have zero -weight is .
On this branch resampling the initial population still selects only particles equal to , and the identity transition leaves them there. Thus the first average event weight, from , is zero, so [F2] returns estimate zero despite . This does not contradict [F3]: unbiasedness is an expectation over all branches and does not imply that each realization is positive.
A finite grid can miss a continuous-time crossing
Example
On , let the deterministic continuous path be , and define the target crossing event as . Sampling only at grid times misses the crossing.
Facts & Assumptions
Given: The path , the threshold , and the endpoint grid .
Finite-budget stopped-event kernel with a cemetery outcome: A finite-budget status reports a target hit only when that target is reached at an inspected state within the budget.
Finite-budget stopped-kernel measurability and event normalizer: The finite-budget normalizer is the probability of a target hit by the budget.
Truncation and total-variation errors for stopped crossings: A grid-detected event contained in the continuous target has probability bias equal to the probability of the missed-crossing event; no rate follows without an additional bound.
Verification
The path satisfies , while . Thus the continuous crossing event occurs and endpoint-grid detection fails.
The model is deterministic, so its continuous crossing probability is and the grid-detected probability is ; their absolute bias is . This is exactly the missed-crossing event in [F3], and no error rate in grid spacing can be inferred from this single example.
An unbiased importance-sampling weight can have infinite second moment
Example
Let , , and , where . For , the ordinary importance-sampling contribution is unbiased and integrable, but its second moment is infinite.
Facts & Assumptions
Given: The probability mass functions above, the event for fixed , and proposal law .
Ordinary importance sampling: The single-draw contribution is for .
Ordinary importance sampling is unbiased: If the target event law is absolutely continuous with respect to the proposal and the weighted contribution is integrable, its expectation is .
Ordinary importance sampling has finite variance and a CLT under a weighted second moment: A finite weighted second moment is a sufficient condition for finite variance.
Rare-event efficiency and work criteria: Efficiency criteria record whether the second moment is finite; finite variance is not implied by unbiasedness alone.
Verification
Both constants are finite and positive because the defining series converge for exponents and , and for every ; hence . The likelihood ratio is .
By [F1], so [F2] confirms unbiasedness.
The second moment is by divergence of the harmonic tail. Thus the weighted second-moment hypothesis in [F3] is absent and this unbiased estimator has infinite variance; [F4] therefore rules out describing its second-moment efficiency as finite.
Sources
- Gino Biondini, An Introduction to Rare Event Simulation and Importance Sampling, Handbook of Statistics 33, Chapter 2, §§3.1–3.4
- Gino Biondini, An Introduction to Rare Event Simulation and Importance Sampling, Handbook of Statistics 33, Chapter 2, §8
- Adam M. Johansen, Pierre Del Moral, and Arnaud Doucet, Sequential Monte Carlo Samplers for Rare Events, §§2–3
- Patrick Laub, Algorithms for Rare Event Estimation, Short Course, Lecture 2, Cross-Entropy Method
- Gino Biondini, An Introduction to Rare Event Simulation and Importance Sampling, Handbook of Statistics 33, Chapter 2, §5
- Gino Biondini, An Introduction to Rare Event Simulation and Importance Sampling, Handbook of Statistics 33, Chapter 2, §§3.1–3.3