How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite-Sample Point Estimation — Examples
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Binary Operations, Monoids, Groups and Subgroups
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Conditional Distributions and Regular Conditional Probability
- Conditional Expectation
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Convexity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Darboux, L'Hôpital, and Taylor's Theorem
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Estimators and Randomized Procedures
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability Spaces and Random Variables
- Finite-Sample Point Estimation
- Foundations of the Real Numbers for Analysis
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Lebesgue-Stieltjes Measures and Distribution Functions
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Loss, Risk and Decision Theory
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Standard-Borel Real Codings and Determining Classes
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Sufficiency, Completeness and Exponential Families
- Suprema and Infima
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral: Definition and Integrability
- The Topology of Euclidean Space
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
These worked calculations show the binomial sample proportion and its exact finite-sample variance, a parameter-specific MSE improvement from a biased constant rule, and the Rao–Blackwellization of one Bernoulli observation by the sample sum. Endpoint laws are included in the discrete conditional calculation.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
The binomial sample proportion
Example
Let be independent Bernoulli observations, where and . For , The equalities include the degenerate endpoints and .
Facts & Assumptions
Given: The finite product Bernoulli experiment, , and .
An estimator is unbiased when its expectation equals the estimand at every parameter; MSE is the squared-error expectation. (Unbiased estimators and UMVU estimators, Bias and mean squared error)
Variance of a finite sum is the sum of individual variances and twice the sum of pairwise covariances. (Variance of a finite sum as the sum of all variances and covariances)
Independent square-integrable variables have zero covariance. (Independence forces covariance to vanish)
On a finite probability space, variance is the expectation of the centered square. (Variance, standard deviation, and covariance on a finite probability space)
Expectation is linear on finite linear combinations of integrable random variables. (The Lebesgue integral is linear on )
For an unbiased estimator, MSE equals variance. (Bias–variance decomposition)
A measurable real-valued data map to the named target is an estimator. (Statistics and estimators)
A Bernoulli variable takes values and with probabilities and , and mutual independence of finite-valued variables means their joint cell probabilities factor. (Bernoulli random variables and binomial random variables as sums of independent Bernoulli trials, Pairwise and mutual independence of finite-valued random variables)
Verification
Each and is measurable on the finite product space, hence an estimator by [F7]. The Bernoulli law [F8] gives and ; summing these two values gives and , including . Thus [F5] gives , so is unbiased by [F1].
The independent are square-integrable, so [F3] makes every off-diagonal covariance zero. Applying [F2] gives and hence . Since the bias is zero, [F6] gives the same value for MSE.
A biased estimator can have lower MSE
Example
Observe one and estimate . The unbiased estimator has . The constant estimator is biased when , but at , This is a pointwise comparison at , not a uniform improvement: at the constant rule has MSE and has MSE .
Facts & Assumptions
Given: One Bernoulli observation with .
The bias and MSE are expectation minus target and expected squared error, respectively. (Bias and mean squared error)
Unbiasedness means expectation equals the target at every parameter. (Unbiased estimators and UMVU estimators)
A Bernoulli variable has mean and variance , and takes values and with probabilities and . (Bernoulli random variables and binomial random variables as sums of independent Bernoulli trials, A Bernoulli variable has mean and variance ; a binomial variable has mean and variance )
A measurable real-valued function of the data is an estimator of its named target. (Statistics and estimators)
Verification
Both and the constant are measurable estimators by [F4]. The two-point law gives and , so [F2] makes unbiased and [F1] gives . For , [F1] gives bias and MSE .
At , the MSEs are and , respectively, so the biased rule has strictly smaller MSE there. At , they are and , so the inequality is not uniform in .
Rao–Blackwellizing one Bernoulli observation by the sample sum
Example
Work on the finite product sample space with its discrete sigma-algebra. Let its coordinates be iid Bernoulli with , , and . The unbiased estimator is Rao–Blackwellized by to The statistic is sufficient: conditional on , the data vector is uniform over the vectors with ones when . At and , only the fibers and are supported, respectively, and their conditional laws are point masses at the all-zero and all-one vectors. These conditional laws do not depend on .
Facts & Assumptions
Given: The finite iid Bernoulli experiment with and .
Rao–Blackwellization of an unbiased finite-variance estimator is its conditional expectation given a sufficient statistic. (Rao–Blackwell theorem for scalar finite-variance estimators)
Sufficiency is defined by one probability kernel from the standard-Borel statistic space to the standard-Borel data space satisfying for every parameter and measurable data and statistic events ; the kernel is independent of . (Sufficient statistics)
is a measurable estimator of , and it is unbiased when its expectation is . (Statistics and estimators, Unbiased estimators and UMVU estimators)
The conditional-expectation notation is an almost-sure class; AC is inherited from its existence convention. (Conditional expectation as an ae class, The Axiom of Choice)
A Bernoulli variable takes values and with probabilities and , and mutual independence of finite-valued variables means their joint cell probabilities factor. (Bernoulli random variables and binomial random variables as sums of independent Bernoulli trials, Pairwise and mutual independence of finite-valued random variables)
The finite discrete data and statistic spaces are standard Borel: their discrete metrics are complete, and each finite space is separable, so the identity map witnesses the definition. (Standard Borel spaces)
Verification
For let ; it has elements. Define for every data event . Each section is the uniform probability measure on , and every event evaluation is measurable because the statistic space is finite and discrete; thus is a probability kernel independent of . By [F4], independence makes the joint law the product of the Bernoulli coordinate masses. For , each vector in has mass and , so is the conditional law given . At or , only or is supported, respectively, and that fiber is a singleton on which the same kernel is the conditional law. Hence is a common regular conditional law and proves sufficiency by [L1].
For , the uniform fiber law is invariant under coordinate permutations, so the conditional means agree. Their sum is , hence each is . At , almost surely, so the same formula holds on the support. Since , is square-integrable; its Bernoulli law gives by [F4]. Both spaces are standard Borel by [F5] and is sufficient by step 1.1, so [F2] and [F1] identify as the Rao–Blackwellized unbiased estimator; [F3] records its conditional-expectation class convention.
Sources
- George Deligiannidis, SB2.1 Foundations of Statistical Inference, Chapter 5, PDF pp. 29–31
- Karl B. Gregory, STAT 713 Lecture 6: Best Unbiased Estimators, Rao-Blackwell Theorem, PDF pp. 2–8
- George Deligiannidis, SB2.1 Foundations of Statistical Inference, Theorem 6.1 and Bernoulli example, PDF pp. 33–35
- Karl B. Gregory, STAT 713 Lecture 6: Best Unbiased Estimators, Rao-Blackwell Theorem, PDF pp. 9–11