How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Stationary means and sample autocovariance
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Compactness
- Compactness in Metric Spaces
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Conditional Expectation
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Density Separability and Convolution in Lᵖ
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability Spaces and Random Variables
- Foundations of the Real Numbers for Analysis
- Fubini and Change of Variables
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Infinite Product Measures and Kolmogorov Extension
- Lebesgue Measure on Euclidean Space
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Measurable Functions and Simple Approximation
- Measure-Preserving Systems and Mixing Criteria
- Measures and Their Basic Properties
- Metric Spaces
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Stationary Markov Chains and Ergodic Limits
- Subspaces, Products, and Quotients
- Suprema and Infima
- The Derivative and the Mean Value Theorems
- The Ergodic Theorems of von Neumann and Birkhoff
- The Exponential Function
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
For an integer-indexed real process, strict stationarity concerns all finite-dimensional laws, while weak stationarity requires finite second moments, a constant mean and lag-dependent covariance. Under weak stationarity, the sample-mean variance is a triangularly weighted covariance sum; absolute covariance summability gives an variance bound and consistency, without a mixing or central limit conclusion. The zero-extended biased sample ACVF has nonnegative Toeplitz quadratic forms; the pair-count-normalized rescaling need not. Ergodicity gives a separate almost-sure and mean limit only with strict stationarity, integrability and the Axiom of Choice required by the Birkhoff supplier. These are consequences of the specified probability law; neither a model contract nor these theorems establish that a scientific model adequately describes its application.
Model contract for this pair
For horizon , the observed record is the finite coordinate tuple in with the finite product Borel sigma-algebra; its law is the pushforward of the process law under the coordinate map (Stochastic processes and their finite-dimensional distributions, Law or distribution of a random element, The product sigma-algebra and its finite iterates, The Borel sigma-algebra of a topological space). One record is one real coordinate at an integer time index. The index set and origin for the displayed sample are fixed; a physical time scale, sampling frame and scientific unit are application fields, not supplied by this abstract pair. The coordinates are random and is observed; no predictors, latent quantities, treatment assignment or missingness mechanism is specified. The target is the common law mean , and the analysis uses the joint process law without conditioning on a design. No support restriction beyond that law is imposed. This model-record convention is the observation/index/quantity-status/law context of Scientific statistical model contracts.
Stationarity and finite moments are empirically assessable assumptions: data can challenge their implications but cannot prove them. Absolute covariance summability and ergodicity are global law hypotheses that a finite record does not verify. Whether the specified law describes a scientific population requires application-level evidence and is not a consequence of the mathematics here.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Strict and weak stationarity for integer-indexed time series
Definition
Let be a real-valued stochastic process on one probability space, so each is a real random variable and each finite tuple has its pushforward law (Stochastic processes and their finite-dimensional distributions, Random elements and real random variables, Law or distribution of a random element). We call a time series here because its index set is .
The process is strictly stationary when for every integer , every , and every shift , This condition concerns the full finite-dimensional laws and imposes no moment condition by itself.
The process is weakly stationary when for every , its mean is independent of , and for every the covariance is independent of . Expectation, variance, and covariance have the meanings in Expectation of a nonnegative or integrable random variable and Moments, variance, and covariance on a probability space. Strict stationarity alone therefore does not supply the moment hypotheses needed for covariance or sample-mean claims.
Autocovariance and sample autocovariance
Definition
For a weakly stationary real process , its autocovariance function (ACVF) is which is independent of by Strict and weak stationarity for integer-indexed time series.
For a finite data vector , where , let Its biased sample ACVF is the zero-extended sequence on given by and for . The absolute lag makes .
For comparison, define the pair-count-normalized rescaling and set it to zero for . Its denominator is positive on the stated domain. The names specify the denominator convention; they assert no unbiasedness formula.
Ergodic time-series sample means converge almost surely and in L1
Statement
Assume the Axiom of Choice. Let be a real strictly stationary process with . Put for . If the canonical shift of the one-sided path law of is ergodic, then almost surely and in . Here strict stationarity on means invariance of every finite-dimensional law under every common integer shift; the one-sided ergodicity convention is that of Stationary process and canonical path shift and Ergodicity relative to an invariant measure.
Facts & Assumptions
Given: AC, a real process whose finite-dimensional laws are invariant under all common integer shifts, , and ergodicity of the canonical shift on the path law of , .
The Axiom of Choice (AC) asserts that every family of nonempty sets has a choice function (The Axiom of Choice).
Strict and weak stationarity for integer-indexed time series: strict stationarity on is invariance of all finite-dimensional laws under common integer shifts.
Stationary process and canonical path shift: a one-sided strictly stationary process has a canonical path law and left shift.
Ergodicity relative to an invariant measure: ergodicity means every strictly invariant event is null or conull for the invariant path law.
Birkhoff limit for a stationary integrable process: assuming AC, a real strictly stationary integrable process has almost-sure and convergence of its averages to the conditional-expectation limit; if its canonical shift is ergodic, that limit is its mean.
Proof
Proof technique: restrict the integer-indexed process to positive times and apply the established one-sided Birkhoff result.
Define for . For any finite indices and shift , [F1] applied to the times gives . Thus is strictly stationary in the one-sided convention of [F2]. Taking shows has the same law as , so it is integrable; the canonical shift is ergodic by the given assumption.
By [F3] the assumed ergodicity is exactly ergodicity of the canonical path shift required by [F4]. AC [A1], integrability from step 1.1, strict stationarity from step 1.1, and that ergodic shift satisfy the hypotheses of [F4]. Hence converges almost surely and in to . Since this average is exactly , the asserted convergence follows. The choice assumption is inherited through [F4]'s conditional-expectation identification; this proof adds no other choice use.
Sample-mean variance and positive semidefinite sample ACVF
Statement
Let be weakly stationary, with mean and autocovariance , and define for . Then If , then so : the sample mean is consistent in . No mixing property or central limit theorem is asserted here. For every finite real data vector, the zero-extended biased sample ACVF of Autocovariance and sample autocovariance has nonnegative Toeplitz quadratic forms.
Facts & Assumptions
Given: A weakly stationary real process with mean and autocovariance , an integer , and (for the consistency conclusion) . The sample ACVF conclusion applies to every finite real data vector of length .
Strict and weak stationarity for integer-indexed time series: each has finite second moment, is constant, and is independent of .
Moments, variance, and covariance on a probability space defines variance and covariance from centered squares and products; Variance and covariance identities for random variables gives covariance bilinearity on finite linear combinations.
Linearity, monotonicity, and the modulus bound for expectation: expectation is linear on integrable random variables.
Autocovariance and sample autocovariance: after centering a data vector by its sample mean, is the lagged product sum, with zero extension for .
Proof
Proof technique: count pairs by their lag, bound the resulting covariance sum, and write the sample Toeplitz form as a sum of squares.
Each is integrable because and the probability space has total mass one. Repeated application of [F3] gives . By [F2] and its cited covariance-bilinearity supplier, .
Fix a data vector , let for , and set otherwise. By [F4], for every , . The sum is finite because has finite support. Replacing by and commuting the real factors shows .
For , [F1] gives . For each integer with , exactly ordered pairs satisfy , and no ordered pair has . Grouping the finite sum in step 1.1 by proves the variance identity.
Under absolute covariance summability, every weight in the identity is between and , so .
Step 1.1 gives . Therefore , and the bound in step 3.1 tends to zero as . This is precisely consistency for the mean.
Let be any finitely supported real coefficient family indexed by integers. Expanding the finite sums and using the evenness from step 1.2 gives . Only finitely many terms on the right are nonzero, and every summand is a square. Thus every finite Toeplitz quadratic form of is nonnegative.
5 · Examples, counterexamples and false statements
None yet.
Sources
- Nicolai Meinshausen, Time Series Analysis: Notes for the course HS 2022, complete 57-page lecture notes
- STAT 720 Time Series Analysis, South Carolina course notes by Wang, focused Sections 2.1–2.2
- STAT 720 Time Series Analysis, South Carolina course notes by Wang, focused Sections 2.1–2.2 and Lemma 2.3