How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Sample-covariance resolvent deterministic equivalents
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Analyticity of Holomorphic Functions; Liouville and Morera
- Arc Length and Rectifiable Curves
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Bounded Variation and the Riemann–Stieltjes Integral
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Coordinate and Path Transport
- Complex Differentiability and the Cauchy–Riemann Equations
- Complex Power Series and Analytic Functions
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Concentration
- Conditional Expectation
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Connectedness
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Contour Integration
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Cyclic Groups and Direct Products
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Discrete Time Martingales
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- Equivalent Forms of Completeness
- Filters and Ultrafilters
- Finite basis projector energies and variational electronic structure
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability Spaces and Random Variables
- Foundations of the Real Numbers for Analysis
- Fundamental Trigonometric Identities
- Goursat's Theorem and Cauchy's Theorem in a Convex Domain
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Hausdorff via the Diagonal
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Influence and Breakdown
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Interpolative cur and nystrom decompositions
- Lebesgue Measure on Euclidean Space
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Line Integrals and the Gradient Theorem
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Marchenko–Pastur law and sample-covariance edge bounds
- Martingale Inequalities and Convergence
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Modes of Convergence for Random Variables
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Partitions of Unity and Paracompactness
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Radon Measures and the Riesz Markov Kakutani Theorem
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Splitting Fields
- Strong Laws of Large Numbers
- Subspaces, Products, and Quotients
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Exponential Function
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Fundamental Theorems of Calculus
- The Galois Correspondence
- The Identity Theorem, the Maximum Principle and the Open Mapping Theorem
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Moore--Penrose Pseudoinverse and Regularised Least Squares
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Urysohn's Lemma and the Tietze Extension Theorem
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
- Weak Laws and Series of Independent Random Variables
2 · Logical flowchart
3 · Definitions, theorems and proofs
Directional spectral measure of a Hermitian matrix
Definition
For positive integers , let and let be Hermitian positive semidefinite, meaning and for every . Let be its Hermitian positive semidefinite square root and set For each distinct eigenvalue of the Hermitian matrix , let be the orthogonal projection onto its eigenspace. The empirical spectral distribution of , normalized by its dimension , is where is the unit point mass at . For a deterministic unit vector , its directional spectral measure is For a Borel set , set ; then . Both measures are supported on the nonnegative real axis.
Definition references
Bai, Miao, and Pan, §1, printed pp. 7–8 (full paper PDF).
Bai and Silverstein, Chapter 3, §§3.1–3.3, printed pp. 39–58 (full book PDF).
Facts & Assumptions
Given: Positive integers , the matrices and vector in the Definition, and the finite-dimensional spectral decomposition.
Every Hermitian matrix has real eigenvalues and mutually orthogonal eigenspace projections whose sum is the identity (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).
For each real , is the unit Borel point mass at (The Dirac set function at a point).
Each point mass is a Borel probability measure (A Dirac set function is a probability measure).
Verification
Given: The positive semidefinite matrix , matrix , and the definitions in the Definition.
By [F1], diagonalize with each . Then is Hermitian positive semidefinite. With , the matrix is Hermitian and for every ; hence all its eigenvalues are nonnegative.
Each displayed set function is a finite nonnegative linear combination of the point masses defined in [F2], which are Borel probability measures by [F3]; its coefficients are nonnegative because and . Thus both are finite Borel measures. By step 1.1 their finite supports lie in .
Operator-norm bound for bounded complex iid matrices
Statement
On a common probability space, for each positive integer , let be a positive integer with , and let have independent identically distributed entries satisfying and almost surely for a fixed . Then there is a finite constant such that, almost surely, for all sufficiently large .
Statement references
Bai and Silverstein, Chapter 3, full book PDF (source).
Facts & Assumptions
Given: The matrix sequence on its common probability space and its bounded centered iid entry law from the Statement.
The entries in each matrix are mutually independent and have the common law specified in the Statement (Identical distribution and IID families).
If , then almost surely only finitely many occur (First Borel-Cantelli lemma for events).
For an event and , whenever (Markov's inequality for random variables).
The operator norm is the maximum of over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).
Proof
If , every entry is zero almost surely and the conclusion is immediate. Assume . Regard the complex unit sphere in as the real unit sphere in . For , a maximal -separated subset is an -net; the disjoint radius- balls about its points lie in the radius- ball, so volume comparison bounds its cardinality by . If are such nets for the two unit spheres and is an complex matrix, approximating unit vectors attaining gives Indeed, the approximation error is at most .
Fix deterministic unit vectors and . Then is a sum of independent centered complex variables. Each real or imaginary summand is bounded in absolute value by . If a centered real variable is bounded by , convexity of the exponential on and give . Independence, exponential Markov inequality [F3], and optimization in therefore give because .
Choose in step 1.1. The product of the two net cardinalities is at most . Taking with large enough that , the union bound and step 2.1 make the probability that the net maximum exceeds at most . These probabilities are summable in because . Since all are defined on the common probability space in the Statement, [F2] applies to this sequence of events and the net maximum is at most eventually almost surely. The net inequality in step 1.1 and boundedness of then yield eventually, with deterministic .
Source notes
The proof is the explicit finite-net and exponential-moment argument above; the sources record the standard norm-estimation context and are not imported as proof premises.
Fourth-moment bound for a centered complex quadratic form
Statement
Let have independent identically distributed complex coordinates with , , and . Let be an independent random complex matrix with , where . Put . Then
Statement references
Bai, Miao, and Pan, Lemma 1 in §2, printed p. 12 (full paper PDF).
Bai and Silverstein, Chapter 3, §3.3, printed pp. 57–58 (full book PDF).
Facts & Assumptions
Given: The independent vector and matrix, moment conditions, and Frobenius norm in the Statement.
IID means the coordinates are mutually independent and have one common law (Identical distribution and IID families).
The joint law of independent random elements is the product of their marginal laws (Independent random elements have product joint law).
Fubini's theorem permits integration in either order for an integrable function on a sigma-finite product space (Fubini's theorem for L^1 functions on a sigma-finite product).
Proof
Given: The moment hypotheses, independence, and finite Frobenius-norm second moment in the Statement.
First fix a deterministic complex matrix . Centering the diagonal terms gives In the squared modulus, independence and make diagonal and off-diagonal parts uncorrelated; distinct diagonal terms are uncorrelated; and two off-diagonal terms have nonzero expectation only when their ordered index pairs agree or are reversed. Expanding those remaining terms yields Here by Cauchy–Schwarz, and . Also Thus the deterministic quadratic-form variance is at most .
By [F2], has product joint law. The integrand is integrable because and in finite dimension. Integrate the deterministic inequality from step 1.1 over the law of ; [F3] justifies the order of integration and gives the stated bound.
Source notes
Bai, Miao, and Pan, Lemma 1 in §2, printed p. 12 (full paper PDF).
Uniqueness of the deformed Marchenko–Pastur fixed point
Statement
Let , let be a Borel probability measure on , and fix with . There is at most one satisfying , with , and
Statement references
Silverstein, Theorem 1.1 and equation (1.4), PDF pp. 2–3 (full paper PDF).
Bai, Miao, and Pan, equation (1.1), PDF pp. 3–4 (full paper PDF).
Facts & Assumptions
Given: , a Borel probability measure on , , and two candidate solutions satisfying the Statement.
The aspect ratio is positive.
is a countably additive Borel measure on with total mass one (Probability measures and probability spaces).
The spectral parameter is with and .
Each candidate has positive imaginary part, has positive imaginary part, and satisfies the fixed-point equation in the Statement.
Proof
For either candidate , set . Since , for every , and the fixed-point equation becomes . Substituting this into and using gives All integrals are finite because .
If are the transforms of two solutions, subtracting their equations in step 1.1 and dividing by yields For either solution , taking imaginary parts in step 1.1 gives so .
Taking absolute values in the identity of step 2.1 and applying Cauchy–Schwarz gives contradicting step 2.1. Hence , and the relation with gives .
Source notes
Silverstein, Theorem 1.1 and equation (1.4), PDF pp. 2–3 (full paper PDF).
Hermitian rank-one resolvent update and trace-norm bound
Statement
Let be Hermitian positive semidefinite, let , and let with and . Set and . For the trace norm , defined as the sum of the singular values of , one has ,
Statement references
Bai, Miao, and Pan, the rank-one identity in §2, printed pp. 12–13 (full paper PDF).
Bai and Silverstein, Chapter 3, §3.3, printed pp. 53–54 (full book PDF).
Facts & Assumptions
Given: The Hermitian positive semidefinite matrix , vector , and in the Statement.
A finite-dimensional Hermitian matrix has an orthonormal eigenbasis with real eigenvalues (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).
Proof
Given: , , and with .
By [F1], write with . If , then For this is positive, so ; for the denominator is one.
Direct multiplication, using step 1.1, gives The Hermitian matrix has a resolvent at nonreal , so the displayed inverse is .
The difference in step 2.1 is a rank-one matrix. Its trace norm equals the product of the two vector norms divided by ; normality of makes both vector norms . Since , step 1.1 gives . The inequality then gives the trace bound. The case has both differences zero.
Source notes
Bai, Miao, and Pan, §2, equations (2.1)–(2.2), printed pp. 12–13 (full paper PDF).
Adapted concentration of bounded complex resolvent quadratic forms
Statement
On a common probability space, for each positive integer , let have entries from one common iid law with mean zero, unit second absolute moment, and absolute value at most , where is independent of . Let be deterministic Hermitian positive semidefinite with , and let be deterministic with . Assume . For fixed with , set Then almost surely. Moreover, for every there is a constant such that, for all sufficiently large ,
Statement references
Bai, Miao, and Pan, §2, equations (2.1)–(2.3), printed pp. 12–13 (full paper PDF).
Silverstein, Theorem 1.1 proof, PDF pp. 3–8 (full paper PDF).
Facts & Assumptions
Given: The common probability space, bounded iid entries, deterministic PSD , unit vectors , and fixed in the Statement.
The entries are mutually independent with the stated common law (Identical distribution and IID families).
Independent columns have their product joint law (Independent random elements have product joint law).
Fubini permits the finite product-integral conditional averages used for the column filtration (Fubini's theorem for L^1 functions on a sigma-finite product).
The Hermitian rank-one resolvent update and nonzero denominator are given by Hermitian rank-one resolvent update and trace-norm bound.
A summable sequence of probabilities has probability zero of occurring infinitely often (First Borel-Cantelli lemma for events).
A finite-dimensional Hermitian PSD matrix has nonnegative real eigenvalues and a unitary eigenbasis (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).
For a nonnegative random variable and , (Markov's inequality for random variables).
The operator norm is the maximum of over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).
Proof
Given: The hypotheses and notation in the Statement.
We first prove a linear-form bound. If are independent centered complex variables with and , expansion of has zero contribution whenever an index occurs exactly once. Each remaining equality pattern partitions the eight positions into blocks of sizes at least two. For a fixed pattern, the absolute sum is at most , since for . There are finitely many such patterns, so .
Write , , and . By [F4], Diagonalizing as in [F6] gives , hence the denominator has modulus at least . Conditional on all columns except , each factor in the numerator is a linear form in the bounded independent entries of column , with coefficient-vector norm at most . Step 1.1 and Cauchy–Schwarz therefore give .
Let , and let be the finite-product average over the remaining columns. By [F2]–[F3], The leave-one-column resolvent depends on all columns except , so its product-integral averages under and agree. Therefore the th summand is . Integrating over column shows , so these are martingale differences. Conditional Jensen gives .
Put , , , and . Expanding , the term linear in vanishes after conditional integration; and give By Cauchy–Schwarz and conditional Jensen, , while . Induction gives for a fixed sufficiently large and , hence .
Apply [F7] to and to obtain the stated tail bound. Since , the probabilities are summable in . All deviations lie on the common probability space in the Statement, so [F5] proves almost-sure convergence for this fixed .
Source notes
Bai, Miao, and Pan, §2, equations (2.1)–(2.3), printed pp. 12–13 (full paper PDF).
Concentration of the normalized complex Hermitian resolvent trace
Statement
On a common probability space, for each positive integer , let be independent random vectors in , let , and assume . Fix with and , and define Then for every , and almost surely.
Statement references
Bai, Miao, and Pan, §2, printed pp. 12–13 (full paper PDF).
Bai and Silverstein, Chapter 3, §3.3, printed pp. 53–55 (full book PDF).
Facts & Assumptions
Given: The common probability space, independent complex columns , the normalized resolvent trace, and with .
Adding one positive rank-one term changes the unnormalized Hermitian resolvent trace by at most (Hermitian rank-one resolvent update and trace-norm bound).
Independent random elements have product joint law (Independent random elements have product joint law).
Fubini's theorem permits integration in either order on the finite product spaces used to define the conditional averages (Fubini's theorem for L^1 functions on a sigma-finite product).
A summable sequence of event probabilities has probability zero of occurring infinitely often (First Borel-Cantelli lemma for events).
For a nonnegative random variable and , (Markov's inequality for random variables).
Proof
Given: The hypotheses and notation of the Statement.
Replacing one column by any other vector removes one positive rank-one term and adds another. Applying [F1] twice shows that changes by at most , so the real and imaginary parts of each have coordinate oscillation at most .
Let be either real part of and use [F2]–[F3] to form its product-integral Doob averages over the first columns, integrating the remaining columns against their marginal laws. Boundedness makes these integrals finite. Then has conditional mean zero and lies, conditionally on the first columns, in an interval of length at most by step 1.1.
If a real random variable has mean zero and lies in an interval of width , then has second derivative equal to a variance under an exponentially tilted law, at most ; the variance bound follows from for interval endpoints . Since the log moment and its first derivative vanish at , integrating twice gives . Apply this conditional estimate to each , iterate, and use [F5] with to obtain each one-sided tail . The same bound applies to the lower tail and to the imaginary part. If a complex number has modulus greater than , one of its real or imaginary parts has magnitude greater than , so the union bound and give the displayed probability inequality.
Since , for every fixed the step 3.1 bound is at most for all sufficiently large and some . The probabilities are summable. The deviations lie on the common probability space in the Statement, so [F4] applies; use , , and intersect the resulting countable probability-one events to conclude almost surely.
Source notes
Bai, Miao, and Pan, §2, equations (2.1)–(2.3), printed pp. 12–13 (full paper PDF).
A Hermitian directional spectral measure is a probability law
Statement
For every positive integer and every Hermitian positive semidefinite , its empirical spectral distribution is a Borel probability measure supported on . For every deterministic unit vector , its directional spectral measure is also a Borel probability measure supported on .
Statement references
Bai, Miao, and Pan, §1, printed pp. 7–8 (full paper PDF).
Bai and Silverstein, Appendix B.2, printed pp. 514–523 (full book PDF).
Directional and empirical spectral-measure definitions: definition of the directional spectral measure.
Facts & Assumptions
Given: A positive integer , a Hermitian positive semidefinite matrix and, for the directional measure, a deterministic vector with .
A finite-dimensional Hermitian matrix has an orthonormal eigenbasis; its eigenvalues are real, and positive semidefiniteness makes them nonnegative (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).
The empirical and directional measures are the finite Dirac sums stated in Directional spectral measure of a Hermitian matrix.
A Borel probability measure is countably additive and has total mass one (Probability measures and probability spaces).
The Dirac set function defined in The Dirac set function at a point is a Borel probability measure by A Dirac set function is a probability measure.
Proof
Given: , , and the definitions in the Statement.
By [F1], write over its distinct eigenvalues, where the are mutually orthogonal projections, , and . Taking traces gives . Thus the nonnegative weights in [F2] sum to one; by [F3] and [F4], is a Borel probability measure supported on .
For the unit vector , the directional weights in [F2] are , and orthogonality gives . By [F3] and [F4], the finite Dirac sum is a Borel probability measure; its support is contained in the nonnegative spectrum of by [F1].
Source notes
Bai, Miao, and Pan, equation (1.8), printed p. 8 (full paper PDF).
Deterministic equivalent for the bounded complex sample-covariance resolvent
Statement
For each positive integer , let be a positive integer with , let have entries from one common iid law with mean zero, second absolute moment one and almost surely for a fixed , and let be deterministic Hermitian positive semidefinite (self-adjoint with for every ) with induced Euclidean operator norm . Define For every fixed with and , the matrix is invertible and
Statement references
Bai, Miao, and Pan, complete Section 2 proof of Theorem 1, printed pp. 12–16 (full paper PDF).
Silverstein, Theorem 1.1 proof, PDF pp. 3–8 (full paper PDF).
Facts & Assumptions
Given: The iid bounded entries, deterministic positive semidefinite , aspect-ratio limit, and fixed in the Statement.
Independent centered complex coordinates with unit second absolute moment satisfy the stated second-moment quadratic-form bound, also conditionally when the coefficient matrix is independent (Fourth-moment bound for a centered complex quadratic form).
Adding one positive rank-one matrix has the Sherman–Morrison resolvent formula and trace-norm bound (Hermitian rank-one resolvent update and trace-norm bound).
For bounded iid entries, each deterministic unit-vector resolvent quadratic form differs from its expectation with fourth-tail bound (Adapted concentration of bounded complex resolvent quadratic forms).
Hermitian positive semidefinite matrices have nonnegative eigenvalues and an orthonormal eigenbasis (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).
The Stieltjes transform of a probability measure uses the convention in the upper half-plane (Stieltjes transform of a probability measure on the real line).
The operator norm is the maximum of over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).
Proof
Fix , suppress the index , write , , , , and . The companion matrix is positive semidefinite by [F4], so is the Stieltjes transform of an expected probability measure on by [F5] and has positive imaginary part. If , then for every , so exists and . The same spectral calculation applied to gives .
Set and . The trace in is a Stieltjes transform with nonnegative weights: in an eigenbasis of its weights are . The inequality in step 1.1 therefore also gives . Conditional on all columns except , [F1] and give , where integrates column . For any deterministic unit , set This is a centered quadratic form in column . Its coefficient matrix is so it has rank at most one and Frobenius norm at most . Thus [F1] gives . Also and .
For all sufficiently large we have . Put , , and . The matrix has block form For a block matrix with invertible , solving its product with gives and . Hence its inverse's upper-left entry is . Here , so and . The Schur complement is therefore , proving .
By exchangeability of the columns and step 2.2, . The identity gives . The rank-one formula [F2] gives . Substituting these identities and the formula for yields Testing against and adding then subtracting and decomposes the right side into three terms .
For the first term, . Since is independent of column 1 and , we have . Therefore step 2.1, Cauchy–Schwarz, and the uniform bounds on imply
For the second term, . Conditional second moments of the two linear forms and are each , uniformly in the other columns. Cauchy–Schwarz and boundedness of yield .
The third term is . For any deterministic sequence of unit vectors , put and ; their norms are uniformly bounded by step 1.1. For , direct expansion gives Rescale each nonzero vector to unit length; zero vectors contribute zero. For each fixed , [F3] and the union bound imply . Also for a fixed finite . Thus , so first letting and then gives . Boundedness of and Cauchy–Schwarz yield . This holds for every deterministic unit-vector sequence, hence uniformly over unit : otherwise a sequence of deterministic directions with bounded away from zero along a subsequence would contradict the conclusion just proved. No shrinking-threshold tail estimate is used.
The bounds in steps 4.1, 4.2, and 4.3 tend to zero uniformly over deterministic unit . The tested resolvent identity in step 3.1 therefore proves the asserted supremum limit.
Source notes
Bai, Miao, and Pan, equations (2.2)–(2.9), printed pp. 12–15 (full paper PDF). The -prefactor in their estimate (2.6) gives after the displayed moment bounds; the proof above retains that corrected vanishing order. Their (2.8) term is bounded here by adapted resolvent concentration and polarization.
General-population sample-covariance law for bounded entries
Statement
Assume the Axiom of Choice. On a common probability space, for each positive integer , let be a positive integer with , let have entries from one common iid law with mean zero, second absolute moment one and absolute value bounded by one fixed finite constant, and let be deterministic Hermitian positive semidefinite (self-adjoint with for every ) with uniformly bounded induced Euclidean operator norm. Suppose the empirical eigenvalue measures converge weakly to a Borel probability measure on . Put and , and let . Then there is a unique Borel probability measure on such that, almost surely, converges weakly to . Its Stieltjes transform is the unique satisfying , with , and
Statement references
Silverstein, Theorem 1.1 and its complete proof in Section 3 (full paper PDF).
Bai, Miao, and Pan, Section 2, including the sample-covariance resolvent conventions (full paper PDF).
Facts & Assumptions
Given: The common probability space, assumptions, matrices, and empirical measures in the Statement, including AC.
The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).
The normalized eigenvalue measure of the complex Hermitian sample-covariance matrix is its empirical spectral distribution, defined as the rank-weighted finite spectral measure (Directional spectral measure of a Hermitian matrix).
Iid entries are mutually independent and share one common distribution (Identical distribution and IID families).
The Stieltjes transform convention is for (Stieltjes transform of a probability measure on the real line).
Markov's inequality bounds the mass of by the first moment divided by (Markov's inequality for random variables).
Tight families of Borel probabilities on a Polish space are relatively sequentially compact for weak convergence, under AC (Prokhorov tightness theorem on polish spaces).
The bounded-entry resolvent has the deterministic equivalent , uniformly on deterministic unit-vector quadratic forms (Deterministic equivalent for the bounded complex sample-covariance resolvent).
The normalized resolvent trace concentrates almost surely about its expectation (Concentration of the normalized complex Hermitian resolvent trace).
The deformed fixed-point equation has at most one solution satisfying the stated upper-half-plane conditions (Uniqueness of the deformed Marchenko–Pastur fixed point).
Equal Stieltjes transforms determine probability measures on the real line (Stieltjes inversion and uniqueness for probability measures on the real line).
The normalized operator norm of bounded complex iid matrices is almost surely eventually bounded (Operator-norm bound for bounded complex iid matrices).
The nonzero eigenvalues of and agree with multiplicity (Every linear map between finite-dimensional real or complex inner product spaces admits a singular value decomposition).
A probability measure is a countably additive Borel measure of total mass one (Probability measures and probability spaces).
Integrals of nonnegative increasing measurable sequences converge to the integral of their pointwise limit (Monotone convergence for the integral).
The ordered eigenvalues of a Hermitian matrix vary continuously with the matrix in operator norm (Ordered eigenvalues of Hermitian matrices are operator-norm Lipschitz).
A Polish space is a separable topological space whose topology is induced by a complete metric (Polish spaces are separable completely metrizable spaces).
Weak convergence of Borel probabilities means convergence of integrals against all bounded continuous real-valued functions (Weak convergence of borel probability measures).
The operator norm is the maximum of over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).
Proof
Write , let , and let be defined similarly for . By [F14], each ordered eigenvalue is continuous in the matrix entries, so these setwise expectations are defined for Borel . For disjoint Borel sets, countable additivity of the random ESDs followed by [F13] gives countable additivity of and ; their total masses are one. Independence and unit second moment give and . Both first moments are uniformly bounded because and is uniformly bounded. By [F4], their tails above are at most the corresponding first moment divided by , so both expected-measure sequences are tight on . The half-line is Polish: it is a closed subset of the complete real line and is dense. By [A1] and [F5], every subsequence of has a further weakly convergent subsequence.
For each fixed , [F7] gives almost surely. Since all are on the common probability space in the Statement, intersect these events over the countable dense set .
Fix and take any such subsequence with . Let and . By [F11], the two sample-covariance matrices have the same nonzero eigenvalues, so their transforms satisfy exactly . Hence . Moreover . The first moments of are bounded, so at least half of each lies in some fixed interval ; consequently and .
Apply [F6] to an orthonormal eigenbasis of . Its uniform quadratic-form error implies Since , all are supported in one compact interval, , and , the integrands converge uniformly on that interval to . Thus . The relation for in step 2.1 gives , so satisfies the fixed-point equation in the Statement. The argument applies to every and every weak subsequential limit . By [F8], all such limits have the same transform; [F9] makes them equal. At least one such limit exists by step 1.1, so call it . Tightness then implies .
On the same event, [F10] gives eventually for a finite deterministic , so the random measures are eventually supported on and are tight. The half-line is Polish by the metric facts in step 1.1 and [F15]. By [A1] and [F5], every subsequence has a weakly convergent further subsequence. For each dense-set , its transform equals that of by steps 3.1 and 1.2, since the real and imaginary parts of are bounded continuous and [F16] applies to each. For any probability law , its transform satisfies , so equality on the dense set extends to all ; [F9] identifies the subsequential limit as . Every subsequence has the same further limit, and [F16] gives almost surely.
Source notes
Silverstein, Theorem 1.1 and complete Section 3 proof (full paper PDF). The local proof makes the companion-transform relation and the uniqueness step explicit.
Directional deterministic equivalent for bounded sample-covariance entries
Statement
Assume the Axiom of Choice. On a common probability space, for each positive integer , let be a positive integer with , let have entries from one common iid law with mean zero, second absolute moment one and absolute value bounded by a fixed finite constant, and let be deterministic Hermitian positive semidefinite (self-adjoint with for every ) with uniformly bounded induced Euclidean operator norm and empirical eigenvalue measures . Let be deterministic unit vectors such that for every , For , define the directional spectral measure for Borel . Then almost surely , where and is the probability measure characterized by
Statement references
Bai, Miao, and Pan, Theorem 1 and complete Section 2 proof, printed pp. 8–16 (full paper PDF).
Silverstein, Theorem 1.1 and complete Section 3 proof (full paper PDF).
Facts & Assumptions
Given: The common probability space, hypotheses, matrices, and directional measures in the Statement, including AC.
The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).
For Hermitian and unit , the directional spectral measure is (Directional spectral measure of a Hermitian matrix).
This measure is a Borel probability because the spectral projections are orthogonal and sum to the identity (A Hermitian directional spectral measure is a probability law).
The expected resolvent has deterministic equivalent , uniformly for deterministic unit-vector quadratic forms (Deterministic equivalent for the bounded complex sample-covariance resolvent).
The bounded-entry empirical spectral distribution converges almost surely to with the stated fixed-point transform (General-population sample-covariance law for bounded entries).
A bounded-entry directional resolvent quadratic form concentrates almost surely about its expectation (Adapted concentration of bounded complex resolvent quadratic forms).
Dominated convergence passes limits through integrals under a common integrable bound (Dominated convergence).
The normalized operator norm of bounded complex iid matrices is almost surely eventually bounded (Operator-norm bound for bounded complex iid matrices).
Tight probability laws on a Polish space have weakly convergent subsequences under AC (Prokhorov tightness theorem on polish spaces).
The Stieltjes transform uses and determines a probability measure uniquely (Stieltjes transform of a probability measure on the real line, Stieltjes inversion and uniqueness for probability measures on the real line).
The nonzero eigenvalues of and agree with multiplicity (Every linear map between finite-dimensional real or complex inner product spaces admits a singular value decomposition).
A Polish space is a separable topological space whose topology is induced by a complete metric (Polish spaces are separable completely metrizable spaces).
Weak convergence of Borel probabilities means convergence of integrals against every bounded continuous real-valued function (Weak convergence of borel probability measures).
The operator norm is the maximum of over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).
Proof
Fix and let . By [F4], the empirical transforms of converge almost surely to ; their absolute values are at most , so [F6] gives convergence of their expectations. By [F10], the nonzero eigenvalue equality for and gives , with . Hence .
For deterministic unit , [F3] and [F5] yield The matrix inverses are uniformly bounded by from the positive-measure resolvent estimate in the proof of [F3]. Since are uniformly bounded and , the resolvent identity gives
Since , also lies in and . The population-resolvent hypothesis at this fixed therefore gives . By [F4], . Step 2.1 now proves almost surely for each fixed .
The resolvent in step 3.1 is the Stieltjes transform of by [F1]. Intersect the probability-one events over a countable dense subset of . By [F7], on this event the spectra of are eventually contained in one compact interval, so [F2] makes the directional measures a tight sequence of probabilities. The half-line is Polish: it is a closed subset of the complete real line with dense subset , in the sense of [F11]. By [A1] and [F8], every subsequence has a weakly convergent further subsequence. Its transform agrees with on the dense set by step 3.1; continuity of Stieltjes transforms extends equality to all , and [F9] identifies that limit with . Therefore every subsequence has the same further limit, which by the bounded-continuous-test definition [F12] proves almost surely.
Source notes
Bai, Miao, and Pan, Theorem 1, equations (1.1)–(1.5), and Section 2, equations (2.1)–(2.9), printed pp. 8–16 (full paper PDF).
A coarse complex sample-covariance norm bound from real edge bounds
Statement
Let be one infinite iid array of centered complex random variables with and . For positive integers , let be positive with , and let . Then almost surely In particular, when , the right side is at most .
Statement references
Yin, Bai, and Krishnaiah, Theorem 3.1, as reconstructed in the current real finite-fourth-moment upper-edge supplier (full paper PDF).
Bai, Miao, and Pan, Section 2, printed pp. 12–16 (full paper PDF).
Facts & Assumptions
Given: The common nested complex iid array and its centered finite-fourth-moment entry law.
Iid entries are independent and share one common distribution (Identical distribution and IID families).
For a real nested iid array with mean zero, variance one and finite fourth moment, almost surely when the number of columns divided by the number of rows tends to (Finite-fourth-moment upper bound for the largest sample-covariance eigenvalue).
The operator norm is the largest singular value, and the largest eigenvalue of is its square (The operator norm is 0 on the zero domain and otherwise equals the largest singular value, attained at a right-singular vector, Every linear map between finite-dimensional real or complex inner product spaces admits a singular value decomposition).
The operator norm is the maximum of over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).
Proof
Write , , and . Centering of makes both real coordinates centered, and . If , the matrices are upper-left blocks of one real iid array with mean zero, variance one and finite fourth moment. Applying [F2] with and then [F3] gives If , the centered real part is zero almost surely, so the same bound holds. The identical argument for the imaginary part gives the bound with .
The complex operator norm satisfies . Intersecting the two probability-one events from step 1.1 proves the asserted limsup bound. Finally, by Cauchy–Schwarz, giving the unit-variance consequence.
Source notes
The real edge application uses the current local upper-edge proof for the same top-left nested blocks, finite-fourth-moment law, dimension ratio and normalization. The complex-to-real reduction and triangle bound are proved above.
Sample-covariance resolvent deterministic equivalents
Statement
Assume the Axiom of Choice. Let be one infinite iid array of complex random variables with , , and . For each positive integer , let be positive with and let be its upper-left block. Let be deterministic Hermitian positive semidefinite with uniformly bounded operator norm and empirical eigenvalue measures . Let be deterministic unit vectors such that, for every , Define and for Borel . Then almost surely converges weakly to the probability measure whose Stieltjes transform is the unique satisfying , with , and
Statement references
Bai, Miao, and Pan, Theorem 1 and complete Section 2 proof, printed pp. 8–16 (full paper PDF).
Silverstein, Theorem 1.1 and complete Section 3 proof (full paper PDF).
Facts & Assumptions
Given: The common nested iid array, finite-fourth-moment law, deterministic population matrices and directions, aspect ratio, and AC in the Statement.
The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).
For bounded complex iid entries with the stated population and direction hypotheses, the directional measures converge almost surely to (Directional deterministic equivalent for bounded sample-covariance entries).
For a centered complex iid finite-fourth-moment array with , the same nested-block and aspect-ratio conventions give almost surely, where and ; the bound includes (A coarse complex sample-covariance norm bound from real edge bounds).
A Hermitian directional spectral measure is a probability law (A Hermitian directional spectral measure is a probability law).
Tight probability laws on a Polish space have weakly convergent subsequences under AC (Prokhorov tightness theorem on polish spaces).
Equal Stieltjes transforms determine probability measures on the real line (Stieltjes inversion and uniqueness for probability measures on the real line).
A Polish space is a separable topological space whose topology is induced by a complete metric (Polish spaces are separable completely metrizable spaces).
Iid entries are mutually independent and share one common law (Identical distribution and IID families).
The directional measure is for a deterministic unit vector (Directional spectral measure of a Hermitian matrix).
The Stieltjes transform convention is on (Stieltjes transform of a probability measure on the real line).
Weak convergence means convergence of integrals against all bounded continuous real-valued functions (Weak convergence of borel probability measures).
The operator norm is the maximum of over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).
Proof
Let have the common entry law. For integer , set , , and . Then , and because and . For all sufficiently large , ; put . These entries are centered, bounded, iid and have unit second absolute moment, while is centered iid with finite fourth moment. At matrix level, , where and are the common upper-left blocks formed from and .
For each fixed sufficiently large integer , the original, standardized, and residual arrays have second absolute moments , , and , respectively. Applying the variance-scaled bound [F2] to each gives almost surely where . If , the centered residual entries are zero almost surely; countability of the double array gives for every on one probability-one event, so the residual bound still holds. Intersect these events over the countable set of such . Writing , the identity yields where . For positive semidefinite and , the resolvent identity gives .
Fix and a deterministic unit direction sequence . For each such , [F1] applied to gives almost surely, with the transform convention [F9]. By step 2.1, on the probability-one event obtained by intersecting the events from step 2.1 with the almost-sure convergence event for this fixed truncation level. The right side tends to zero as , so the directional Stieltjes transforms converge almost surely at every fixed . Intersecting over a countable dense set gives simultaneous convergence there.
By [F2], is almost surely eventually bounded. Thus the directional laws are eventually supported on one compact interval; [F3] makes them probability measures and [F8] gives their exact spectral-measure meaning. They are therefore tight. The half-line is Polish: it is closed in the complete real line and has dense subset , as required by [F6]. By [A1] and [F4], each subsequence has a weakly convergent further subsequence. Its transform equals on the dense set by step 3.1; continuity of Stieltjes transforms extends equality to , and [F5] identifies the subsequential limit as . The bounded-continuous-test definition [F10] yields the stated weak convergence. Every subsequence has the same further limit, proving the asserted almost-sure limit.
Source notes
Bai, Miao, and Pan, Theorem 1 and Section 2, printed pp. 8–16 (full paper PDF). The sampling convention is the upper-left block of one iid double array. The truncation comparison uses the separately proved real-edge norm supplier; it does not assume weak convergence alone controls spectral edges.
Isotropic minimum-norm risk limits under a positive spectral gap
Statement
Assume the Axiom of Choice. Let be one infinite iid array of real random variables with mean zero, variance one and finite fourth moment. For each , let be a positive integer with and let be the upper-left block. Let be deterministic with . Let have independent centered components of variance , independent of (so its covariance is ), and let be independent of with mean zero and covariance . Set , , and . Define the design-conditional prediction risk by . If , then almost surely . If , then almost surely .
Statement references
Hastie, Montanari, Rosset, and Tibshirani, Theorem 1 and Appendix C.2 (full paper PDF).
Bai, Miao, and Pan, Theorem 1 (full paper PDF).
Facts & Assumptions
Given: The nested real iid design, deterministic signal, independent centered noise with covariance , and AC in the Statement.
The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).
The noise vector is independent of the design, centered, and has covariance as stated.
The test feature is independent of the design and noise, centered, and has covariance as stated.
The Moore–Penrose inverse is characterized by the four Penrose equations (The Moore--Penrose pseudoinverse as the solution of the four Penrose equations).
and are orthogonal projections with ranges and , respectively (The Moore-Penrose products are orthogonal projectors).
Positive covariance eigenvalues are squared positive singular values divided by the sample size, and their number is the matrix rank (Every linear map between finite-dimensional real or complex inner product spaces admits a singular value decomposition, The rank of a linear map is the number of its nonzero singular values).
For the nested design, the smallest positive covariance eigenvalue has limit for and for , with eventual full rectangular rank (Almost-sure limit and structural-zero count at the lower sample-covariance edge).
The empirical spectral distribution of converges almost surely to the Marchenko–Pastur law with aspect ratio (Almost-sure Marchenko–Pastur law for finite-fourth-moment sample covariance matrices).
For upper-left blocks indexed by their row dimension , the directional theorem with identity population gives almost-sure weak convergence to when (Sample-covariance resolvent deterministic equivalents). Repeated dimensions require the argument below.
The Marchenko–Pastur probability law has an atom at zero, positive support , and transform satisfying (Marchenko–Pastur measure with aspect ratio gamma, The Marchenko–Pastur formula defines a probability law with the fixed-point transform).
Weak convergence gives convergence of integrals against every bounded continuous test function (Weak convergence of borel probability measures).
The deformed fixed-point solution is unique when both its transform and its companion transform have positive imaginary part (Uniqueness of the deformed Marchenko–Pastur fixed point).
Dominated convergence passes limits through integrals under an integrable majorant (Dominated convergence).
Iid entries are independent and share one common law (Identical distribution and IID families).
The finite-column proof of bounded resolvent concentration, steps 1.1–4.1, bounds the fourth moment of each leave-one-column increment by and that of the centered directional resolvent by , with constants independent of the unit direction and row dimension when the population is the identity (Adapted concentration of bounded complex resolvent quadratic forms).
For a nested real iid unit-variance finite-fourth-moment array with , almost surely (Finite-fourth-moment upper bound for the largest sample-covariance eigenvalue, [F3]).
Markov bounds a nonnegative random variable's tail by its expectation divided by the threshold; summable event probabilities imply only finitely many occurrences almost surely (Markov's inequality for random variables, First Borel-Cantelli lemma for events).
Proof
Put . For any fixed , , so the stated prediction risk equals . By [F2], is an orthogonal projection. The Penrose equation shows : if , then , and if , then . Hence by the right-singular-vector basis in [F3], so . Conditional on , the cross term has expectation zero because . Its noise contribution is where the middle equality follows by writing an SVD and the last uses for . With , this proves the exact identity
First identify the isotropic limit. By [F7], is a nonnegative probability measure: when , the negative coefficient cancels exactly the zero atom of . Thus is its Stieltjes transform and has positive imaginary part, as does . The scalar equation in [F7] rearranges to ; [F9] therefore identifies . For any deterministic unit directions and fixed , we claim . Indeed, every subsequence has a further subsequence with strictly increasing , since . In the transposed infinite array, prescribe and direction at , and at all other dimensions prescribe and the first coordinate vector. Then , so [F6] applies to this completed sequence. The bound and [F10] give the claimed expectation limit along . The subsequence criterion gives it along the original sequence. This argument also applies to each fixed standardized bounded truncation of the entry law.
Suppose and set . By [F4], has full column rank eventually and every eigenvalue of is at least eventually. Thus the bias term in step 1.1 is zero and for the bounded continuous function . By [F5] and [F8], this converges to , since the Marchenko–Pastur support is bounded below by . For , define . The integrands are bounded by and converge pointwise to , so [F10] gives as . The fixed-point equation in [F7], initially stated for , extends to by dominated convergence in its defining integral; its denominator stays nonzero because . Taking yields , hence . Since , step 1.1 gives .
For such a bounded unit-variance truncation, let be its block and . Apply the finite-column argument [F12] to , which has independent columns and identity population. More explicitly, each leave-one-column resolvent quadratic-form increment has by the bounded-entry eighth-moment linear-form estimate; its column-filtration difference satisfies . The fourth-moment recursion in [F12], , gives , and hence . These are finite-matrix estimates, with no indexing or distinctness assumption on . By [F14], their tails are summable in the original index . Together with step 1.2 this proves almost surely for each fixed .
To remove boundedness, put , , and . For sufficiently large integers , form from and write . The residual entries are centered with finite fourth moment and variance . Applying [F13] to the original, standardized and variance-normalized residual arrays yields, with , almost surely , , and . If , countability of the array makes every residual entry zero almost surely. The Gram-matrix identity then gives . For , the resolvent identity bounds the difference of their directional transforms by . Intersect the probability-one events over integers and let in step 2.2 to obtain almost surely.
Suppose and set . By [F4], has full row rank eventually, has exactly zero eigenvalues, and all positive eigenvalues are at least eventually. For each rational , the spectral identity bounds the difference between the directional transforms at and by , both for and for . Use step 3.1 at for all positive integers , then let , to obtain on one probability-one event for all rational . The gap gives eventually. Since by [F7] and [F10], letting rational proves the required bias limit. Define and, for , . This is bounded and continuous, equals zero at zero, and equals for . Therefore by [F5] and [F8]. [F7] gives as : subtract the zero atom and use [F10] by dominated convergence on the positive support, whose lower endpoint is . To compute the constant term, write and substitute into , the fixed-point equation at (again obtained by dominated convergence from [F7]). The coefficient of vanishes because ; the constant term is . It must vanish, so . Using in step 1.1 proves .
Source notes
Hastie, Montanari, Rosset, and Tibshirani, Theorem 1 and Appendix C.2 (full paper PDF). The repeated-dimension argument in steps 1.2, 2.2, and 3.1 uses injective row dimensions only for expectation limits; almost-sure concentration is summed in the original sample index. It follows the truncation and martingale structure of Bai, Miao, and Pan, Section 2, without changing the row-indexed supplier interface. The proof above separates the conditional noise expectation from the design almost-sure limits and uses a positive-edge cutoff rather than a interchange.
Fixed negative-axis directional resolvent integrals converge
Statement
Under the hypotheses of the sample-covariance resolvent deterministic-equivalent theorem, for each fixed the directional measures satisfy
Statement references
Bai, Miao, and Pan, Theorem 1, printed pp. 8–9 (full paper PDF).
Facts & Assumptions
Given: The hypotheses and directional measures in the Statement.
The directional measures converge almost surely weakly to (Sample-covariance resolvent deterministic equivalents).
Weak convergence means convergence of integrals against every bounded continuous real-valued function (Weak convergence of borel probability measures).
The directional spectral measure is for a deterministic unit vector (Directional spectral measure of a Hermitian matrix).
Proof
Fix . The function is continuous on and satisfies , so it is bounded. The measure is the directional spectral law in [F3].
On the probability-one event in [F1], apply the defining bounded-continuous-test property [F2] to to obtain the asserted integral convergence.
Source notes
The proof is the direct bounded-continuous-test consequence of the preceding directional weak-convergence theorem.
4 · Examples, counterexamples and false statements
None yet.
Sources
- Z. D. Bai, B. Q. Miao, and G. M. Pan, On Asymptotics of Eigenvectors of Large Sample Covariance Matrix
- Z. D. Bai and J. W. Silverstein, Spectral Analysis of Large Dimensional Random Matrices, 2nd ed.
- J. W. Silverstein, Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices
- Yin, Bai, and Krishnaiah, Theorem 3.1 (real upper-edge result)
- T. Hastie, A. Montanari, S. Rosset, and R. J. Tibshirani, Surprises in High-Dimensional Ridgeless Least Squares Interpolation