Alphabeta Math
Pipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

Sample-covariance resolvent deterministic equivalents

1 · Prerequisites

2 · Logical flowchart

3 · Definitions, theorems and proofs

DefinitionDefinition: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Directional spectral measure of a Hermitian matrix

Definition

For positive integers d,N, let X∈Cd×N and let T∈Cd×d be Hermitian positive semidefinite, meaning T=T∗ and v∗Tv≥0 for every v∈Cd. Let T1/2 be its Hermitian positive semidefinite square root and set A:=1NT1/2XX∗T1/2. For each distinct eigenvalue λ of the Hermitian matrix A, let Pλ be the orthogonal projection onto its eigenspace. The empirical spectral distribution of A, normalized by its dimension d, is μA:=1d∑λ∈spec⁡(A)rank⁡(Pλ) δλ, where δλ is the unit point mass at λ. For a deterministic unit vector x∈Cd, its directional spectral measure is μAx:=∑λ∈spec⁡(A)∥Pλx∥22 δλ. For a Borel set B⊆R, set 1B(A):=∑λ∈B∩spec⁡(A)Pλ; then μAx(B)=x∗1B(A)x. Both measures are supported on the nonnegative real axis.

Definition references

Bai, Miao, and Pan, §1, printed pp. 7–8 (full paper PDF).

Bai and Silverstein, Chapter 3, §§3.1–3.3, printed pp. 39–58 (full book PDF).

Facts & Assumptions

Given: Positive integers d,N, the matrices and vector in the Definition, and the finite-dimensional spectral decomposition.

[F1]

Every Hermitian matrix has real eigenvalues and mutually orthogonal eigenspace projections whose sum is the identity (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).

[F2]

For each real λ, δλ is the unit Borel point mass at λ (The Dirac set function at a point).

[F3]

Each point mass δλ is a Borel probability measure (A Dirac set function is a probability measure).

Verification

Given: The positive semidefinite matrix T, matrix X, and the definitions in the Definition.

1.1givenF1algebra

By [F1], diagonalize T=Udiag⁡(t1,…,td)U∗ with each tj≥0. Then T1/2:=Udiag⁡(t1,…,td)U∗ is Hermitian positive semidefinite. With B=N−1/2T1/2X, the matrix A=BB∗ is Hermitian and v∗Av=∥B∗v∥22≥0 for every v; hence all its eigenvalues are nonnegative.

2.1givenF2F3step 1.1algebra∎

Each displayed set function is a finite nonnegative linear combination of the point masses defined in [F2], which are Borel probability measures by [F3]; its coefficients are nonnegative because rank⁡(Pλ)/d≥0 and ∥Pλx∥22≥0. Thus both are finite Borel measures. By step 1.1 their finite supports lie in [0,∞).

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

Operator-norm bound for bounded complex iid matrices

Statement

On a common probability space, for each positive integer n, let Nn be a positive integer with n/Nn→c∈(0,∞), and let Xn∈Cn×Nn have independent identically distributed entries ξ satisfying Eξ=0 and ∣ξ∣≤K almost surely for a fixed K<∞. Then there is a finite constant C=C(K,c) such that, almost surely, ∥Xn∥op≤CNn for all sufficiently large n.

Statement references

Bai and Silverstein, Chapter 3, full book PDF (source).

Facts & Assumptions

Given: The matrix sequence on its common probability space and its bounded centered iid entry law from the Statement.

[F1]

The entries in each matrix are mutually independent and have the common law specified in the Statement (Identical distribution and IID families).

[F2]

If ∑nP(En)<∞, then almost surely only finitely many En occur (First Borel-Cantelli lemma for events).

[F3]

For an event E and a>0, P(E)≤E[Y]/a whenever Y≥a1E (Markov's inequality for random variables).

[F4]

The operator norm is the maximum of ∥Av∥2 over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).

Proof

1.1givenF4algebra

If K=0, every entry is zero almost surely and the conclusion is immediate. Assume K>0. Regard the complex unit sphere in Cd as the real unit sphere in R2d. For 0<ε<1/2, a maximal ε-separated subset is an ε-net; the disjoint radius-ε/2 balls about its points lie in the radius-(1+ε/2) ball, so volume comparison bounds its cardinality by (1+2/ε)2d. If N1,N2 are such nets for the two unit spheres and A is an n×N complex matrix, approximating unit vectors u,v attaining ∥A∥op=∣u∗Av∣ gives ∥A∥op≤(1−2ε)−1max⁡u0∈N1, v0∈N2∣u0∗Av0∣. Indeed, the approximation error is at most ∥u−u0∥∥A∥+∥v−v0∥∥A∥≤2ε∥A∥.

2.1givenF1F3step 1.1algebra

Fix deterministic unit vectors u∈Cn and v∈CN. Then u∗Xnv=∑i,ju‾ivjξij is a sum of independent centered complex variables. Each real or imaginary summand is bounded in absolute value by K∣ui∣∣vj∣. If a centered real variable Y is bounded by b, convexity of the exponential on [−b,b] and EY=0 give EeλY≤cosh⁡(λb)≤eλ2b2/2. Independence, exponential Markov inequality [F3], and optimization in λ therefore give P{∣u∗Xnv∣>t}≤4exp⁡ ⁣(−t24K2), because ∑i,jK2∣ui∣2∣vj∣2=K2.

3.1givenF2step 1.1step 2.1algebra∎

Choose ε=1/8 in step 1.1. The product of the two net cardinalities is at most 172(n+Nn). Taking t=Ln+Nn with L large enough that L2/(4K2)>2log⁡17+1, the union bound and step 2.1 make the probability that the net maximum exceeds t at most 4e−(n+Nn). These probabilities are summable in n because Nn/n→1/c>0. Since all Xn are defined on the common probability space in the Statement, [F2] applies to this sequence of events and the net maximum is at most Ln+Nn eventually almost surely. The net inequality in step 1.1 and boundedness of n/Nn then yield ∥Xn∥op≤CNn eventually, with deterministic C=C(K,c).

Source notes

The proof is the explicit finite-net and exponential-moment argument above; the sources record the standard norm-estimation context and are not imported as proof premises.

LemmaStatement: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Fourth-moment bound for a centered complex quadratic form

Statement

Let ξ=(ξ1,…,ξd)T have independent identically distributed complex coordinates with Eξi=0, E∣ξi∣2=1, and μ4:=E∣ξi∣4<∞. Let A be an independent random complex d×d matrix with E∥A∥F2<∞, where ∥A∥F2:=∑i,j∣Aij∣2. Put τ:=Eξ12. Then E∣ξ∗Aξ−tr⁡A∣2≤Cμ4,τ E∥A∥F2,Cμ4,τ:=max⁡{μ4−1,1+∣τ∣2}.

Statement references

Bai, Miao, and Pan, Lemma 1 in §2, printed p. 12 (full paper PDF).

Bai and Silverstein, Chapter 3, §3.3, printed pp. 57–58 (full book PDF).

Facts & Assumptions

Given: The independent vector and matrix, moment conditions, and Frobenius norm in the Statement.

[F1]

IID means the coordinates are mutually independent and have one common law (Identical distribution and IID families).

[F2]

The joint law of independent random elements is the product of their marginal laws (Independent random elements have product joint law).

[F3]

Fubini's theorem permits integration in either order for an integrable function on a sigma-finite product space (Fubini's theorem for L^1 functions on a sigma-finite product).

Proof

Given: The moment hypotheses, independence, and finite Frobenius-norm second moment in the Statement.

1.1givenF1algebra

First fix a deterministic complex matrix A. Centering the diagonal terms gives ξ∗Aξ−tr⁡A=∑iAii(∣ξi∣2−1)+∑i≠jξi‾Aijξj. In the squared modulus, independence and Eξi=0 make diagonal and off-diagonal parts uncorrelated; distinct diagonal terms are uncorrelated; and two off-diagonal terms have nonzero expectation only when their ordered index pairs agree or are reversed. Expanding those remaining terms yields E∣ξ∗Aξ−tr⁡A∣2=(μ4−1)∑i∣Aii∣2+∑i≠j∣Aij∣2+∣τ∣2∑i≠jAijAji‾. Here μ4−1≥0 by Cauchy–Schwarz, and ∣τ∣≤E∣ξ1∣2=1. Also ∣∑i≠jAijAji‾∣≤∑i≠j∣Aij∣∣Aji∣≤∑i≠j∣Aij∣2. Thus the deterministic quadratic-form variance is at most Cμ4,τ∥A∥F2.

2.1givenF2F3step 1.1algebra∎

By [F2], (ξ,A) has product joint law. The integrand is integrable because ∣ξ∗Aξ−tr⁡A∣2≤2∥A∥F2∥ξ∥24+2d∥A∥F2, and E∥ξ∥24<∞ in finite dimension. Integrate the deterministic inequality from step 1.1 over the law of A; [F3] justifies the order of integration and gives the stated bound.

Source notes

Bai, Miao, and Pan, Lemma 1 in §2, printed p. 12 (full paper PDF).

LemmaStatement: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Uniqueness of the deformed Marchenko–Pastur fixed point

Statement

Let c>0, let H be a Borel probability measure on [0,∞), and fix z∈C with Im⁡z>0. There is at most one q∈C satisfying Im⁡q>0, u:=−(1−c)/z+cq with Im⁡u>0, and q=∫[0,∞)1t(1−c−czq)−z dH(t).

Statement references

Silverstein, Theorem 1.1 and equation (1.4), PDF pp. 2–3 (full paper PDF).

Bai, Miao, and Pan, equation (1.1), PDF pp. 3–4 (full paper PDF).

Facts & Assumptions

Given: c>0, a Borel probability measure H on [0,∞), z∈C+, and two candidate solutions q1,q2 satisfying the Statement.

[A1]

The aspect ratio c is positive.

[A2]

H is a countably additive Borel measure on [0,∞) with total mass one (Probability measures and probability spaces).

[A3]

The spectral parameter is z=u+iη with u∈R and η>0.

[A4]

Each candidate q has positive imaginary part, −(1−c)/z+cq has positive imaginary part, and q satisfies the fixed-point equation in the Statement.

Proof

1.1givenA1A2A3A4algebra

For either candidate q, set u=−(1−c)/z+cq∈C+. Since t≥0, 1+tu≠0 for every t, and the fixed-point equation becomes q=−z−1∫(1+tu)−1 dH(t). Substituting this into u=−(1−c)/z+cq and using (1+tu)−1=1−tu/(1+tu) gives z=−1u+c∫[0,∞)t1+tu dH(t). All integrals are finite because ∣t/(1+tu)∣≤1/Im⁡u.

2.1A1A2A3A4step 1.1algebra

If u1≠u2 are the transforms of two solutions, subtracting their equations in step 1.1 and dividing by u1−u2 yields 1u1u2=c∫[0,∞)t2(1+tu1)(1+tu2) dH(t). For either solution u, taking imaginary parts in step 1.1 gives Im⁡z=Im⁡u(1∣u∣2−c∫[0,∞)t2∣1+tu∣2 dH(t))>0, so c∣u∣2∫t2∣1+tu∣−2 dH(t)<1.

3.1A1A2A3A4step 2.1algebra∎

Taking absolute values in the identity of step 2.1 and applying Cauchy–Schwarz gives 1≤(c∣u1∣2∫t2∣1+tu1∣2 dH(t))1/2(c∣u2∣2∫t2∣1+tu2∣2 dH(t))1/2<1, contradicting step 2.1. Hence u1=u2, and the relation u=−(1−c)/z+cq with c>0 gives q1=q2.

Source notes

Silverstein, Theorem 1.1 and equation (1.4), PDF pp. 2–3 (full paper PDF).

LemmaStatement: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Hermitian rank-one resolvent update and trace-norm bound

Statement

Let B∈Cd×d be Hermitian positive semidefinite, let x∈Cd, and let z=u+iη with u∈R and η>0. Set R=(B−zI)−1 and Rx=(B+xx∗−zI)−1. For the trace norm ∥M∥1, defined as the sum of the singular values of M, one has 1+x∗Rx≠0, Rx=R−Rxx∗R1+x∗Rx,∥Rx−R∥1≤1η,∣tr⁡Rx−tr⁡R∣≤1η.

Statement references

Bai, Miao, and Pan, the rank-one identity in §2, printed pp. 12–13 (full paper PDF).

Bai and Silverstein, Chapter 3, §3.3, printed pp. 53–54 (full book PDF).

Facts & Assumptions

Given: The Hermitian positive semidefinite matrix B, vector x, and z in the Statement.

[F1]

Proof

Given: B, x, and z=u+iη with η>0.

1.1givenF1algebra

By [F1], write B=Udiag⁡(λ1,…,λd)U∗ with λj≥0. If c=U∗x, then q:=x∗Rx=∑j∣cj∣2λj−z,Im⁡q=η∑j∣cj∣2∣λj−z∣2=η∥Rx∥22. For x≠0 this is positive, so 1+q≠0; for x=0 the denominator is one.

2.1step 1.1algebra

Direct multiplication, using step 1.1, gives (B+xx∗−zI)(R−Rxx∗R1+x∗Rx)=I. The Hermitian matrix B+xx∗ has a resolvent at nonreal z, so the displayed inverse is Rx.

3.1step 1.1step 2.1algebra∎

The difference in step 2.1 is a rank-one matrix. Its trace norm equals the product of the two vector norms divided by ∣1+q∣; normality of R makes both vector norms ∥Rx∥2. Since ∣1+q∣≥Im⁡q=η∥Rx∥22, step 1.1 gives ∥Rx−R∥1≤1/η. The inequality ∣tr⁡M∣≤∥M∥1 then gives the trace bound. The case x=0 has both differences zero.

Source notes

Bai, Miao, and Pan, §2, equations (2.1)–(2.2), printed pp. 12–13 (full paper PDF).

LemmaStatement: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Adapted concentration of bounded complex resolvent quadratic forms

Statement

On a common probability space, for each positive integer n, let Xn∈Cn×Nn have entries from one common iid law with mean zero, unit second absolute moment, and absolute value at most K, where K is independent of n. Let Tn∈Cn×n be deterministic Hermitian positive semidefinite with ∥Tn∥op≤M, and let xn∈Cn be deterministic with ∥xn∥2=1. Assume Nn/n→κ∈(0,∞). For fixed z=u+iη with η>0, set An:=1NnTn1/2XnXn∗Tn1/2,Rn(z):=(An−zI)−1. Then xn∗Rn(z)xn−E[xn∗Rn(z)xn]→0 almost surely. Moreover, for every t>0 there is a constant C=C(K,M,z,κ) such that, for all sufficiently large n, P ⁣{∣xn∗Rn(z)xn−E[xn∗Rn(z)xn]∣>t}≤Ct4Nn2.

Statement references

Bai, Miao, and Pan, §2, equations (2.1)–(2.3), printed pp. 12–13 (full paper PDF).

Silverstein, Theorem 1.1 proof, PDF pp. 3–8 (full paper PDF).

Facts & Assumptions

Given: The common probability space, bounded iid entries, deterministic PSD Tn, unit vectors xn, and fixed z∈C+ in the Statement.

[F1]

The entries are mutually independent with the stated common law (Identical distribution and IID families).

[F2]

Independent columns have their product joint law (Independent random elements have product joint law).

[F3]

Fubini permits the finite product-integral conditional averages used for the column filtration (Fubini's theorem for L^1 functions on a sigma-finite product).

[F4]

The Hermitian rank-one resolvent update and nonzero denominator are given by Hermitian rank-one resolvent update and trace-norm bound.

[F5]

A summable sequence of probabilities has probability zero of occurring infinitely often (First Borel-Cantelli lemma for events).

[F6]

A finite-dimensional Hermitian PSD matrix has nonnegative real eigenvalues and a unitary eigenbasis (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).

[F7]

For a nonnegative random variable Y and a>0, P(Y>a)≤E[Y]/a (Markov's inequality for random variables).

[F8]

The operator norm is the maximum of ∥Av∥2 over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).

Proof

Given: The hypotheses and notation in the Statement.

1.1givenF1algebra

We first prove a linear-form bound. If ζi are independent centered complex variables with ∣ζi∣≤K and ai∈C, expansion of E∣∑iaiζi∣8 has zero contribution whenever an index occurs exactly once. Each remaining equality pattern partitions the eight positions into blocks of sizes at least two. For a fixed pattern, the absolute sum is at most K8∏B∑i∣ai∣∣B∣≤K8(∑i∣ai∣2)4, since ∑i∣ai∣r≤(∑i∣ai∣2)r/2 for r≥2. There are finitely many such patterns, so E∣∑iaiζi∣8≤CK(∑i∣ai∣2)4.

2.1givenF2F4F6F8step 1.1algebra

Write sn,j=Tn1/2Xn,⋅j/Nn, An,j=An−sn,jsn,j∗, and Rn,j=(An,j−zI)−1. By [F4], Un,j:=xn∗(Rn−Rn,j)xn=−(xn∗Rn,jsn,j)(sn,j∗Rn,jxn)1+sn,j∗Rn,jsn,j. Diagonalizing An,j as in [F6] gives Im⁡(z(1+sn,j∗Rn,jsn,j))≥η, hence the denominator has modulus at least η/∣z∣. Conditional on all columns except j, each factor in the numerator is a linear form in the bounded independent entries of column j, with coefficient-vector norm at most M/(ηNn). Step 1.1 and Cauchy–Schwarz therefore give E∣Un,j∣4≤CNn−4.

3.1givenF2F3step 2.1algebra

Let Fn,j=σ(Xn,⋅1,…,Xn,⋅j), and let En,j be the finite-product average over the remaining columns. By [F2]–[F3], xn∗Rnxn−E[xn∗Rnxn]=∑j=1Nn(En,j−En,j−1)xn∗Rnxn. The leave-one-column resolvent Rn,j depends on all columns except j, so its product-integral averages under En,j and En,j−1 agree. Therefore the jth summand is Dn,j:=(En,j−En,j−1)Un,j. Integrating over column j shows En,j−1Dn,j=0, so these are martingale differences. Conditional Jensen gives E∣Dn,j∣4≤16E∣Un,j∣4≤CNn−4.

4.1step 3.1algebra

Put Sk=∑j≤kDn,j, ak=E∣Sk∣4, vk:=En,k−1∣Dn,k∣2, and wk:=En,k−1∣Dn,k∣4. Expanding ∣Sk−1+Dn,k∣4, the term linear in Dn,k vanishes after conditional integration; ∣Re⁡(S‾k−1Dn,k)∣≤∣Sk−1∣∣Dn,k∣ and 4∣Sk−1∣∣Dn,k∣3≤2∣Sk−1∣2∣Dn,k∣2+2∣Dn,k∣4 give ak≤ak−1+8E(∣Sk−1∣2vk)+3Ewk. By Cauchy–Schwarz and conditional Jensen, E(∣Sk−1∣2vk)≤ak−1Evk2≤ak−1Ewk≤Cak−1/Nn2, while Ewk≤C/Nn4. Induction gives ak≤C0k2/Nn4 for a fixed sufficiently large C0 and k≤Nn, hence E∣SNn∣4≤C0/Nn2.

5.1givenF5F7step 4.1algebra∎

Apply [F7] to Y=∣SNn∣4 and a=t4 to obtain the stated C/(t4Nn2) tail bound. Since Nn/n→κ>0, the probabilities are summable in n. All deviations lie on the common probability space in the Statement, so [F5] proves almost-sure convergence for this fixed z.

Source notes

Bai, Miao, and Pan, §2, equations (2.1)–(2.3), printed pp. 12–13 (full paper PDF).

LemmaStatement: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

Concentration of the normalized complex Hermitian resolvent trace

Statement

On a common probability space, for each positive integer n, let Yn,1,…,Yn,Nn be independent random vectors in Cn, let Bn=∑j=1NnYn,jYn,j∗, and assume Nn/n→κ∈(0,∞). Fix z=u+iη with u∈R and η>0, and define Mn(z):=1ntr⁡(Bn−zI)−1. Then for every t>0, P{∣Mn(z)−EMn(z)∣>t}≤4exp⁡ ⁣(−t2n2η24Nn), and Mn(z)−EMn(z)→0 almost surely.

Statement references

Bai, Miao, and Pan, §2, printed pp. 12–13 (full paper PDF).

Bai and Silverstein, Chapter 3, §3.3, printed pp. 53–55 (full book PDF).

Facts & Assumptions

Given: The common probability space, independent complex columns Yn,j, the normalized resolvent trace, and z=u+iη with η>0.

[F1]

Adding one positive rank-one term changes the unnormalized Hermitian resolvent trace by at most 1/η (Hermitian rank-one resolvent update and trace-norm bound).

[F2]

Independent random elements have product joint law (Independent random elements have product joint law).

[F3]

Fubini's theorem permits integration in either order on the finite product spaces used to define the conditional averages (Fubini's theorem for L^1 functions on a sigma-finite product).

[F4]

A summable sequence of event probabilities has probability zero of occurring infinitely often (First Borel-Cantelli lemma for events).

[F5]

For a nonnegative random variable Y and a>0, P(Y>a)≤E[Y]/a (Markov's inequality for random variables).

Proof

Given: The hypotheses and notation of the Statement.

1.1givenF1algebra

Replacing one column Yn,j by any other vector removes one positive rank-one term and adds another. Applying [F1] twice shows that tr⁡(Bn−zI)−1 changes by at most 2/η, so the real and imaginary parts of Mn(z) each have coordinate oscillation at most cn:=2/(nη).

2.1givenF2F3step 1.1construct

Let f be either real part of Mn(z) and use [F2]–[F3] to form its product-integral Doob averages Fj over the first j columns, integrating the remaining columns against their marginal laws. Boundedness ∣tr⁡(Bn−zI)−1∣≤n/η makes these integrals finite. Then Dj:=Fj−Fj−1 has conditional mean zero and lies, conditionally on the first j−1 columns, in an interval of length at most cn by step 1.1.

3.1F5step 2.1algebra

If a real random variable D has mean zero and lies in an interval of width c, then log⁡EeλD has second derivative equal to a variance under an exponentially tilted law, at most c2/4; the variance bound follows from E[(D−a)(b−D)]≥0 for interval endpoints a≤D≤b. Since the log moment and its first derivative vanish at 0, integrating twice gives EeλD≤eλ2c2/8. Apply this conditional estimate to each Dj, iterate, and use [F5] with λ=4t/(Nncn2) to obtain each one-sided tail P{f−Ef≥t}≤e−2t2/(Nncn2). The same bound applies to the lower tail and to the imaginary part. If a complex number has modulus greater than t, one of its real or imaginary parts has magnitude greater than t/2, so the union bound and cn=2/(nη) give the displayed probability inequality.

4.1givenF4step 3.1algebra∎

Since Nn/n→κ∈(0,∞), for every fixed t>0 the step 3.1 bound is at most 4e−atn for all sufficiently large n and some at>0. The probabilities are summable. The deviations lie on the common probability space in the Statement, so [F4] applies; use t=1/m, m≥1, and intersect the resulting countable probability-one events to conclude Mn(z)−EMn(z)→0 almost surely.

Source notes

Bai, Miao, and Pan, §2, equations (2.1)–(2.3), printed pp. 12–13 (full paper PDF).

LemmaStatement: AI-adaptedProof: AI-adaptedOpen item page →

A Hermitian directional spectral measure is a probability law

Statement

For every positive integer d and every Hermitian positive semidefinite A∈Cd×d, its empirical spectral distribution μA is a Borel probability measure supported on [0,∞). For every deterministic unit vector x∈Cd, its directional spectral measure μAx is also a Borel probability measure supported on [0,∞).

Statement references

Bai, Miao, and Pan, §1, printed pp. 7–8 (full paper PDF).

Bai and Silverstein, Appendix B.2, printed pp. 514–523 (full book PDF).

Directional and empirical spectral-measure definitions: definition of the directional spectral measure.

Facts & Assumptions

Given: A positive integer d, a Hermitian positive semidefinite matrix A∈Cd×d and, for the directional measure, a deterministic vector x∈Cd with ∥x∥2=1.

[F1]

A finite-dimensional Hermitian matrix has an orthonormal eigenbasis; its eigenvalues are real, and positive semidefiniteness makes them nonnegative (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).

[F2]

The empirical and directional measures are the finite Dirac sums stated in Directional spectral measure of a Hermitian matrix.

[F3]

A Borel probability measure is countably additive and has total mass one (Probability measures and probability spaces).

[F4]

The Dirac set function δλ defined in The Dirac set function at a point is a Borel probability measure by A Dirac set function is a probability measure.

Proof

Given: A, x, and the definitions in the Statement.

1.1givenF1F2F3F4algebra

By [F1], write A=∑j=1rλjPj over its distinct eigenvalues, where the Pj are mutually orthogonal projections, ∑jPj=I, and λj≥0. Taking traces gives ∑jrank⁡(Pj)=d. Thus the nonnegative weights rank⁡(Pj)/d in [F2] sum to one; by [F3] and [F4], μA is a Borel probability measure supported on [0,∞).

2.1givenF1F2F3F4step 1.1algebra∎

For the unit vector x, the directional weights in [F2] are ∥Pjx∥22≥0, and orthogonality gives ∑j∥Pjx∥22=∥∑jPjx∥22=∥x∥22=1. By [F3] and [F4], the finite Dirac sum is a Borel probability measure; its support is contained in the nonnegative spectrum of A by [F1].

Source notes

Bai, Miao, and Pan, equation (1.8), printed p. 8 (full paper PDF).

LemmaStatement: AI-adaptedProof: AI-adaptedOpen item page →

Deterministic equivalent for the bounded complex sample-covariance resolvent

Statement

For each positive integer n, let Nn be a positive integer with Nn/n→κ∈(0,∞), let Xn∈Cn×Nn have entries from one common iid law with mean zero, second absolute moment one and ∣Xij∣≤K almost surely for a fixed K, and let Tn be deterministic Hermitian positive semidefinite (self-adjoint with v∗Tnv≥0 for every v) with induced Euclidean operator norm ∥Tn∥op≤M. Define An=Nn−1Tn1/2XnXn∗Tn1/2,A~n=Nn−1Xn∗TnXn, Rn(z)=(An−zIn)−1,R~n(z)=(A~n−zINn)−1,qn(z)=E[Nn−1tr⁡R~n(z)]. For every fixed z=u+iη with u∈R and η>0, the matrix In+qn(z)Tn is invertible and sup⁡∥x∥2=1∣x∗(ERn(z)+1z(In+qn(z)Tn)−1)x∣⟶0.

Statement references

Bai, Miao, and Pan, complete Section 2 proof of Theorem 1, printed pp. 12–16 (full paper PDF).

Silverstein, Theorem 1.1 proof, PDF pp. 3–8 (full paper PDF).

Facts & Assumptions

Given: The iid bounded entries, deterministic positive semidefinite Tn, aspect-ratio limit, and fixed z∈C+ in the Statement.

[F1]

Independent centered complex coordinates with unit second absolute moment satisfy the stated second-moment quadratic-form bound, also conditionally when the coefficient matrix is independent (Fourth-moment bound for a centered complex quadratic form).

[F2]

Adding one positive rank-one matrix has the Sherman–Morrison resolvent formula and trace-norm bound (Hermitian rank-one resolvent update and trace-norm bound).

[F3]

For bounded iid entries, each deterministic unit-vector resolvent quadratic form differs from its expectation with fourth-tail bound C/(t4Nn2) (Adapted concentration of bounded complex resolvent quadratic forms).

[F4]

Hermitian positive semidefinite matrices have nonnegative eigenvalues and an orthonormal eigenbasis (Complex spectral theorem: a normal endomorphism of a finite-dimensional complex inner product space has an orthonormal eigenbasis, and conversely).

[F5]

The Stieltjes transform of a probability measure uses the (t−z)−1 convention in the upper half-plane (Stieltjes transform of a probability measure on the real line).

[F6]

The operator norm is the maximum of ∥Av∥2 over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).

Proof

1.1givenF4F5F6algebra

Fix n,z, suppress the index n, write N=Nn, sj=T1/2X⋅j/N, R=(A−zI)−1, Rj=(A−sjsj∗−zI)−1, and βj=(1+sj∗Rjsj)−1. The companion matrix A~=N−1X∗TX is positive semidefinite by [F4], so q=N−1Etr⁡(A~−zI)−1 is the Stieltjes transform of an expected probability measure on [0,∞) by [F5] and has positive imaginary part. If q=∫(λ−z)−1 dG(λ), then for every t≥0, Im⁡{z(1+tq)}=η+t∫λη∣λ−z∣2 dG(λ)≥η, so C:=(I+qT)−1 exists and ∥C∥op≤∣z∣/η. The same spectral calculation applied to A−sjsj∗ gives ∣βj∣≤∣z∣/η.

2.1givenF1F4step 1.1algebra

Set bj=(1+N−1tr⁡(TRj))−1 and ξj=sj∗Rjsj−N−1tr⁡(TRj). The trace in bj is a Stieltjes transform with nonnegative weights: in an eigenbasis of A−sjsj∗ its weights are ⟨vk,Tvk⟩/N≥0. The inequality in step 1.1 therefore also gives ∣bj∣≤∣z∣/η. Conditional on all columns except j, [F1] and ∥T1/2RjT1/2∥F2≤nM2/η2 give Ej∣ξj∣2≤C1n/N2=O(N−1), where Ej integrates column j. For any deterministic unit x, set αj=x∗Csjsj∗Rjx−N−1x∗CTRjx. This is a centered quadratic form in column j. Its coefficient matrix is N−1(T1/2Rjx)(x∗CT1/2), so it has rank at most one and Frobenius norm at most M∥C∥op/(Nη). Thus [F1] gives Ej∣αj∣2=O(N−2). Also Ejαj=0 and βj−bj=−βjbjξj.

2.2givenF4step 1.1algebra

For all sufficiently large n we have N=Nn≥2. Put Y=[s2 ⋯ sN], D=Y∗Y−zIN−1, and C−=YY∗−zIn=A−s1s1∗−zIn. The matrix A~−zI has block form (s1∗s1−zs1∗YY∗s1D). For a block matrix (ab∗bD) with invertible D, solving its product with (u,v)T=(1,0)T gives v=−D−1bu and (a−b∗D−1b)u=1. Hence its inverse's upper-left entry is (a−b∗D−1b)−1. Here (C−)Y=YD, so (C−)(I−YD−1Y∗)=C−−YY∗=−zI and I−YD−1Y∗=−zC−−1=−zR1. The Schur complement is therefore s1∗(I−YD−1Y∗)s1−z=−z(1+s1∗R1s1), proving (R~)11=−β1/z.

3.1givenF2F4step 1.1step 2.2algebra

By exchangeability of the columns and step 2.2, zq=−N−1∑j=1NEβj. The identity R−1=∑jsjsj∗−zI gives ∑jsjsj∗R=I+zR. The rank-one formula [F2] gives sjsj∗R=βjsjsj∗Rj. Substituting these identities and the formula for zq yields ER+1zC=1z∑j=1NE[βj(Csjsj∗Rj−N−1CT ER)]. Testing against x and adding then subtracting N−1x∗CTRjx and N−1x∗CTRx decomposes the right side into three terms δ1+δ2+δ3.

4.1givenF1step 2.1step 3.1algebra

For the first term, δ1=(N/z)E(β1α1). Since b1 is independent of column 1 and E1α1=0, we have E(b1α1)=0. Therefore step 2.1, Cauchy–Schwarz, and the uniform bounds on β1,b1 imply ∣δ1∣≤C2N(E∣ξ1∣2)1/2(E∣α1∣2)1/2=O(N−1/2).

4.2givenF1F2step 2.1step 3.1algebra

For the second term, R1−R=β1R1s1s1∗R1. Conditional second moments of the two linear forms x∗CTR1s1 and s1∗R1x are each O(N−1), uniformly in the other columns. Cauchy–Schwarz and boundedness of β1 yield ∣δ2∣=O(N−1).

4.3givenF3step 1.1step 3.1algebra

The third term is δ3=z−1E[β1x∗CT(R−ER)x]. For any deterministic sequence of unit vectors x=xn, put u=(CT)∗x and v=x; their norms are uniformly bounded by step 1.1. For Q(w)=w∗(R−ER)w, direct expansion gives Bn:=u∗(R−ER)v=14{Q(u+v)−Q(u−v)−iQ(u+iv)+iQ(u−iv)}. Rescale each nonzero vector to unit length; zero vectors contribute zero. For each fixed t>0, [F3] and the union bound imply P(∣Bn∣>t)→0. Also ∣Bn∣≤2∥u∥∥v∥/η≤L for a fixed finite L. Thus E∣Bn∣2≤t2+L2P(∣Bn∣>t), so first letting n→∞ and then t↓0 gives E∣Bn∣2→0. Boundedness of β1 and Cauchy–Schwarz yield δ3→0. This holds for every deterministic unit-vector sequence, hence uniformly over unit x: otherwise a sequence of deterministic directions with ∣δ3∣ bounded away from zero along a subsequence would contradict the conclusion just proved. No shrinking-threshold tail estimate is used.

5.1givenstep 3.1step 4.1step 4.2step 4.3algebra∎

The bounds in steps 4.1, 4.2, and 4.3 tend to zero uniformly over deterministic unit x. The tested resolvent identity in step 3.1 therefore proves the asserted supremum limit.

Source notes

Bai, Miao, and Pan, equations (2.2)–(2.9), printed pp. 12–15 (full paper PDF). The N-prefactor in their estimate (2.6) gives O(N−1/2) after the displayed moment bounds; the proof above retains that corrected vanishing order. Their (2.8) term is bounded here by adapted resolvent concentration and polarization.

TheoremStatement: AI-adaptedProof: AI-adaptedjudge pass (gpt-6-luna)Open item page →

General-population sample-covariance law for bounded entries

Statement

Assume the Axiom of Choice. On a common probability space, for each positive integer n, let Nn be a positive integer with Nn/n→κ∈(0,∞), let Xn∈Cn×Nn have entries from one common iid law with mean zero, second absolute moment one and absolute value bounded by one fixed finite constant, and let Tn be deterministic Hermitian positive semidefinite (self-adjoint with v∗Tnv≥0 for every v) with uniformly bounded induced Euclidean operator norm. Suppose the empirical eigenvalue measures Hn=n−1∑i=1nδλi(Tn) converge weakly to a Borel probability measure H on [0,∞). Put c=κ−1 and An=Nn−1Tn1/2XnXn∗Tn1/2, and let Fn=n−1∑i=1nδλi(An). Then there is a unique Borel probability measure Fc,H on [0,∞) such that, almost surely, Fn converges weakly to Fc,H. Its Stieltjes transform mc,H(z)=∫(t−z)−1 dFc,H(t) is the unique m∈C satisfying Im⁡m>0, u:=−(1−c)/z+cm with Im⁡u>0, and m=∫[0,∞)1t(1−c−czm)−z dH(t)(Im⁡z>0).

Statement references

Silverstein, Theorem 1.1 and its complete proof in Section 3 (full paper PDF).

Bai, Miao, and Pan, Section 2, including the sample-covariance resolvent conventions (full paper PDF).

Facts & Assumptions

Given: The common probability space, assumptions, matrices, and empirical measures in the Statement, including AC.

[A1]

The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).

[F1]

The normalized eigenvalue measure of the complex Hermitian sample-covariance matrix An is its empirical spectral distribution, defined as the rank-weighted finite spectral measure (Directional spectral measure of a Hermitian matrix).

[F2]

Iid entries are mutually independent and share one common distribution (Identical distribution and IID families).

[F3]

The Stieltjes transform convention is mμ(z)=∫(t−z)−1 dμ(t) for Im⁡z>0 (Stieltjes transform of a probability measure on the real line).

[F4]

Markov's inequality bounds the mass of {t>R} by the first moment divided by R (Markov's inequality for random variables).

[F5]

Tight families of Borel probabilities on a Polish space are relatively sequentially compact for weak convergence, under AC (Prokhorov tightness theorem on polish spaces).

[F6]

The bounded-entry resolvent has the deterministic equivalent −(z(I+qnTn))−1, uniformly on deterministic unit-vector quadratic forms (Deterministic equivalent for the bounded complex sample-covariance resolvent).

[F7]

The normalized resolvent trace concentrates almost surely about its expectation (Concentration of the normalized complex Hermitian resolvent trace).

[F8]

The deformed fixed-point equation has at most one solution satisfying the stated upper-half-plane conditions (Uniqueness of the deformed Marchenko–Pastur fixed point).

[F9]

Equal Stieltjes transforms determine probability measures on the real line (Stieltjes inversion and uniqueness for probability measures on the real line).

[F10]

The normalized operator norm of bounded complex iid matrices is almost surely eventually bounded (Operator-norm bound for bounded complex iid matrices).

[F11]

The nonzero eigenvalues of Y∗Y and YY∗ agree with multiplicity (Every linear map between finite-dimensional real or complex inner product spaces admits a singular value decomposition).

[F12]

A probability measure is a countably additive Borel measure of total mass one (Probability measures and probability spaces).

[F13]

Integrals of nonnegative increasing measurable sequences converge to the integral of their pointwise limit (Monotone convergence for the integral).

[F14]

The ordered eigenvalues of a Hermitian matrix vary continuously with the matrix in operator norm (Ordered eigenvalues of Hermitian matrices are operator-norm Lipschitz).

[F15]

A Polish space is a separable topological space whose topology is induced by a complete metric (Polish spaces are separable completely metrizable spaces).

[F16]

Weak convergence of Borel probabilities means convergence of integrals against all bounded continuous real-valued functions (Weak convergence of borel probability measures).

[F17]

The operator norm is the maximum of ∥Av∥2 over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).

Proof

1.1givenA1F1F2F4F5F12F13F14F15F17algebra

Write cn=n/Nn, let Fˉn(B)=EFn(B), and let Gˉn be defined similarly for A~n=Nn−1Xn∗TnXn. By [F14], each ordered eigenvalue is continuous in the matrix entries, so these setwise expectations are defined for Borel B. For disjoint Borel sets, countable additivity of the random ESDs followed by [F13] gives countable additivity of Fˉn and Gˉn; their total masses are one. Independence and unit second moment give ∫t dFˉn(t)=n−1tr⁡Tn and ∫t dGˉn(t)=Nn−1tr⁡Tn. Both first moments are uniformly bounded because cn→c>0 and ∥Tn∥op is uniformly bounded. By [F4], their tails above R are at most the corresponding first moment divided by R, so both expected-measure sequences are tight on [0,∞). The half-line is Polish: it is a closed subset of the complete real line and Q∩[0,∞) is dense. By [A1] and [F5], every subsequence of Fˉn has a further weakly convergent subsequence.

1.2givenF7

For each fixed z∈C+, [F7] gives ∫(t−z)−1dFn(t)−∫(t−z)−1dFˉn(t)→0 almost surely. Since all Xn are on the common probability space in the Statement, intersect these events over the countable dense set {a+ib:a,b∈Q, b>0}.

2.1givenF3F4F11F16step 1.1algebra

Fix z∈C+ and take any such subsequence with Fˉn⇒G. Let mG(z)=∫(t−z)−1dG(t) and qn(z)=∫(t−z)−1dGˉn(t). By [F11], the two sample-covariance matrices have the same nonzero eigenvalues, so their transforms satisfy exactly qn=−(1−cn)/z+cn∫(t−z)−1dFˉn(t). Hence qn→u:=−(1−c)/z+cmG(z). Moreover Im⁡mG(z)>0. The first moments of Gˉn are bounded, so at least half of each Gˉn lies in some fixed interval [0,L]; consequently Im⁡qn(z)≥η/(2(L+∣z∣)2) and Im⁡u>0.

3.1givenF3F6F8F9F16F17step 1.1step 2.1algebra

Apply [F6] to an orthonormal eigenbasis of Tn. Its uniform quadratic-form error implies ∫(t−z)−1 dFˉn(t)=−1zntr⁡(I+qnTn)−1+o(1)=−1z∫11+qnt dHn(t)+o(1). Since Hn⇒H, all Hn are supported in one compact interval, qn→u, and Im⁡u>0, the integrands converge uniformly on that interval to −1/[z(1+ut)]. Thus mG(z)=∫[−z(1+ut)]−1dH(t). The relation for u in step 2.1 gives −z(1+ut)=t(1−c−czmG(z))−z, so mG satisfies the fixed-point equation in the Statement. The argument applies to every z∈C+ and every weak subsequential limit G. By [F8], all such limits have the same transform; [F9] makes them equal. At least one such limit exists by step 1.1, so call it Fc,H. Tightness then implies Fˉn⇒Fc,H.

4.1givenA1F5F9F10F15F16step 1.1step 3.1step 1.2algebra∎

On the same event, [F10] gives ∥An∥op≤L1 eventually for a finite deterministic L1, so the random measures Fn are eventually supported on [0,L1] and are tight. The half-line is Polish by the metric facts in step 1.1 and [F15]. By [A1] and [F5], every subsequence has a weakly convergent further subsequence. For each dense-set z, its transform equals that of Fc,H by steps 3.1 and 1.2, since the real and imaginary parts of (t−z)−1 are bounded continuous and [F16] applies to each. For any probability law μ, its transform satisfies ∣mμ(z)−mμ(w)∣≤∣z−w∣/(Im⁡zIm⁡w), so equality on the dense set extends to all C+; [F9] identifies the subsequential limit as Fc,H. Every subsequence has the same further limit, and [F16] gives Fn⇒Fc,H almost surely.

Source notes

Silverstein, Theorem 1.1 and complete Section 3 proof (full paper PDF). The local proof makes the companion-transform relation and the uniqueness step explicit.

TheoremStatement: AI-adaptedProof: AI-adaptedOpen item page →

Directional deterministic equivalent for bounded sample-covariance entries

Statement

Assume the Axiom of Choice. On a common probability space, for each positive integer n, let Nn be a positive integer with Nn/n→κ∈(0,∞), let Xn∈Cn×Nn have entries from one common iid law with mean zero, second absolute moment one and absolute value bounded by a fixed finite constant, and let Tn be deterministic Hermitian positive semidefinite (self-adjoint with v∗Tnv≥0 for every v) with uniformly bounded induced Euclidean operator norm and empirical eigenvalue measures Hn=n−1∑iδλi(Tn)⇒H. Let xn∈Cn be deterministic unit vectors such that for every w∈C∖[0,∞), xn∗(Tn−wIn)−1xn⟶mH(w):=∫[0,∞)(t−w)−1 dH(t). For An=Nn−1Tn1/2XnXn∗Tn1/2, define the directional spectral measure μnxn(B)=xn∗1B(An)xn for Borel B⊆[0,∞). Then almost surely μnxn⇒Fc,H, where c=κ−1 and Fc,H is the probability measure characterized by mc,H(z)=∫[0,∞)1t(1−c−czmc,H(z))−z dH(t),Im⁡z>0.

Statement references

Bai, Miao, and Pan, Theorem 1 and complete Section 2 proof, printed pp. 8–16 (full paper PDF).

Silverstein, Theorem 1.1 and complete Section 3 proof (full paper PDF).

Facts & Assumptions

Given: The common probability space, hypotheses, matrices, and directional measures in the Statement, including AC.

[A1]

The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).

[F1]

For Hermitian An and unit xn, the directional spectral measure is ∑λ∥Pλxn∥22δλ (Directional spectral measure of a Hermitian matrix).

[F2]

This measure is a Borel probability because the spectral projections are orthogonal and sum to the identity (A Hermitian directional spectral measure is a probability law).

[F3]

The expected resolvent has deterministic equivalent −(z(I+qnTn))−1, uniformly for deterministic unit-vector quadratic forms (Deterministic equivalent for the bounded complex sample-covariance resolvent).

[F4]

The bounded-entry empirical spectral distribution converges almost surely to Fc,H with the stated fixed-point transform (General-population sample-covariance law for bounded entries).

[F5]

A bounded-entry directional resolvent quadratic form concentrates almost surely about its expectation (Adapted concentration of bounded complex resolvent quadratic forms).

[F6]

Dominated convergence passes limits through integrals under a common integrable bound (Dominated convergence).

[F7]

The normalized operator norm of bounded complex iid matrices is almost surely eventually bounded (Operator-norm bound for bounded complex iid matrices).

[F8]

Tight probability laws on a Polish space have weakly convergent subsequences under AC (Prokhorov tightness theorem on polish spaces).

[F9]

The Stieltjes transform uses (t−z)−1 and determines a probability measure uniquely (Stieltjes transform of a probability measure on the real line, Stieltjes inversion and uniqueness for probability measures on the real line).

[F10]

The nonzero eigenvalues of Y∗Y and YY∗ agree with multiplicity (Every linear map between finite-dimensional real or complex inner product spaces admits a singular value decomposition).

[F11]

A Polish space is a separable topological space whose topology is induced by a complete metric (Polish spaces are separable completely metrizable spaces).

[F12]

Weak convergence of Borel probabilities means convergence of integrals against every bounded continuous real-valued function (Weak convergence of borel probability measures).

[F13]

The operator norm is the maximum of ∥Av∥2 over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).

Proof

1.1givenF4F6F9F10algebra

Fix z∈C+ and let qn(z)=E[Nn−1tr⁡(Nn−1Xn∗TnXn−zI)−1]. By [F4], the empirical transforms of An converge almost surely to mc,H(z); their absolute values are at most 1/Im⁡z, so [F6] gives convergence of their expectations. By [F10], the nonzero eigenvalue equality for An and Nn−1Xn∗TnXn gives qn=−(1−cn)/z+cnE[n−1tr⁡(An−zI)−1], with cn=n/Nn. Hence qn(z)→u(z):=−(1−c)/z+cmc,H(z).

2.1givenF3F5F13step 1.1algebra

For deterministic unit xn, [F3] and [F5] yield xn∗(An−zI)−1xn+1zxn∗(I+qn(z)Tn)−1xn⟶0almost surely. The matrix inverses are uniformly bounded by ∣z∣/Im⁡z from the positive-measure resolvent estimate in the proof of [F3]. Since Tn are uniformly bounded and qn→u, the resolvent identity gives ∥(I+qnTn)−1−(I+uTn)−1∥op≤M(∣z∣/Im⁡z)2∣qn−u∣⟶0.

3.1givenF4step 1.1step 2.1algebra

Since u∈C+, w=−1/u also lies in C+ and (I+uTn)−1=u−1(Tn−wI)−1. The population-resolvent hypothesis at this fixed w therefore gives xn∗(I+uTn)−1xn→u−1mH(−1/u). By [F4], mc,H(z)=−z−1∫(1+ut)−1dH(t)=−[zu]−1mH(−1/u). Step 2.1 now proves xn∗(An−zI)−1xn→mc,H(z) almost surely for each fixed z∈C+.

4.1givenA1F1F2F7F8F9F11F12F13step 3.1algebra∎

The resolvent in step 3.1 is the Stieltjes transform of μnxn by [F1]. Intersect the probability-one events over a countable dense subset of C+. By [F7], on this event the spectra of An are eventually contained in one compact interval, so [F2] makes the directional measures a tight sequence of probabilities. The half-line is Polish: it is a closed subset of the complete real line with dense subset Q∩[0,∞), in the sense of [F11]. By [A1] and [F8], every subsequence has a weakly convergent further subsequence. Its transform agrees with mc,H on the dense set by step 3.1; continuity of Stieltjes transforms extends equality to all C+, and [F9] identifies that limit with Fc,H. Therefore every subsequence has the same further limit, which by the bounded-continuous-test definition [F12] proves μnxn⇒Fc,H almost surely.

Source notes

Bai, Miao, and Pan, Theorem 1, equations (1.1)–(1.5), and Section 2, equations (2.1)–(2.9), printed pp. 8–16 (full paper PDF).

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

A coarse complex sample-covariance norm bound from real edge bounds

Statement

Let (ξij)i,j≥1 be one infinite iid array of centered complex random variables with E∣ξ11∣2=τ2<∞ and E∣ξ11∣4<∞. For positive integers n, let Nn be positive with n/Nn→c∈(0,∞), and let Xn=(ξij)1≤i≤n, 1≤j≤Nn. Then almost surely lim sup⁡n→∞∥Xn∥opNn≤(σR+σI)(1+c),σR2=E(Re⁡ξ11)2,σI2=E(Im⁡ξ11)2. In particular, when τ2=1, the right side is at most 2(1+c).

Statement references

Yin, Bai, and Krishnaiah, Theorem 3.1, as reconstructed in the current real finite-fourth-moment upper-edge supplier (full paper PDF).

Bai, Miao, and Pan, Section 2, printed pp. 12–16 (full paper PDF).

Facts & Assumptions

Given: The common nested complex iid array and its centered finite-fourth-moment entry law.

[F1]

Iid entries are independent and share one common distribution (Identical distribution and IID families).

[F2]

For a real nested iid array with mean zero, variance one and finite fourth moment, lim sup⁡λmax⁡(ZnTZn/n)≤(1+γ)2 almost surely when the number of columns divided by the number of rows tends to γ>0 (Finite-fourth-moment upper bound for the largest sample-covariance eigenvalue).

[F4]

The operator norm is the maximum of ∥Av∥2 over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).

Proof

1.1givenF1F2F3algebra

Write κn=Nn/n→1/c, σR2=E(Re⁡ξ11)2, and σI2=E(Im⁡ξ11)2. Centering of ξ11 makes both real coordinates centered, and σR2+σI2=τ2. If σR>0, the matrices Zn=Re⁡Xn/σR are upper-left blocks of one real iid array with mean zero, variance one and finite fourth moment. Applying [F2] with γ=κ=1/c and then [F3] gives lim sup⁡n∥Re⁡Xn∥opNn≤σR1+κκ=σR(1+c)almost surely. If σR=0, the centered real part is zero almost surely, so the same bound holds. The identical argument for the imaginary part gives the bound with σI.

2.1givenF4step 1.1algebra∎

The complex operator norm satisfies ∥Xn∥op=∥Re⁡Xn+iIm⁡Xn∥op≤∥Re⁡Xn∥op+∥Im⁡Xn∥op. Intersecting the two probability-one events from step 1.1 proves the asserted limsup bound. Finally, σR+σI≤2(σR2+σI2)=2τ by Cauchy–Schwarz, giving the unit-variance consequence.

Source notes

The real edge application uses the current local upper-edge proof for the same top-left nested blocks, finite-fourth-moment law, dimension ratio and normalization. The complex-to-real reduction and triangle bound are proved above.

TheoremStatement: AI-adaptedProof: AI-adaptedOpen item page →

Sample-covariance resolvent deterministic equivalents

Statement

Assume the Axiom of Choice. Let (ξij)i,j≥1 be one infinite iid array of complex random variables with Eξ11=0, E∣ξ11∣2=1, and E∣ξ11∣4<∞. For each positive integer n, let Nn be positive with n/Nn→c∈(0,∞) and let Xn=(ξij)1≤i≤n, 1≤j≤Nn be its upper-left block. Let Tn be deterministic Hermitian positive semidefinite with uniformly bounded operator norm and empirical eigenvalue measures Hn=n−1∑iδλi(Tn)⇒H. Let xn∈Cn be deterministic unit vectors such that, for every w∈C∖[0,∞), xn∗(Tn−wIn)−1xn⟶mH(w):=∫[0,∞)(t−w)−1 dH(t). Define An=Nn−1Tn1/2XnXn∗Tn1/2 and μnxn(B)=xn∗1B(An)xn for Borel B⊆[0,∞). Then almost surely μnxn converges weakly to the probability measure Fc,H whose Stieltjes transform is the unique m∈C satisfying Im⁡m>0, u=−(1−c)/z+cm with Im⁡u>0, and m=∫[0,∞)1t(1−c−czm)−z dH(t),Im⁡z>0.

Statement references

Bai, Miao, and Pan, Theorem 1 and complete Section 2 proof, printed pp. 8–16 (full paper PDF).

Silverstein, Theorem 1.1 and complete Section 3 proof (full paper PDF).

Facts & Assumptions

Given: The common nested iid array, finite-fourth-moment law, deterministic population matrices and directions, aspect ratio, and AC in the Statement.

[A1]

The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).

[F1]

For bounded complex iid entries with the stated population and direction hypotheses, the directional measures converge almost surely to Fc,H (Directional deterministic equivalent for bounded sample-covariance entries).

[F2]

For a centered complex iid finite-fourth-moment array with E∣ξ11∣2=τ2, the same nested-block and aspect-ratio conventions give lim sup⁡∥Xn∥op/Nn≤(σR+σI)(1+c)≤2τ(1+c) almost surely, where σR2=E(Re⁡ξ11)2 and σI2=E(Im⁡ξ11)2; the bound includes τ=0 (A coarse complex sample-covariance norm bound from real edge bounds).

[F3]

A Hermitian directional spectral measure is a probability law (A Hermitian directional spectral measure is a probability law).

[F4]

Tight probability laws on a Polish space have weakly convergent subsequences under AC (Prokhorov tightness theorem on polish spaces).

[F5]

Equal Stieltjes transforms determine probability measures on the real line (Stieltjes inversion and uniqueness for probability measures on the real line).

[F6]

A Polish space is a separable topological space whose topology is induced by a complete metric (Polish spaces are separable completely metrizable spaces).

[F7]

Iid entries are mutually independent and share one common law (Identical distribution and IID families).

[F8]

The directional measure is ∑λ∥Pλxn∥22δλ for a deterministic unit vector (Directional spectral measure of a Hermitian matrix).

[F9]

The Stieltjes transform convention is mμ(z)=∫(t−z)−1dμ(t) on C+ (Stieltjes transform of a probability measure on the real line).

[F10]

Weak convergence means convergence of integrals against all bounded continuous real-valued functions (Weak convergence of borel probability measures).

[F11]

The operator norm is the maximum of ∥Av∥2 over unit vectors in the domain (The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||).

Proof

1.1givenF1F2F7algebra

Let ξ have the common entry law. For integer K, set ξ(K)=ξ1{∣ξ∣≤K}−E[ξ1{∣ξ∣≤K}], σK2=E∣ξ(K)∣2, and Δ(K)=ξ−ξ(K). Then σK→1, and τK2:=E∣Δ(K)∣2→0 because Eξ=0 and E∣ξ∣2<∞. For all sufficiently large K, σK>0; put ζ(K)=ξ(K)/σK. These entries are centered, bounded, iid and have unit second absolute moment, while Δ(K) is centered iid with finite fourth moment. At matrix level, Xn=σKZn(K)+Dn(K), where Zn(K) and Dn(K) are the common upper-left blocks formed from ζ(K) and Δ(K).

2.1givenF2F11step 1.1algebra

For each fixed sufficiently large integer K, the original, standardized, and residual arrays have second absolute moments 1, 1, and τK2, respectively. Applying the variance-scaled bound [F2] to each gives almost surely lim sup⁡n∥Xn∥Nn≤Cc,lim sup⁡n∥Zn(K)∥Nn≤Cc,lim sup⁡n∥Dn(K)∥Nn≤CcτK, where Cc=2(1+c). If τK=0, the centered residual entries are zero almost surely; countability of the double array gives Dn(K)=0 for every n on one probability-one event, so the residual bound still holds. Intersect these events over the countable set of such K. Writing An(K)=Nn−1Tn1/2Zn(K)Zn(K)∗Tn1/2, the identity UU∗−VV∗=(U−V)U∗+V(U−V)∗ yields lim sup⁡n∥An−σK2An(K)∥op≤MCc2(1+σK)τK,lim sup⁡n∥σK2An(K)−An(K)∥op≤MCc2∣σK2−1∣, where M=sup⁡n∥Tn∥op. For positive semidefinite B,C and z∈C+, the resolvent identity gives ∥(B−zI)−1−(C−zI)−1∥op≤∥B−C∥op/(Im⁡z)2.

3.1givenF1F9step 1.1step 2.1algebra

Fix z∈C+ and a deterministic unit direction sequence xn. For each such K, [F1] applied to Zn(K) gives xn∗(An(K)−zI)−1xn→mc,H(z) almost surely, with the transform convention [F9]. By step 2.1, lim sup⁡n∣xn∗(An−zI)−1xn−mc,H(z)∣≤MCc2(Im⁡z)2((1+σK)τK+∣σK2−1∣) on the probability-one event obtained by intersecting the events from step 2.1 with the almost-sure convergence event for this fixed truncation level. The right side tends to zero as K→∞, so the directional Stieltjes transforms converge almost surely at every fixed z∈C+. Intersecting over a countable dense set gives simultaneous convergence there.

4.1givenA1F2F3F4F5F6F8F10F11step 3.1algebra∎

By [F2], ∥An∥op≤M∥Xn∥op2/Nn is almost surely eventually bounded. Thus the directional laws are eventually supported on one compact interval; [F3] makes them probability measures and [F8] gives their exact spectral-measure meaning. They are therefore tight. The half-line is Polish: it is closed in the complete real line and has dense subset Q∩[0,∞), as required by [F6]. By [A1] and [F4], each subsequence has a weakly convergent further subsequence. Its transform equals mc,H on the dense set by step 3.1; continuity of Stieltjes transforms extends equality to C+, and [F5] identifies the subsequential limit as Fc,H. The bounded-continuous-test definition [F10] yields the stated weak convergence. Every subsequence has the same further limit, proving the asserted almost-sure limit.

Source notes

Bai, Miao, and Pan, Theorem 1 and Section 2, printed pp. 8–16 (full paper PDF). The sampling convention is the upper-left block of one iid double array. The truncation comparison uses the separately proved real-edge norm supplier; it does not assume weak convergence alone controls spectral edges.

CorollaryStatement: AI-adaptedProof: AI-generatedOpen item page →

Isotropic minimum-norm risk limits under a positive spectral gap

Statement

Assume the Axiom of Choice. Let (ξij)i,j≥1 be one infinite iid array of real random variables with mean zero, variance one and finite fourth moment. For each n, let pn be a positive integer with pn/n→γ∈(0,∞)∖{1} and let Xn=(ξij)1≤i≤n, 1≤j≤pn be the upper-left block. Let βn∈Rpn be deterministic with ∥βn∥2=r>0. Let εn∈Rn have independent centered components of variance σ2, independent of Xn (so its covariance is σ2In), and let z0,n∈Rpn be independent of (Xn,εn) with mean zero and covariance Ipn. Set yn=Xnβn+εn, β^n=Xn+yn, and Sn=XnTXn/n. Define the design-conditional prediction risk by Rn=Eεn,z0,n[(z0,nTβ^n−z0,nTβn)2∣Xn]. If γ<1, then almost surely Rn→σ2γ/(1−γ). If γ>1, then almost surely Rn→r2(1−1/γ)+σ2/(γ−1).

Statement references

Hastie, Montanari, Rosset, and Tibshirani, Theorem 1 and Appendix C.2 (full paper PDF).

Bai, Miao, and Pan, Theorem 1 (full paper PDF).

Facts & Assumptions

Given: The nested real iid design, deterministic signal, independent centered noise with covariance σ2In, and AC in the Statement.

[A1]

The Axiom of Choice permits a choice function for every family of nonempty sets (The Axiom of Choice).

[A2]

The noise vector is independent of the design, centered, and has covariance σ2In as stated.

[A3]

The test feature is independent of the design and noise, centered, and has covariance Ipn as stated.

[F1]

The Moore–Penrose inverse X+ is characterized by the four Penrose equations (The Moore--Penrose pseudoinverse A+ as the solution of the four Penrose equations).

[F2]

X+X and XX+ are orthogonal projections with ranges Ran⁡(X+) and Ran⁡(X), respectively (The Moore-Penrose products are orthogonal projectors).

[F3]

Positive covariance eigenvalues are squared positive singular values divided by the sample size, and their number is the matrix rank (Every linear map between finite-dimensional real or complex inner product spaces admits a singular value decomposition, The rank of a linear map is the number of its nonzero singular values).

[F4]

For the nested design, the smallest positive covariance eigenvalue has limit (1−γ)2 for γ<1 and (γ−1)2 for γ>1, with eventual full rectangular rank (Almost-sure limit and structural-zero count at the lower sample-covariance edge).

[F5]

The empirical spectral distribution of Sn converges almost surely to the Marchenko–Pastur law with aspect ratio γ (Almost-sure Marchenko–Pastur law for finite-fourth-moment sample covariance matrices).

[F6]

For upper-left d×Nd blocks indexed by their row dimension d, the directional theorem with identity population gives almost-sure weak convergence to Fγ,δ1 when d/Nd→γ (Sample-covariance resolvent deterministic equivalents). Repeated dimensions pn require the argument below.

[F7]

The Marchenko–Pastur probability law has an atom (1−1/γ)+ at zero, positive support [(1−γ)2,(1+γ)2], and transform satisfying 1+zm=m/(1+γm) (Marchenko–Pastur measure with aspect ratio gamma, The Marchenko–Pastur formula defines a probability law with the fixed-point transform).

[F8]

Weak convergence gives convergence of integrals against every bounded continuous test function (Weak convergence of borel probability measures).

[F9]

The deformed fixed-point solution is unique when both its transform and its companion transform have positive imaginary part (Uniqueness of the deformed Marchenko–Pastur fixed point).

[F10]

Dominated convergence passes limits through integrals under an integrable majorant (Dominated convergence).

[F11]

Iid entries are independent and share one common law (Identical distribution and IID families).

[F12]

The finite-column proof of bounded resolvent concentration, steps 1.1–4.1, bounds the fourth moment of each leave-one-column increment by C/N4 and that of the centered directional resolvent by C/N2, with constants independent of the unit direction and row dimension when the population is the identity (Adapted concentration of bounded complex resolvent quadratic forms).

[F13]

For a nested real iid unit-variance finite-fourth-moment array with pn/n→γ, almost surely lim sup⁡∥Xn∥op/n≤1+γ (Finite-fourth-moment upper bound for the largest sample-covariance eigenvalue, [F3]).

[F14]

Markov bounds a nonnegative random variable's tail by its expectation divided by the threshold; summable event probabilities imply only finitely many occurrences almost surely (Markov's inequality for random variables, First Borel-Cantelli lemma for events).

Proof

1.1givenA2A3F1F2F3algebra

Put Pker⁡Xn=Ipn−Xn+Xn. For any fixed v∈Rpn, Ez0,n(z0,nTv)2=vTE[z0,nz0,nT]v=∥v∥22, so the stated prediction risk equals Eεn[∥β^n−βn∥22∣Xn]. By [F2], Pn:=Xn+Xn is an orthogonal projection. The Penrose equation XnXn+Xn=Xn shows ker⁡(Pn)=ker⁡(Xn): if Xnv=0, then Pnv=0, and if Pnv=0, then Xnv=XnXn+Xnv=XnPnv=0. Hence Ran⁡(Pn)=ker⁡(Xn)⊥=Ran⁡(XnT) by the right-singular-vector basis in [F3], so β^n−βn=−Pker⁡Xnβn+Xn+εn. Conditional on Xn, the cross term has expectation zero because E[εn∣Xn]=0. Its noise contribution is Eεn∥Xn+εn∥22=σ2tr⁡(Xn+(Xn+)T)=σ2tr⁡((XnTXn)+)=σ2ntr⁡(Sn+), where the middle equality follows by writing an SVD and the last uses (aB)+=a−1B+ for a>0. With xn=βn/r, this proves the exact identity Rn=r2xnTPker⁡Xnxn+σ2ntr⁡(Sn+).

1.2givenA1F6F7F9F10F11algebra

First identify the isotropic limit. By [F7], νγ=(1−γ)δ0+γμγ is a nonnegative probability measure: when γ>1, the negative coefficient cancels exactly the zero atom of γμγ. Thus u=−(1−γ)/z+γmγ(z) is its Stieltjes transform and has positive imaginary part, as does mγ(z). The scalar equation in [F7] rearranges to mγ=(1−γ−z−γzmγ)−1; [F9] therefore identifies Fγ,δ1=μγ. For any deterministic unit directions xn and fixed z∈C+, we claim E[xnT(Sn−zI)−1xn]→mγ(z). Indeed, every subsequence has a further subsequence (nj) with strictly increasing pnj, since pn→∞. In the transposed infinite array, prescribe Nd=nj and direction xnj at d=pnj, and at all other dimensions prescribe Nd=max⁡(1,⌊d/γ⌋) and the first coordinate vector. Then d/Nd→γ, so [F6] applies to this completed sequence. The bound ∣(t−z)−1∣≤1/Im⁡z and [F10] give the claimed expectation limit along (nj). The subsequence criterion gives it along the original sequence. This argument also applies to each fixed standardized bounded truncation of the entry law.

2.1givenA1F4F5F7F8F10F11step 1.1algebra

Suppose γ<1 and set a=(1−γ)2>0. By [F4], Xn has full column rank eventually and every eigenvalue of Sn is at least a/2 eventually. Thus the bias term in step 1.1 is zero and pn−1tr⁡(Sn+)=∫f(t)dμn(t) for the bounded continuous function f(t)=1/max⁡(t,a/2). By [F5] and [F8], this converges to Jγ=∫t−1dμγ(t), since the Marchenko–Pastur support is bounded below by a. For s>0, define mγ(−s)=∫(t+s)−1dμγ(t). The integrands are bounded by 1/a and converge pointwise to 1/t, so [F10] gives mγ(−s)→Jγ as s↓0. The fixed-point equation in [F7], initially stated for z∈C+, extends to z=−s<0 by dominated convergence in its defining integral; its denominator stays nonzero because 1+γmγ(−s)>0. Taking s↓0 yields 1+(γ−1)Jγ=0, hence Jγ=1/(1−γ). Since pn/n→γ, step 1.1 gives Rn→σ2γ/(1−γ).

2.2givenF12F14step 1.2algebra

For such a bounded unit-variance truncation, let Zn be its n×pn block and Sn(K)=ZnTZn/n. Apply the finite-column argument [F12] to ZnT, which has n independent columns and identity population. More explicitly, each leave-one-column resolvent quadratic-form increment Uj has E∣Uj∣4≤CKn−4 by the bounded-entry eighth-moment linear-form estimate; its column-filtration difference Dj satisfies E∣Dj∣4≤16E∣Uj∣4. The fourth-moment recursion in [F12], aj≤aj−1+CKaj−1/n2+CK/n4, gives aj≤CK′j2/n4, and hence E∣xnT((Sn(K)−zI)−1−E(Sn(K)−zI)−1)xn∣4≤CK′/n2. These are finite-matrix estimates, with no indexing or distinctness assumption on pn. By [F14], their tails are summable in the original index n. Together with step 1.2 this proves xnT(Sn(K)−zI)−1xn→mγ(z) almost surely for each fixed K,z.

3.1givenF3F11F13step 2.2algebra

To remove boundedness, put ξ(K)=ξ1{∣ξ∣≤K}−E[ξ1{∣ξ∣≤K}], σK2=E∣ξ(K)∣2→1, and τK2=E∣ξ−ξ(K)∣2→0. For sufficiently large integers K, form Zn from ξ(K)/σK and write Xn=σKZn+Dn. The residual entries are centered with finite fourth moment and variance τK2. Applying [F13] to the original, standardized and variance-normalized residual arrays yields, with L=1+γ, almost surely lim sup⁡∥Xn∥/n≤L, lim sup⁡∥Zn∥/n≤L, and lim sup⁡∥Dn∥/n≤LτK. If τK=0, countability of the array makes every residual entry zero almost surely. The Gram-matrix identity then gives lim sup⁡∥Sn−Sn(K)∥≤L2((1+σK)τK+∣σK2−1∣). For η=Im⁡z>0, the resolvent identity bounds the difference of their directional transforms by η−2∥Sn−Sn(K)∥. Intersect the probability-one events over integers K and let K→∞ in step 2.2 to obtain xnT(Sn−zI)−1xn→mγ(z) almost surely.

4.1givenF3F4F5F7F8F10step 1.1step 3.1algebra∎

Suppose γ>1 and set a=(γ−1)2>0. By [F4], Xn has full row rank eventually, Sn has exactly pn−n zero eigenvalues, and all positive eigenvalues are at least a/2 eventually. For each rational s>0, the spectral identity bounds the difference between the directional transforms at −s and −s+iη by η/s2, both for Sn and for μγ. Use step 3.1 at −s+i/k for all positive integers k, then let k→∞, to obtain xnT(Sn+sI)−1xn→mγ(−s) on one probability-one event for all rational s>0. The gap gives 0≤sxnT(Sn+sI)−1xn−xnTPker⁡Xnxn≤2s/a eventually. Since smγ(−s)→μγ({0})=1−1/γ by [F7] and [F10], letting rational s↓0 proves the required bias limit. Define h(0)=0 and, for t>0, h(t)=t−1min⁡(1,max⁡(0,4t/a−1)). This is bounded and continuous, equals zero at zero, and equals 1/t for t≥a/2. Therefore pn−1tr⁡(Sn+)=∫h(t)dμn(t)→Jγ+:=∫(0,∞)t−1dμγ(t) by [F5] and [F8]. [F7] gives mγ(−s)=(1−1/γ)/s+Jγ++o(1) as s↓0: subtract the zero atom and use [F10] by dominated convergence on the positive support, whose lower endpoint is a>0. To compute the constant term, write α=1−1/γ and substitute m=α/s+Jγ++o(1) into 1+(γ−1−s)m−γsm2=0, the fixed-point equation at z=−s (again obtained by dominated convergence from [F7]). The coefficient of s−1 vanishes because γα=γ−1; the constant term is 1−α−(γ−1)Jγ++o(1). It must vanish, so Jγ+=1/[γ(γ−1)]. Using pn/n→γ in step 1.1 proves Rn→r2(1−1/γ)+σ2/(γ−1).

Source notes

Hastie, Montanari, Rosset, and Tibshirani, Theorem 1 and Appendix C.2 (full paper PDF). The repeated-dimension argument in steps 1.2, 2.2, and 3.1 uses injective row dimensions only for expectation limits; almost-sure concentration is summed in the original sample index. It follows the truncation and martingale structure of Bai, Miao, and Pan, Section 2, without changing the row-indexed supplier interface. The proof above separates the conditional noise expectation from the design almost-sure limits and uses a positive-edge cutoff rather than a z↓0 interchange.

CorollaryStatement: AI-adaptedProof: AI-generatedjudge pass (gpt-6-luna)Open item page →

Fixed negative-axis directional resolvent integrals converge

Statement

Under the hypotheses of the sample-covariance resolvent deterministic-equivalent theorem, for each fixed s>0 the directional measures satisfy ∫[0,∞)1t+s dμnxn(t)⟶∫[0,∞)1t+s dFc,H(t)almost surely.

Statement references

Bai, Miao, and Pan, Theorem 1, printed pp. 8–9 (full paper PDF).

Facts & Assumptions

Given: The hypotheses and directional measures in the Statement.

[F1]

The directional measures converge almost surely weakly to Fc,H (Sample-covariance resolvent deterministic equivalents).

[F2]

Weak convergence means convergence of integrals against every bounded continuous real-valued function (Weak convergence of borel probability measures).

[F3]

The directional spectral measure is ∑λ∥Pλxn∥22δλ for a deterministic unit vector (Directional spectral measure of a Hermitian matrix).

Proof

1.1givenF3algebra

Fix s>0. The function fs(t)=(t+s)−1 is continuous on [0,∞) and satisfies 0<fs(t)≤1/s, so it is bounded. The measure is the directional spectral law in [F3].

2.1givenF1F2step 1.1∎

On the probability-one event in [F1], apply the defining bounded-continuous-test property [F2] to fs to obtain the asserted integral convergence.

Source notes

The proof is the direct bounded-continuous-test consequence of the preceding directional weak-convergence theorem.

4 · Examples, counterexamples and false statements

None yet.

Sources