How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
The Cmax-only Wainwright lower signed-support threshold can predict failure when Lasso succeeds
Statement
Assume the Axiom of Choice. Wainwright's planned lower-threshold claim is the following: along a sequence of real Gaussian linear models with , , , , and independent observations where has rows , , design and noise are independent, there is no separate intercept, and has unit diagonal. Suppose constants , , , and satisfy with . Define For every fixed and every positive non-increasing sequence , if , then the probability that there exists an optimizer with for tends to zero.
Statement references
Facts & Assumptions
Given: The Gaussian model, covariance hypotheses, exact loss normalization, success event, and claimed lower implication in the Statement.
For an iid standard-Gaussian matrix of dimension , its Gram matrix divided by converges in operator norm to identity (Gaussian sample covariance converges in operator norm when dimension is little-o of sample size).
A sum of independent squared standard normals divided by converges in probability to one if and (A chi-square variable divided by a comparable dimension converges to one).
Under AC, a centered Gaussian vector with covariance can be realized as for a vector of independent standard normals (Multivariate normal law, including singular covariance).
A nondegenerate multivariate normal has its usual Gaussian density; in particular the density with identity covariance factors into independent standard-normal densities (A positive-definite multivariate normal law has its Gaussian density, Independent random elements have product joint law).
A standard normal has density (Standard normal and normal laws). Completing the square gives for ; applying Markov to with , and likewise to , yields when (Markov's inequality for random variables). For the probability is zero.
The Lasso objective is (Fixed-design least-squares, ridge, lasso, group, and fused objectives).
AC is assumed for the finite Gaussian constructions and suppliers (The Axiom of Choice).
Refutation
Fix , , , and . For integers tending to infinity set In each observation let the first active coordinates consist of independent pairs , , each with covariance and let the other active coordinates be independent standard normals, independent of these pairs. Take independent standard normals , independent also of all active variables, and define the inactive coordinates by Take independent observations and independent standard-normal noise ; set on and zero off . These finite Gaussian constructions define the model in the Statement, with and no intercept.
The eigenvalues of are and , and each row of has absolute sum . Thus and work. Each inactive coordinate regresses on its pair with coefficients , so . Its variance is one by the definition of , and . The full covariance, after reordering, is a direct sum of positive-definite three-dimensional covariance blocks and singleton identity blocks: each triple is an invertible linear image of because . Every triple has trace three, so every eigenvalue is at most three. Consequently bounds the maximum eigenvalue of the full covariance, and all its diagonal entries are one.
For these constants, so the precise claimed constant satisfies and . Since , the claimed failure inequality holds. Also and . The constant penalty is positive and non-increasing. The lower claim puts no restriction on .
Write , with an iid standard-Gaussian matrix, and put and . By [F1] and , with probability tending to one the minimum eigenvalue of is at least and . On this event define The shrinkage term satisfies . Conditional on , is centered Gaussian with covariance , so [F5] and a finite union bound give uniformly on the spectral event. Thus every active candidate coordinate is positive with probability tending to one.
Put and , so . To compute , put and choose a fixed orthogonal matrix with first column . Orthogonal invariance and [F4] make the rotated columns of , written , mutually independent standard-Gaussian columns. They have full column rank almost surely: condition successively on earlier columns; for each fixed proper column subspace, projection onto any fixed nonzero normal vector has a continuous normal law, so a new standard-Gaussian column belongs to that subspace with probability zero. For full-rank put Block elimination in the Gram matrix of gives exactly . For each fixed full-rank , the projector has rank , so orthogonal invariance gives the conditional law . This conditional law is the same for every such ; the projector is a measurable function of , and no random basis is selected. Since , [F2] gives in probability, and therefore in probability.
Let . The candidate residual is Its two displayed summands are orthogonal. For inactive column , the construction gives , where has entries on its pair and zero elsewhere, and the are mutually independent standard-Gaussian vectors independent of . Because , the dual variables are, conditional on , independent centered normals of common variance By [F2], in probability. Since the second term is at most , step 4.2 and show . This event depends only on and is independent of all inactive residual vectors.
On the event , since and , Applying [F5] and a finite union bound conditionally on yields the uniform bound Removing the conditioning and adding the probability of proves with probability tending to one. Intersecting with the event in step 4.1 preserves probability tending to one and gives both active sign correctness and inactive dual feasibility.
On this intersection put . It equals one on and satisfies off . Since the candidate is positive on and zero off , the scalar inequality holds for every coordinate and every real . For every , expand [F6], with , to obtain Thus this candidate is an optimizer with . Its existence has probability tending to one, whereas step 3.1 meets the exact hypotheses that predict probability tending to zero. This refutes the stated lower implication.
Source notes
This refutes the conclusion itself, independently of the erroneous inverse-block identity in the 2006 Appendix D.6. The construction uses , which the stated source and planned hypotheses permit; it does not refute a theorem with an additional dimensional restriction. The 2009 journal article's equation (27) defines , a minimum pairwise increment-variance parameter, not a least eigenvalue. Its revised threshold interface is distinct and is not substituted for the claim refuted here.
Depends on
- Fixed-design least-squares, ridge, lasso, group, and fused objectives
- Gaussian sample covariance converges in operator norm when dimension is little-o of sample size
- A chi-square variable divided by a comparable dimension converges to one
- Multivariate normal law, including singular covariance
- Standard normal and normal laws
- A positive-definite multivariate normal law has its Gaussian density
- Independent random elements have product joint law
- Markov's inequality for random variables
- The Axiom of Choice
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
46 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Wainwright, Sharp Thresholds for High-Dimensional and Noisy Recovery of Sparsity, 2006, Theorem 1(a), §3.1, §3.4, and Appendix D.6 (standard reference, not scraped)
- Wainwright, Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using L1-Constrained Quadratic Programming (Lasso), 2009, §IV.A (standard reference, not scraped)