How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
The unrestricted Wainwright signed-support threshold claim fails without active-dimension control
Statement
Assume the Axiom of Choice, the Axiom of Dependent Choice, and countable choice. Wainwright's 2006 two-sided threshold claim is the following: consider a sequence of real Gaussian linear models with , , , , , and where observations are independent, design and noise are independent, there is no separate intercept, and has unit diagonal. Suppose constants , , , and satisfy where . Define Let have rows , , and . For , let success mean that there exists an optimizer with for the objective . The threshold claim is that for every fixed , success probability tends to zero if for every non-increasing positive , and tends to one if , , , and .
Statement references
Facts & Assumptions
Given: The model, covariance assumptions, loss normalization, threshold constants, and claimed two-sided conclusion in the Statement refuted.
If an optimizer has positive signs on its active coordinates and the active design has full column rank, its active coefficients equal (The active coordinates of a signed Lasso optimizer satisfy restricted normal equations).
For an iid standard-Gaussian matrix with dimension , its Gram matrix divided by converges in operator norm to the identity (Gaussian sample covariance converges in operator norm when dimension is little-o of sample size).
If , a sum of independent squared standard normals divided by converges in probability to one (A chi-square variable divided by a comparable dimension converges to one).
For finite centered Gaussian vectors, larger pairwise increment variances imply a larger expected maximum (Finite Sudakov–Fernique comparison for Gaussian maxima).
For sufficiently large , the expected maximum of independent standard normals is at least (The maximum of independent standard normals has expectation of order at least the square root of log dimension).
An -Lipschitz function of a standard Gaussian has upper-tail probability at most above its mean, under AC, DC, and countable choice (Lipschitz concentration for standard Gaussian measure).
Under AC, a multivariate normal with covariance is realized as for a standard Gaussian vector (Multivariate normal law, including singular covariance).
A nondegenerate multivariate normal has density proportional to (A positive-definite multivariate normal law has its Gaussian density).
Independent random elements have product joint law (Independent random elements have product joint law).
A standard normal has density (Standard normal and normal laws).
For nonnegative and , (Markov's inequality for random variables).
Product measures exist for sigma-finite probability factors and have the rectangle formula (For sigma-finite factors, the product measure exists, has the rectangle formula, is sigma-finite, and is unique).
AC is assumed for the finite Gaussian laws (The Axiom of Choice).
DC and countable choice are separately assumed for the Gaussian Lipschitz concentration result (The axiom of dependent choice: a relation in which every element is related to something admits an -indexed chain, The Axiom of Countable Choice ()).
Refutation
For integers , set , and for set . Since in the latter range and is increasing, this defines a positive non-increasing sequence. For , set , , , and . Use the model subsequence at sample sizes , with , , , and . Then , , and , while , , , and . For , eventually; also , , and , so the claimed upper hypotheses hold.
Let be the active design, , and . Choose an orthogonal with first column and write . Each row keeps its projection laws under ; [F7]–[F10] give its factorized standard-normal density and [F9] gives independent rows, so entries of are mutually independent standard normals. Set , when is invertible, and . Conditional on , is chi-square with degrees of freedom.
Since and , [F2] applied to and and [F3] applied conditionally to show that , , and each have probability tending to one. Their intersection therefore has probability tending to one.
On , . Given , is centered Gaussian with covariance , so each coordinate variance is at most . Completing the square in [F10] gives moment-generating function ; [F11] at yields . A union bound gives on , hence .
For fixed full-rank , the Gaussian coordinates of along and its orthogonal complement are independent by the factorized density [F8]–[F10]; hence is independent of , and has covariance . This conditional law is measurable because and are Borel on . Direct multiplication gives ; since , it follows that , where is conditionally centered Gaussian with covariance . On , and, for , .
Conditional on when holds, use [F12] to put the law of and an independent standard Gaussian vector on a product space, and set . By [F4], their increment variances, and [F5], .
The map is 1-Lipschitz. By [F7], represent conditionally and apply [F6] with Lipschitz constant and deviation half the mean bound in step 5.1; uniformly when holds, for some fixed . Hence with probability tending to one.
On , . Step 6.1 gives with probability tending to one, and . Since on this event, and step 1.1 gives , , and , it follows that in probability; the diverging term has order .
By steps 3.1, 4.1, and 7.1 and a union bound, with probability tending to one holds, , and . If an optimizer had the correct signed support, [F1] would force . At an index attaining the maximum, these events imply , contradicting the required positive sign. Thus exact signed-support success probability tends to zero, refuting the upper implication and the combined threshold statement.
Source notes
The counterexample uses . It isolates the missing active-coordinate fluctuation term in the claimed upper implication; it makes no prediction-risk claim and does not establish the separate lower-threshold branch.
Depends on
- Fixed-design least-squares, ridge, lasso, group, and fused objectives
- Gaussian sample covariance converges in operator norm when dimension is little-o of sample size
- A chi-square variable divided by a comparable dimension converges to one
- Finite Sudakov–Fernique comparison for Gaussian maxima
- The maximum of independent standard normals has expectation of order at least the square root of log dimension
- The active coordinates of a signed Lasso optimizer satisfy restricted normal equations
- Multivariate normal law, including singular covariance
- Standard normal and normal laws
- A positive-definite multivariate normal law has its Gaussian density
- Independent random elements have product joint law
- For sigma-finite factors, the product measure exists, has the rectangle formula, is sigma-finite, and is unique
- Lipschitz concentration for standard Gaussian measure
- The Axiom of Choice
- The axiom of dependent choice: a relation in which every element is related to something admits an $\mathbb{N}$-indexed chain
- The Axiom of Countable Choice ($\mathrm{AC}_\omega$)
- Markov's inequality for random variables
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
75 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Wainwright, Sharp Thresholds for High-Dimensional and Noisy Recovery of Sparsity, 2006, Theorem 1 and §§3.1, 3.3–3.4 (standard reference, not scraped)
- Philippe Rigollet and Jan-Christian Hütter, High-Dimensional Statistics: Lecture Notes, §§1.1, 1.4, 2.2–2.4 (standard reference, not scraped)