How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
An NTK eigenmode decays exponentially under least squares
Example
Assume AC. Fix , a depth , a bias scale , and a globally Lipschitz nonpolynomial activation . Use the source-normalized network with scalar output and independent standard-normal initialization, and let be pairwise distinct points of . Let be the limiting neural tangent Gram matrix on these inputs given by the sequential infinite-width theorem. Choose a unit eigenvector of with eigenvalue . For labels and , initialize the limiting empirical least-squares kernel flow by and solve
Then . The error stays entirely in this one kernel mode, and its Euclidean norm decays by the factor .
Example references
Jacot, Gabriel, and Hongler, §5, least-squares kernel eigenmodes
Distinct sphere inputs give strictly positive Gram eigenvalues
The deterministic limiting Gram matrix from the sequential width limit
Least-squares NTK flow decays mode by mode and fits distinct sphere data: Each residual eigenmode evolves by
Facts & Assumptions
Given: AC; the source-normalized scalar-output model; , , , a globally Lipschitz nonpolynomial activation; pairwise distinct unit-sphere inputs; a unit eigenvector of their sequential limiting Gram matrix with eigenvalue ; target vector ; and initial prediction with .
Distinct sphere inputs under the proposition's assumptions have a positive-definite limiting NTK Gram matrix (The limiting neural tangent kernel is strictly positive definite on every unit sphere).
Least-squares kernel flow multiplies an eigenmode residual by (Least-squares NTK flow decays mode by mode and fits distinct sphere data).
Verification
The initial residual is . Since is a unit eigenvector with eigenvalue , [F2] gives .
Taking norms and using yields , which tends to zero because . This is the single positive mode asserted in the Example.
Depends on
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
20 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Arthur Jacot, Franck Gabriel, and Clément Hongler, Neural Tangent Kernel: Convergence and Generalization in Neural Networks (standard reference, not scraped)