How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
A gradient-descent path can be bounded below when the objective is not
Example
Let on , start gradient descent at , and use the fixed step . The gradient is and is globally -Lipschitz. The iterates are , so and , even though is unbounded below on . The limit is stationary but is neither a local minimum nor a local maximum.
Facts & Assumptions
Given: , , and fixed step .
The total (Fréchet) derivative as the linear first-order approximation with remainder: a derivative is a linear map whose remainder is at most for all sufficiently small increments, for every .
Directional derivatives and partial derivatives of a map : a coordinate partial derivative is the limit of the difference quotient in that coordinate direction.
The Jacobian matrix of partial derivatives and the gradient in the scalar-valued case: for a scalar function, the gradient vector consists of its coordinate partial derivatives.
Gradient descent: in fixed-step mode the update is .
Gradient descent has vanishing gradients when the objective is bounded below along its iterates: a continuously differentiable objective on with globally -Lipschitz gradient for , fixed , and a lower bound along its iterates has gradient norms tending to zero along those iterates.
Verification
For and , expansion gives , whose absolute value is at most . For every , this is at most when , so [F1] gives the total derivative. The coordinate difference quotients are and , so [F2, F3] give . Therefore , so is continuously differentiable and its gradient is globally -Lipschitz.
By [F5] and the gradient formula in step 1.1, . Starting from , induction gives and for every .
Step 2.1 gives and by [F7], while is unbounded below as . The gradient at the limit is zero, but and for every , so the limit is neither a local minimum nor a local maximum. Finally and the iterates have lower bound , so [F6] applies and gives vanishing gradient norms along this path.
Depends on
- Gradient descent has vanishing gradients when the objective is bounded below along its iterates
- Gradient descent
- The total (Fréchet) derivative $Df(a)$ as the linear first-order approximation with $o(\|h\|_2)$ remainder
- Directional derivatives and partial derivatives of a map $U\subseteq\mathbb{R}^m\to\mathbb{R}^n$
- The Jacobian matrix of partial derivatives and the gradient in the scalar-valued case
- The Euclidean inner product $\langle x,y\rangle = \sum_{k<n} x_k y_k$ on $\mathbb{R}^n$
- For $|r| < 1$ the sequence $r^k$ is null, and for $|r| > 1$ the sequence $|r|^k$ diverges to $+\infty$
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
44 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.