How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
A damped Newton step precedes the local quadratic phase
Example
The strongly convex objective makes a Newton step from increase the objective, while its half-step passes Armijo. With a small positive decrement tolerance, the global-to-local theorem then ensures a finite damped phase followed by unit Newton steps whenever the decrement test continues to permit updates.
Facts & Assumptions
Given: on , , Armijo parameter , shrink factor , and decrement tolerance .
Damped Newton reaches its local quadratic phase in finitely many continued updates: with global bounds , local radius , and , the method reaches the local ball in finitely many updates; later attempted steps are unit and quadratic.
Damped Newton method: the method computes and , stops before line search when , and otherwise starts backtracking at .
Newton's method has local quadratic convergence under a Lipschitz Hessian: with a positive-definite critical Hessian and a Lipschitz Hessian on a ball, there are local constants such that every generated iterate stays in the ball and every attempted Newton update not stopped by the decrement test accepts a unit step with a quadratic error bound.
The mean value theorem, as the case of Cauchy's: for continuous on with and differentiable on there is with : a differentiable scalar function whose derivative is bounded in absolute value by on an interval is -Lipschitz there.
Heine-Borel in : with the Euclidean metric a subset of is compact if and only if it is closed and bounded, and the proof by bisection uses no choice principle; the same holds on the real line: a closed and bounded subset of the real line is compact.
The Jacobian matrix of partial derivatives and the gradient in the scalar-valued case and The Hessian matrix and critical points of a scalar field: the gradient is the first derivative and the Hessian is the second derivative in the one-dimensional coordinate.
Multivariable Taylor formula with a Lagrange remainder along a line segment: on a segment in an open convex domain, the second-order Taylor remainder is one half the Hessian at an interior point times the squared step.
Verification
Differentiation gives , , and . Thus , has the sign of , and is the unique minimizer. Also , since ; [F4] makes globally -Lipschitz. The initial sublevel set is closed by continuity and bounded because , hence compact by [F5].
At , , , and the Newton direction is . Its decrement is , since gives ; hence the positive tolerance test does not stop before the first line search.
Step 1.1 gives , , and a -Lipschitz Hessian on , so [F3] applies there; we directly verify the local radius and constant . For , and , so the Newton direction satisfies . Every point between and therefore satisfies . Since and , we have . Taylor's formula [F7] and now give , so the full step passes Armijo. Also , hence because , and since . Thus and this give a directly verified invariant local ball and quadratic bound whenever the decrement test permits an update.
The full-step point is , whose absolute value exceeds because gives . The objective is even and strictly increasing as a function of , so ; its Armijo threshold is smaller than , and the unit step fails.
The half-step point is , where : indeed implies . Thus , using and so , while because . The objective drop exceeds . The half-step Armijo decrease required is , where because , so . Hence passes, and it is accepted after the failed unit trial.
Choose , which contains every trial segment and . By step 1.1 the global Hessian bounds are , , and the decrement threshold in [F1] is . The chosen is smaller, since gives , so the decrement test cannot stop outside . The first accepted step was the damped half-step in step 2.3; [F1] now gives finite entry into the local ball, followed by unit quadratic updates whenever the decrement test does not stop.
Depends on
- Damped Newton method
- The mean value theorem, as the case $g(x) = x$ of Cauchy's: for $f$ continuous on $[a,b]$ with $a < b$ and differentiable on $(a,b)$ there is $c \in (a,b)$ with $f(b) - f(a) = f'(c)(b-a)$
- The Jacobian matrix of partial derivatives and the gradient in the scalar-valued case
- The Hessian matrix and critical points of a scalar field
- Multivariable Taylor formula with a Lagrange remainder along a line segment
- Damped Newton reaches its local quadratic phase in finitely many continued updates
- Heine-Borel in $\mathbb{R}^n$: with the Euclidean metric a subset of $\mathbb{R}^n$ is compact if and only if it is closed and bounded, and the proof by bisection uses no choice principle; the same holds on the real line
- Newton's method has local quadratic convergence under a Lipschitz Hessian
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
59 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.