How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
An indefinite Rosenbrock Hessian makes the raw Newton direction ascend
Example
For the Rosenbrock objective at , the Hessian is indefinite and the unshifted Newton correction is an ascent direction. With shift , the linear solve produces a descent direction, and the objective is bounded below on its ray; a strong Wolfe interval therefore exists. A finite search budget may still return failure before finding a step.
Use the deterministic Krylov procedure which, for a two-dimensional operator
and right-hand side , forms when .
If and are invertible, it returns
with iteration count ; otherwise it returns
no-candidate. On other input dimensions or budgets below two it returns
no-candidate. Its candidate lies in by construction.
Take , , , ,
, , and , with the shift parameters below.
Facts & Assumptions
Given: The objective and point in the Example, descent threshold , regularization seed , a regularization cap , and attempt budget .
The Jacobian matrix of partial derivatives and the gradient in the scalar-valued case: the gradient is the vector of first partial derivatives in Euclidean coordinates.
The Hessian matrix and critical points of a scalar field: the Hessian matrix consists of the second partial derivatives.
Finite-budget inexact Newton–Krylov with a descent safeguard: the first linear system is unshifted; a failed residual or descent check triggers a positive shift, and a regularized candidate is accepted only after recomputing its residual and checking descent.
A strong Wolfe step exists on a bounded-below descent ray: for a objective bounded below on an entire feasible descent ray, a strong Wolfe interval exists.
Verification
Given: The Rosenbrock objective, the point , , , , and .
Put . Differentiating gives and . At the given point, and . The quadratic form of is negative on and positive on , so is indefinite.
For and either or , , and both operators are invertible. Hence the specified projected solver returns the exact solution in , using . The unshifted Newton solve gives and . It is therefore not a descent direction and fails the algorithm's descent check.
For shift , and the exact shifted solve gives . Its residual is zero, while . Also and , hence and . Thus the shifted candidate passes the stated residual and descent tests.
The Rosenbrock objective is nonnegative on , and the shifted direction has . The entire ray is feasible because . Apply [F4] to conclude that a nonempty interval of strong Wolfe steps exists for this direction. This existence result does not guarantee that any specified finite expansion/zoom budget reaches the interval.
Depends on
- Finite-budget inexact Newton–Krylov with a descent safeguard
- A strong Wolfe step exists on a bounded-below descent ray
- Wolfe and strong Wolfe line-search conditions
- The Jacobian matrix of partial derivatives and the gradient in the scalar-valued case
- The Hessian matrix and critical points of a scalar field
- The Euclidean inner product $\langle x,y\rangle = \sum_{k<n} x_k y_k$ on $\mathbb{R}^n$
- The Krylov subspace $K_m(A,b)=\operatorname{span}\{b,Ab,\dots,A^{m-1}b\}$
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
33 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.