How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Subgradient bundle and derivative free optimization — Examples
1 · Prerequisites
- Binary Operations, Monoids, Groups and Subgroups
- Compactness in Metric Spaces
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Convex and Semicontinuous Functions on Rⁿ
- Countability and Uncountability
- Foundations of the Real Numbers for Analysis
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Metric Spaces
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Order, Zorn's Lemma, and the Axiom of Choice
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Sequences and Limits
- Subgradient bundle and derivative free optimization
- Suprema and Infima
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
Examples
These examples calculate a null step followed by a serious step for the max-affine kink , run direct search on a black-box quadratic using only function values, and exhibit Nelder–Mead meeting both finite tolerances on a flat plateau that is not globally minimizing. Their exact updates and evaluation counts distinguish what a finite run reports from stationarity or global-optimality guarantees.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
Nelder–Mead can stop on a nonminimizing flat plateau
Example
Define the continuous objective on by for , for , and for . Run Finite-budget Nelder–Mead simplex procedure from the one-dimensional simplex with diameter tolerance , spread tolerance , and call budget . It returns tolerance-met after four shrink updates, with simplex , returned best point , and objective spread , although the global minimum is on .
Facts & Assumptions
Given: Exact branch comparisons, tie rules, shrink rule, tolerance test, and call accounting Finite-budget Nelder–Mead simplex procedure.
The stated piecewise formula defines on all of ; its pieces agree at and .
The algorithm keeps the lower-slot vertex on objective ties, uses strict inside-contraction acceptance, and shrinks toward the best vertex (Finite-budget Nelder–Mead simplex procedure).
Verification
The two initial values at are both ; the slot tie rule makes best and worst. At a simplex with , reflection is , with value . Since the reflected value ties the worst value, the inside-contraction branch applies; its point is and also has value , so strict inside-contraction acceptance fails and shrink produces .
Starting at , four repetitions give and the spread remains . Initial evaluations use two calls and each iteration uses reflection, inside contraction, and a fresh shrink evaluation, so the total is calls. All evaluated points lie in , where the objective is flat; meanwhile everywhere and equals for . Thus the prescribed finite tolerance is met at a non-global minimizer.
A black-box quadratic simulator fit using direct search
Example
Treat the simulator response as a black-box evaluation, with no derivative supplied. Run Finite-budget deterministic direct search with positive-spanning polling from using ordered polls , , cap , forcing , increase factor , decrease factor , and poll budget . The successive centers are ; the third poll reaches the exact simulator fit , and the finite run returns status budget-exhausted.
Facts & Assumptions
Given: Positive-spanning direct-search polling and forcing rule Finite-budget deterministic direct search with positive-spanning polling.
In one dimension is positive spanning; the acceptance test compares only function values and the stated forcing threshold (Finite-budget deterministic direct search with positive-spanning polling).
Verification
At center , and the first poll point has , so the first poll succeeds at and the mesh grows to .
At center with mesh , the ordered trials have values , neither below ; the second poll is unsuccessful and halves the mesh to . At center with mesh , the first trial has value , so the third poll succeeds at . The budget is now exhausted; the observed exact minimizer is returned without a derivative-based certificate.
A max-affine kink produces one null and one serious bundle step
Example
Run two trials of Finite-memory-free proximal bundle method with serious and null steps on over , with , , and initial center . At choose subgradient ; at the first trial point choose subgradient ; at choose subgradient . The first trial is null and the second is serious, with exact trial points and respectively.
Facts & Assumptions
Given: The serious/null algorithm and subgradient definition Finite-memory-free proximal bundle method with serious and null steps, Subgradients and the subdifferential of a convex function.
For , , because each affine branch is bounded by the right side; hence is convex.
For every , , , and , so the chosen slopes support at respectively (Subgradients and the subdifferential of a convex function).
The finite maximum-affine model plus its positive quadratic has a unique minimizer (The proximal bundle model subproblem has a unique minimizer).
Verification
The initial cut is . The model objective is , so its unique minimizer is . Then , , and actual decrease is . Thus this is a null step and the cut at is .
The new model is . For , , with equality only at . For , its difference from is because both factors are nonpositive, with equality only at . Thus its unique minimizer is , and , while actual decrease is . The second step is serious and sets the center to .
Sources
- Tamara G. Kolda, Robert Michael Lewis, and Virginia Torczon, Optimization by Direct Search, Nelder–Mead discussion
- K. I. M. McKinnon, Convergence of the Nelder–Mead Simplex Method to a Nonstationary Point, §§2–3
- A. R. Conn, K. Scheinberg, and L. N. Vicente, Introduction to Derivative-Free Optimization, §§2.1–2.2 and ch. 8
- Tamara G. Kolda, Robert Michael Lewis, and Virginia Torczon, Optimization by Direct Search, §§3.1–3.6
- Mateo Díaz and Benjamin Grimmer, Optimal Convergence Rates for the Proximal Bundle Method, §§2–3
- Dominikus Noll, Olivier Prot, and Aude Rondepierre, A proximity control algorithm to minimize nonsmooth and nonconvex functions, §§2–4