How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Direct transcription and numerical ode optimal control
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Absolute Continuity and the Sharp Fundamental Theorem of Calculus
- Adaptive ODE solvers and error estimation
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Approximation and Compactness in C(K)
- Areas of Elementary Plane Figures
- Automatic differentiation and computational graphs
- Banach Alaoglu Goldstine and Krein Milman
- Banach-Space Differential Calculus and Banach Manifolds
- Barrier and primal dual interior point methods
- Binary Operations, Monoids, Groups and Subgroups
- Bounded Linear Operators and Quotient Spaces
- Bounded Variation and the Riemann–Stieltjes Integral
- Compact Operators and Riesz Schauder Theory
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Complex Norms and Realification
- Complex Subspace Realification
- Complexification, Realification and Real Structures
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Connectedness
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Convergence: Nets and Filters
- Convex and Semicontinuous Functions on Rⁿ
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Cyclic Groups and Direct Products
- Darboux, L'Hôpital, and Taylor's Theorem
- Density Separability and Convolution in Lᵖ
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Differentiation of Monotone Functions and the Vitali Covering Theorem
- Direct Matrix Factorisations: LU, Cholesky and QR
- Discrete continuous and pde adjoint sensitivities
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Dual Spaces Adjoint Operators and Annihilators
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- Euclidean Ordinary Differential Equations with Smooth Dependence
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Dimensional Normed Spaces and Riesz Lemma
- Finite Probability and the Probabilistic Method
- Finite-precision direct factorizations and least squares
- Foundations of the Real Numbers for Analysis
- Fubini and Change of Variables
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- Geometric Hahn Banach and Convex Separation
- Global ODE and Log-density Integration Error
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Hausdorff via the Diagonal
- Hilbert Space Geometry and Riesz Representation
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Inequality KKT duality and optimality certificates
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Lebesgue Measure on Euclidean Space
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Matrix Differentiation and First-order Spectral Perturbation
- Matrix Norms, Condition Numbers and Numerical Stability
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Monadicity and Beck's Theorem
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Nonconvex line search and inexact newton methods
- Nonlinear Boundary-Value Solvers
- Nonlinear equations and Newton methods
- Normal Subgroups and Quotient Groups
- Normed and Banach Spaces
- Norming and Separation under Hahn–Banach
- One-step ODE Consistency and Local Error
- Order, Zorn's Lemma, and the Axiom of Choice
- Orthonormal Bases, Parseval and Fourier Series
- Outer Measure and the Caratheodory Extension Theorem
- Picard-Lindelöf and First-Order Ordinary Differential Equations
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Reflexivity and Eberlein Smulian
- Relations, Functions, and Quotients
- Response surfaces and optimal design
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Runge–Kutta Methods and Order
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Splitting Fields
- Sqp active set and augmented lagrangian methods
- Subspaces, Products, and Quotients
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Analytic Hahn Banach Theorem
- The Baire Principles of Functional Analysis
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Direct Method and Euler--Lagrange Equations
- The Exponential Function
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Fundamental Theorems of Calculus
- The Galois Correspondence
- The Gauge Integral and Cousin's Lemma
- The Inverse and Implicit Function Theorems
- The Inverse Function Theorem Completed
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Maximal Function and Lebesgue Differentiation
- The Moore--Penrose Pseudoinverse and Regularised Least Squares
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak and Weak Star Topologies
2 · Summary
This page separates a measurable-control existence model from the pointwise smooth-data branch required to evaluate Runge–Kutta stages. It proves the bounded linear state map; under their stated Countable Choice hypotheses, it proves weak closedness of compact convex actuator bounds, weak-to-uniform state convergence, and strong recovery by cell averages. The LQR branch gives existence and uniqueness using the stated ultrafilter lemma, Dependent Choice, and Hahn–Banach assumptions, then derives the continuous adjoint, reduced gradient, and feasible-set variational inequality under their explicit choice hypotheses. The pointwise Hamiltonian condition is shown only for control-only constraints; a terminal-state example refutes the broader claim.
The transcription procedures cover single and multiple shooting, explicit stages, and implicit collocation with coupled stage residuals solved internally and their nonlinear-solve statuses returned. Declared path-constraint times are inserted as mesh nodes; sampled constraints do not certify continuous-path feasibility. Every equivalence-class datum used at a stage or quadrature time needs a chosen pointwise representative and sampling rule. Exact single/multiple shooting equivalence is finite-dimensional, and convex quadratic transcriptions reduce to QPs when sampled weights and constraints meet the stated assumptions. Mesh convergence is conditional on uniform objective consistency and feasible recovery. Strong convexity converts uniform state/quadrature and comparison-recovery bounds into an objective and control rate; an embedded RK difference alone is not a global error certificate.
The finite dispatcher reports decision variables, defects, constraints, KKT residuals, objective, and separate NLP, stage, IVP, quadrature, mesh, and budget statuses. Exact-Hessian SQP convergence is local for a fixed transcription under LICQ, strict complementarity, SOSC, and smoothness. A mesh-family KKT limit is also proved conditionally from residual consistency, uniformly bounded discrete KKT sensitivities, and reconstruction into common normed spaces; finite solver budgets may stop before convergence.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Finite-horizon bounded-control linear-quadratic ODE problem
Definition
Fix a finite horizon , state and control dimensions , and the real quotient space of measurable controls modulo equality almost everywhere (The space as the quotient by null functions). Let and be equivalence classes, let , and let . Let be nonempty, compact and convex. The pointwise control set is
Let and be symmetric almost everywhere, with and almost everywhere for constants . Let be symmetric positive semidefinite. For each , its state is the unique continuous solution of the Volterra equation
The same state equation is defined for every , and the running and terminal cost on that ambient space is
The constrained problem minimizes this ambient functional over , where additional path or terminal constraints are represented by a nonempty convex weakly sequentially closed set ; with no additional state constraints, . “Weakly sequentially closed” means that every weakly convergent sequence in has its weak limit in (Weak convergence of nets and sequences). The definition asserts no optimizer or adjoint existence; the state-map well-definedness is supplied by The bounded measurable linear ODE has a unique affine state map ↗.
Finite-horizon ODE optimal-control transcription data
Definition
For pointwise numerical transcription on , the data consist of integers , open sets and , a nonempty compact convex control set , an initial state , a pointwise-defined vector field , a pointwise-defined running cost , and a terminal cost . The admissible state solves almost everywhere and the continuous objective is . Optional path and endpoint constraints are pointwise-defined functions evaluated at declared continuous times or transcription nodes. A compact tube is a compact subset of containing the state/control triples used by stages and trajectories. On such a tube, and any constraint functions used in a local NLP theorem are continuous and have continuous state/control derivatives through order three (the convention of Euclidean maps and diffeomorphisms), with those derivatives bounded. An equivalence class alone has no specified value at a Runge–Kutta stage time, so it is not an admissible stage-evaluation input without an additional pointwise representative and sampling rule. This definition makes no existence, convergence, or continuous-path-feasibility claim.
The bounded measurable linear ODE has a unique affine state map
Statement
Let , , , , and . Write and for the essential suprema of their Euclidean operator norms. There is a unique absolutely continuous satisfying
Under Countable Choice it satisfies almost everywhere, and it always satisfies
For fixed , the map is affine into , and its zero-initial-state linear part is bounded from to the supremum norm.
The almost-everywhere derivative assertion uses Countable Choice, as required by the cited fundamental theorem. The integral-equation existence, uniqueness, bound, and affine-map claims do not require that axiom.
Facts & Assumptions
Given: , essentially bounded matrix classes , a control , an initial state , and the standard Lebesgue integral.
The scalar Lebesgue integral is linear and satisfies for ; it is monotone on nonnegative integrable functions. Euclidean Cauchy--Schwarz gives (The Lebesgue integral is linear on , The modulus of an integral is bounded by the integral of the modulus, Monotonicity and nonnegative homogeneity of the nonnegative integral, Cauchy-Schwarz with its equality case, the triangle inequality for , the parallelogram law and polarisation).
The indefinite integral of an function is absolutely continuous; under Countable Choice its derivative equals the integrand almost everywhere (The indefinite integral of an function is absolutely continuous, The indefinite integral of an function is differentiable almost everywhere).
is complete in the supremum metric; the finite product is therefore complete componentwise ( is complete in the supremum metric for every nonempty compact metric space ).
If for continuous and constants , then (Gronwall's integral inequality with variable and constant coefficients).
The Lebesgue integral is linear on ; changing an integrand on a null set does not change the integral (The Lebesgue integral is linear on ).
For , the geometric series converges to (For , , and for the series diverges).
Countable Choice is assumed only for the almost-everywhere derivative conclusion (The Axiom of Countable Choice ()).
Proof
For any Lebesgue-integrable vector function with , write . If , the norm inequality is immediate. Otherwise put . Then , by [F1], linearity componentwise, and . Thus the vector integral estimate needed below holds for these Lebesgue integrands. Now put ; this follows from , , and [F5]. Choose a finite partition with on each subinterval when ; if , use . Given the already constructed value , define on . By [F2], maps continuous functions to continuous functions, and the vector-integral estimate just proved gives with .
Starting from the constant function , let . Then . By [F7], the geometric majorant has finite sum, so the iterates are Cauchy in the supremum norm. Each coordinate converges uniformly by [F3], and the finite coordinate limit is a continuous vector function . The integral estimate in step 1.1 makes continuous in the supremum norm, hence . If are two fixed points, , so . Solving the finitely many subintervals in order gives one continuous solution on , and the same uniqueness on each subinterval proves global uniqueness.
The integrand lies in . Its indefinite integral is absolutely continuous by [F2], as required in the Statement. Under [A1], the fundamental theorem in [F2] differentiates the integral equation almost everywhere and yields . The same equation is independent of the chosen representatives of by [F6].
From the integral equation and step 1.1, . Apply [F4] with and then [F5]; this gives the displayed supremum bound.
Linearity of the integral [F6] shows that a linear combination of two zero-initial-state solutions is the solution for the same linear combination of controls; uniqueness from step 2.1 makes the zero-initial-state map linear. Step 3.2 with bounds this linear map in the and supremum norms, while the fixed initial-state contribution is independent of . Hence the full map is affine and bounded as claimed.
Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2
Statement
Assume the Axiom of Countable Choice.
Let be nonempty, compact and convex, and let be the pointwise admissible set in Finite-horizon bounded-control linear-quadratic ODE problem. If and weakly in real , then . Thus is weakly sequentially closed.
Facts & Assumptions
Given: Countable Choice, a finite horizon , a nonempty compact convex set , its pointwise admissible set , and a weakly convergent sequence in real .
Countable Choice ensures the Lebesgue outer measure construction is a measure on its sigma-algebra (The Axiom of Countable Choice (), Assuming countable choice, is a sigma-algebra containing every elementary set and is a complete measure extending elementary volume).
(Finite-horizon bounded-control linear-quadratic ODE problem). The pairing is well-defined for vector-valued classes and bounded by : apply Euclidean Cauchy--Schwarz pointwise and scalar Cauchy--Schwarz to the norm functions (Cauchy-Schwarz with its equality case, the triangle inequality for , the parallelogram law and polarisation, Cauchy-Schwarz inequality for ).
Weak convergence means convergence under every bounded linear functional; by [F1], is bounded on whenever is measurable (Weak convergence of nets and sequences).
A continuous real function on a nonempty compact metric space attains its minimum (A continuous real-valued function on a nonempty compact metric space is bounded and attains a greatest and a least value).
The Lebesgue integral is linear on , and the nonnegative integral is monotone (The Lebesgue integral is linear on , Monotonicity and nonnegative homogeneity of the nonnegative integral).
Rational open boxes form a countable basis of the product topology, and on that topology is the Euclidean metric topology ( is a countable dense subset of , and rational open boxes form a countable basis, For the product topology on copies of the usual topology of is the metric topology of on , and hence also of and , so as a product and as a metric space are one space).
Under Countable Choice, Lebesgue measurable sets form a sigma-algebra and a countable union of measurable null sets is null, by countable subadditivity (Assuming countable choice, is a sigma-algebra containing every elementary set and is a complete measure extending elementary volume, Finite and countable subadditivity of measures).
Given: The set and sequence in the Statement.
Proof
Given: The set and sequence in the Statement.
For set , which is finite because is compact and hence bounded. If , [F3] gives a nearest point to . For each and , convexity gives ; minimality of implies , and division by followed by gives . Thus satisfies . If , then and . By [F5], rational vectors are dense in Euclidean , so one can choose rational close enough to that . Therefore a point belongs to exactly when for every rational vector .
Fix a rational . Every is in , so almost everywhere. For any measurable , the test function lies in because ; weak convergence, [F2], and [F4] give . If on a set of positive measure, then for some integer the measurable set has positive measure, contradicting the integral inequality with . Hence almost everywhere.
The rational vectors form a countable set by [F5], so the exceptional null sets from step 1.2 have a null union by [A1, F6]. Outside that union all rational support inequalities hold simultaneously; step 1.1 then gives almost everywhere. This is exactly .
Time meshes and piecewise-constant control parameterization
Definition
For the horizon of Finite-horizon bounded-control linear-quadratic ODE problem, a time mesh is a finite partition with . Its cell widths are and its mesh size is . A piecewise-constant control vector is and represents the measurable control for ; its value at is immaterial in . If for every , then . A mesh family is refining when its mesh sizes tend to zero.
Weakly convergent bounded controls have uniformly convergent states
Statement
For the data of Finite-horizon bounded-control linear-quadratic ODE problem, if and weakly in , then uniformly on .
Facts & Assumptions
Given: The bounded measurable linear state equation, the compact control set , and a sequence in the pointwise admissible set.
The state map has a unique continuous solution and its zero-initial-state part is bounded and linear from to (The bounded measurable linear ODE has a unique affine state map).
Every control in satisfies almost everywhere (Finite-horizon bounded-control linear-quadratic ODE problem and compactness of ).
Weak convergence means convergence under every bounded linear functional on (Weak convergence of nets and sequences).
For a Lebesgue-integrable vector function , the componentwise integral obeys : if , test the integral against and use componentwise linearity, Euclidean Cauchy--Schwarz, scalar integral monotonicity, and (The Lebesgue integral is linear on , Cauchy-Schwarz with its equality case, the triangle inequality for , the parallelogram law and polarisation, The modulus of an integral is bounded by the integral of the modulus, Monotonicity and nonnegative homogeneity of the nonnegative integral); if the bound is immediate.
Proof
By [F1] and [F2], the states have a common bound in supremum norm. For , the integral equation and [F4] give , where . The same bound holds for .
For each fixed , evaluation at composed with the bounded linear zero-initial-state map in [F1] is a bounded linear functional on . Thus [F3] gives coordinatewise.
If , step 1.1 makes each state constant, and step 1.2 gives uniform convergence. If , fix and choose a finite partition of with mesh smaller than . By step 1.2 and finiteness of its nodes, there is an index after which at every node. Any is within the mesh of a node, so step 1.1 gives . Hence the convergence is uniform.
Cell averages give a strong recovery sequence for compact convex controls
Statement
Assume the Axiom of Countable Choice.
Assume the constraint set in Finite-horizon bounded-control linear-quadratic ODE problem is only the pointwise box . For the uniform mesh , , define on by . Then for every , is piecewise constant, and as . This recovery statement need not hold for additional state or terminal constraints unless they are separately shown to be preserved or approximated.
Facts & Assumptions
Given: Countable Choice, , a nonempty compact convex , its admissible control set, and the uniform meshes in Time meshes and piecewise-constant control parameterization.
Finite linear combinations of interval indicators are dense in scalar under Countable Choice; applying this componentwise gives density of finite vector-valued interval step functions, and extending by zero applies it on (Finite linear combinations of box indicators are dense in for , The Axiom of Countable Choice ()).
The componentwise Lebesgue vector integral is linear. For on a cell of length , put . If , then satisfies , using pointwise Euclidean Cauchy--Schwarz, monotonicity, scalar Cauchy--Schwarz, and componentwise linearity; the zero case is immediate (The Lebesgue integral is linear on , Cauchy-Schwarz with its equality case, the triangle inequality for , the parallelogram law and polarisation, Cauchy-Schwarz inequality for , The modulus of an integral is bounded by the integral of the modulus, Monotonicity and nonnegative homogeneity of the nonnegative integral).
A continuous distance function attains its minimum on the nonempty compact set (A continuous real-valued function on a nonempty compact metric space is bounded and attains a greatest and a least value).
For , the pointwise Euclidean triangle inequality gives . Squaring, integrating by monotonicity, and applying scalar Minkowski to the scalar functions and yields (Cauchy-Schwarz with its equality case, the triangle inequality for , the parallelogram law and polarisation, Monotonicity and nonnegative homogeneity of the nonnegative integral, Minkowski's inequality for integrals, including ).
Proof
On each interval , let . If , compactness and [F3] give a nearest point . For every , the segment belongs to for ; minimality of gives . Divide by and let to get . With , this implies . But almost everywhere, so integration contradicts the strict inequality. Thus every cell average lies in and is pointwise admissible.
For any , [F2] on a cell gives ; summing proves . For an interval indicator, agrees with it on cells not meeting an endpoint, and at most two endpoint cells contribute to the squared error, at most . By linearity of and the triangle inequality [F4], for every finite linear combination of interval indicators.
Fix and . By [F1] choose such an interval step function with . The contraction bound in step 1.2 and the triangle inequality [F4] give . Taking yields . Since is arbitrary, strongly in .
Runge–Kutta tableaux and stage collocation equations
Definition
Let be a stage count, , and satisfy for each . This is a (possibly implicit) Runge–Kutta tableau. On mesh cell with width , a start state and piecewise-constant control , define stage times and the collocation stage equations The equations are admissibly defined only for , , and stage inputs for every , using the domains in Finite-horizon ODE optimal-control transcription data. A transcription procedure must check these memberships before each query of or , including trial stages of an implicit solve, and report a stage-time-domain failure for an invalid time or a stage-domain failure for an invalid state or control without making that query. The corresponding endpoint equation is . In a finite transcription, an implicit tableau's coupled stage residuals are solved internally and the stage variables are eliminated from the outer NLP; the procedure returns the nonlinear stage-solve status and residuals. The quadrature contribution of the cell is . This definition asserts no stage-solution existence, uniqueness, order, stability, or error bound. If is strictly lower triangular, evaluate stages in increasing order : form , check the stated time-state-control memberships, and then evaluate , reporting an unavailable value as a stage-evaluation failure. This uses the explicit tableau coefficients and algebraic recursion of Explicit Runge–Kutta tableaus, stage maps, and failure status, with the finite-horizon domain checks specified here; it does not invoke that item's open-time-domain stage map or require an extension of beyond .
Continuous adjoint equation for the linear-quadratic ODE
Definition
For the data of Finite-horizon bounded-control linear-quadratic ODE problem and an admissible control with state , a continuous LQR adjoint is a curve whose coordinates are absolutely continuous in the scalar sense of Absolute continuity on a compact interval, satisfying, almost everywhere,
The equation defines the adjoint notion without asserting existence. Existence and uniqueness for each admissible control are established under Countable Choice by The backward LQR adjoint equation has a unique solution ↗. This sign convention is the one for the minimization Hamiltonian .
Under Countable Choice, the LQR objective is weakly lower semicontinuous
Statement
Assume the Axiom of Countable Choice.
For the data of Finite-horizon bounded-control linear-quadratic ODE problem, if and weakly in , then .
Facts & Assumptions
Given: Countable Choice, the LQR data, the associated costs and states, and a weakly convergent sequence in real .
Countable Choice is the hypothesis of the weak-closedness supplier (The Axiom of Countable Choice (), Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2).
The state and cost are those of Finite-horizon bounded-control linear-quadratic ODE problem; , , and almost everywhere.
Weak convergence of controls in implies uniform convergence of their states (Weakly convergent bounded controls have uniformly convergent states).
The pairing is well-defined on vector-valued classes. Pointwise Euclidean Cauchy--Schwarz followed by scalar Cauchy--Schwarz gives (Cauchy-Schwarz with its equality case, the triangle inequality for , the parallelogram law and polarisation, Cauchy-Schwarz inequality for ).
Under Countable Choice, the pointwise admissible set is weakly sequentially closed (Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2).
Proof
By [A1] and [F4], the weak limit belongs to , so [F2] applies. Put and ; their difference tends to zero uniformly. Since is essentially bounded, the estimate shows that . The terminal terms converge by the same estimate with and .
Let . The bounds on imply and ; symmetry gives . For every fixed , , because the difference is . The right-hand side converges to by weak convergence, as [F3] makes bounded. Taking the supremum over gives , with equality in the supremum at .
The state and terminal cost terms converge by step 1.1, while the control quadratic term is lower semicontinuous by step 1.2. Multiplying by and adding these three terms gives .
AC zero-derivative constancy and integrable-derivative reconstruction under Countable Choice
Statement
Assume Countable Choice (The Axiom of Countable Choice ()) and let .
- If is absolutely continuous and almost everywhere on , then is constant.
- Let , let have absolutely continuous coordinates, and let . If almost everywhere for each coordinate , then, for every , Here means that each coordinate is Lebesgue integrable, and the integral is the componentwise Lebesgue integral. For it is zero.
Facts & Assumptions
Given: Countable Choice, a compact interval, and the scalar or vector data in the Statement.
Absolute continuity controls sums of absolute endpoint increments over finite families with pairwise disjoint interiors and sufficiently small total length (Absolute continuity on a compact interval).
Every gauge on a compact interval admits one finite fine tagged partition; every cell lies in its tag's open gauge neighborhood (Cousin's lemma: every gauge on a compact interval admits a fine tagged partition, Gauges and gauge-fine tagged partitions of a compact interval).
Under Countable Choice, a null set has an open superset of arbitrarily small Lebesgue measure (Assuming countable choice, the Lebesgue outer measure of an arbitrary subset of is the infimum of the measures of the open sets containing it).
Under Countable Choice, Lebesgue measure is complete, monotone and additive on disjoint measurable sets and agrees with interval length; finite sets are null and finite unions of null sets are null (Assuming countable choice, is a sigma-algebra containing every elementary set and is a complete measure extending elementary volume, Assuming countable choice, Lebesgue outer measure is an outer measure that restricts to elementary volume).
Every nonempty subset of the naturals has a least element, and (The well-ordering principle, For the sequence is null, and for the sequence diverges to ).
For , its indefinite Lebesgue integral is absolutely continuous and, under Countable Choice, has derivative almost everywhere (The indefinite integral of an function is absolutely continuous, The indefinite integral of an function is differentiable almost everywhere).
Derivatives use the difference-quotient limit and obey the sum and scalar rules (The derivative of at a point that is a limit point of , and differentiability on a set, Sums, scalar multiples, products and quotients: , , , and when ).
Proof
If , both conclusions hold directly. Otherwise fix and for claim 1. Let be a null exceptional set for on , enlarged by ; it is null by [F4]. Restricting [F1] to , choose so that total interval length below implies total absolute increment below . Put . By [F3], choose one open with .
For , define as the least such that whenever and . This set is nonempty by , [F7] and [F5], including by equality. For , instead take the least with ; openness and [F5] give existence. Set . These uniquely specified least integers define one positive gauge; no arbitrary pointwise radius selections are needed. Obtain one finite -fine partition from [F2].
Cells tagged in lie in . Their interiors are disjoint, and their total length is the measure of their finite union, since shared endpoints form a finite null set. By [F4] this sum is at most , so [F1] bounds their total absolute -increment by ; for an empty family the sum is zero.
For every other cell, strict fineness and step 2.1 give , because the tag lies in the cell. The sum over these cells is at most . Telescoping all cells and applying step 3.1 yields . Arbitrary positive gives equality, and arbitrary prove claim 1.
For claim 2 with , fix a coordinate and put . By [F6], is absolutely continuous and almost everywhere. The function is absolutely continuous: for each positive tolerance use the [F1] moduli for at half that tolerance and take their minimum. Outside the union of the two exceptional null sets, [F7] gives . Claim 1 makes constant, and , so for all . Applying this argument to the finitely many coordinates proves the displayed vector identity.
The backward LQR adjoint equation has a unique solution
Statement
Assume the Axiom of Countable Choice.
For every LQR data set in Finite-horizon bounded-control linear-quadratic ODE problem and every admissible control , the adjoint in Continuous adjoint equation for the linear-quadratic ODE exists and is unique.
Facts & Assumptions
Given: Countable Choice; the bounded measurable matrices , state , target , and terminal value .
The linear state lemma supplies a unique absolutely continuous solution of its Volterra integral equation for and ; under Countable Choice this constructed solution also satisfies almost everywhere (The bounded measurable linear ODE has a unique affine state map, The Axiom of Countable Choice ()).
The adjoint is defined by and (Continuous adjoint equation for the linear-quadratic ODE).
Under Countable Choice, an absolutely continuous vector curve with known derivative equals its initial value plus the componentwise Lebesgue integral of that derivative (AC zero-derivative constancy and integrable-derivative reconstruction under Countable Choice).
An absolutely continuous scalar function is continuous, and a continuous scalar function on a compact interval is bounded; these apply to each of the finitely many coordinates ( implies Lipschitz, Lipschitz implies absolutely continuous, and absolutely continuous implies continuous and bounded variation, A continuous real function on a compact subset of is bounded).
On the finite horizon, componentwise (Cauchy-Schwarz inequality for ).
The reflection is a diffeomorphism of onto itself with . The change-of-variables formula therefore preserves integrals and null sets under , so reflection preserves the and classes used below (A C^1 diffeomorphism satisfies the change-of-variables formula for L^1 functions).
Proof
The forcing lies in by [F6]: is essentially bounded, is continuous on a compact interval and hence bounded, and . Also by [F6]. Apply [F1] with and initial value to obtain an absolutely continuous satisfying the forward Volterra integral equation and almost everywhere.
Set . Each coordinate remains absolutely continuous because reflection preserves interval lengths and disjoint interiors in the defining finite-family condition of Absolute continuity on a compact interval. At points where the coordinate derivatives exist, the difference-quotient definition and the chain rule for give ; [F6] carries the exceptional null set to a null set. The forward equation for therefore gives almost everywhere, and . Thus satisfies [F2].
If is another adjoint solution, reflection gives a coordinatewise absolutely continuous as in step 2.1, with and almost everywhere by [F6]. By [F4], is continuous and bounded componentwise. Since , and [F5] gives , the function belongs to componentwise. Apply [F3] to obtain for every . This is exactly the forward Volterra equation used to construct in step 1.1. Its actual integral-equation uniqueness in [F1] gives , hence .
A bounded-control linear-quadratic ODE has a unique minimizer
Statement
Assume the ultrafilter lemma, Dependent Choice, and Hahn–Banach. For the LQR data of Finite-horizon bounded-control linear-quadratic ODE problem, if the feasible-control set is nonempty, convex, and weakly sequentially closed, then attains its minimum on at a unique control . The direct-method branch uses exactly these three principles; Dependent Choice also supplies Countable Choice for the Hilbert-space/reflexivity suppliers. No use of the full Axiom of Choice is asserted.
Facts & Assumptions
Given: The LQR data, a nonempty convex weakly sequentially closed , the ultrafilter lemma, Dependent Choice, and Hahn–Banach.
The ultrafilter lemma, Dependent Choice and Hahn–Banach are the exact axiom assumptions of the direct-method supplier; the uses below are weak-subsequence extraction and the stated reflexivity route (The ultrafilter extension principle (UL/BPI), The axiom of dependent choice: a relation in which every element is related to something admits an -indexed chain, The real dominated-extension principle as an additional hypothesis over ZF).
Under Countable Choice, real with its integral pairing is a Hilbert space ( with the integral pairing is a Hilbert space).
A real Hilbert space is reflexive under Countable Choice (Hilbert spaces are reflexive).
Dependent Choice implies Countable Choice (Dependent choice implies countable choice).
Under the ultrafilter lemma, Dependent Choice and Hahn–Banach, a proper coercive weakly sequentially lower-semicontinuous functional on a nonempty weakly sequentially closed subset of a real reflexive Banach space attains its infimum (The direct method in a reflexive Banach space).
Under Countable Choice (supplied by Dependent Choice through [F3]), the pointwise control set is weakly sequentially closed; additional path/terminal constraints are included only through the assumed weakly sequentially closed set (Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2, Finite-horizon bounded-control linear-quadratic ODE problem).
The quadratic objective is weakly lower semicontinuous (Under Countable Choice, the LQR objective is weakly lower semicontinuous).
The state map is unique, affine, and bounded from to continuous states (The bounded measurable linear ODE has a unique affine state map).
Proof
By [A1] and [F3], Countable Choice is available. Hence [F1] makes a real Hilbert space and [F2] makes it reflexive.
The set is nonempty by hypothesis and weakly sequentially closed by [F5]. For , every state and terminal quadratic term in is nonnegative, while gives . The cost is finite on by [F7], so is proper and coercive there.
By [F6], is weakly sequentially lower semicontinuous on . The axioms in [A1] and the reflexivity and admissibility checks in steps 1.1–1.2 verify every hypothesis of [F4]; therefore there exists with .
The state map is affine by [F7]. For , each positive-semidefinite quadratic state or terminal form satisfies . The control form satisfies . If , then , so is strictly convex on the convex set . Two distinct minimizers would have a feasible strict convex combination with smaller cost, contradicting the minimum value established in step 2.1. Thus is unique.
Remarks
The source notes' direct-method outline is not used as a substitute for lower semicontinuity: Under Countable Choice, the LQR objective is weakly lower semicontinuous proves that requirement for this objective. The proof does not claim an axiom-minimal version without the three principles in [A1].
Finite-budget indirect shooting for an interior-control ODE optimality system
Definition
This procedure is restricted to a smooth, unconstrained-interior control branch. Let the smooth data be those of Finite-horizon ODE optimal-control transcription data, with no active path or endpoint constraints apart from the prescribed initial state. Any optional inequality constraints must remain strictly inactive throughout the branch; additional endpoint equalities or active endpoint inequalities require an augmented boundary residual and are outside this procedure. Let . Supply a pointwise-defined twice continuously differentiable feedback on an open tube such that and throughout that tube; differentiability uses the convention of Euclidean maps and diffeomorphisms. Every successful IVP evaluation must keep its trajectory in this tube. If the evaluator cannot certify that condition for a queried trajectory, return inadmissible-interior-branch with no shooting result. Define , with the derivative taken holding fixed, and only then substitute . Define and
where and .
The indirect shooting procedure takes a certified differentiable IVP evaluator for , an initial trial , residual tolerance , and correction cap , and calls Finite-budget single shooting for a nonlinear two-point BVP on the square BVP . It returns that algorithm's trajectory and status without changing the root-tolerance meaning. In particular, root-tolerance-met certifies only the computed boundary residual for the numerical IVP map; it is not an exact BVP, optimality, global-optimality, or discretization-error certificate. If the control is on a boundary or no such smooth feedback is supplied, this procedure is inapplicable.
The LQR adjoint identity gives the reduced gradient
Statement
Assume the Axioms of Countable Choice and Dependent Choice.
For the LQR problem of Finite-horizon bounded-control linear-quadratic ODE problem, let , let , and let be its adjoint from Continuous adjoint equation for the linear-quadratic ODE. Define the bounded linear map by It is the first-order norm derivative of at in the precise sense that as .
Facts & Assumptions
Given: The LQR data, , the state variation , and the adjoint .
The state map is affine; its difference satisfies and (The bounded measurable linear ODE has a unique affine state map).
The adjoint is absolutely continuous and satisfies and (Continuous adjoint equation for the linear-quadratic ODE, The backward LQR adjoint equation has a unique solution).
For absolutely continuous scalar functions, integration by parts gives componentwise (Integration by parts for absolutely continuous functions).
The integral pairing is bounded by the product of the norms (Cauchy-Schwarz inequality for ).
Countable Choice and Dependent Choice are assumed for [F3], exactly as required by that supplier (The Axiom of Countable Choice (), The axiom of dependent choice: a relation in which every element is related to something admits an -indexed chain).
Proof
By [F1], the state variation is linear in and satisfies for a fixed constant . Expanding the running and terminal quadratic forms gives the linear term and a remainder . Boundedness of and the state-map estimate bound this remainder by . Thus the displayed linear term is the first-order norm derivative before rewriting its state contributions through the adjoint.
Apply [F3] to and , whose absolute continuity follows from [F1] and [F2]. Using their differential equations gives . Since and , rearranging yields .
Substitute the identity from step 1.2 into the derivative coefficient of step 1.1 and use and because almost everywhere. The resulting coefficient is . Moreover, since are essentially bounded, is continuous, and ; [F4] therefore makes a bounded linear map. The quadratic remainder bound in step 1.1 proves the stated first-order norm expansion.
LQR minimizers satisfy a feasible-set variational inequality
Statement
Assume the Axioms of Countable Choice and Dependent Choice.
For the LQR data of Finite-horizon bounded-control linear-quadratic ODE problem, let be nonempty and convex and let . Put , with the adjoint from Continuous adjoint equation for the linear-quadratic ODE. If minimizes on , then Conversely, if this variational inequality holds at , then is the unique minimizer on .
If , the variational inequality is equivalent (under Dependent Choice, hence Countable Choice) to the existence of one null set such that for every and every . The pointwise condition is not asserted for additional state or terminal constraints.
Facts & Assumptions
Given: The LQR data, a nonempty convex feasible set , a control , its continuous adjoint, and the variational-inequality hypothesis when proving sufficiency or the reverse pointwise implication.
The objective has bounded first-order map , with remainder (The LQR adjoint identity gives the reduced gradient).
The state map is affine, and for every the quadratic expansion has the exact remainder , where (Finite-horizon bounded-control linear-quadratic ODE problem, The bounded measurable linear ODE has a unique affine state map).
Cauchy–Schwarz makes the integral pairing finite for factors (Cauchy-Schwarz inequality for ).
Rational open boxes form a countable basis of the product topology, and on that topology is the Euclidean metric topology ( is a countable dense subset of , and rational open boxes form a countable basis, For the product topology on copies of the usual topology of is the metric topology of on , and hence also of and , so as a product and as a metric space are one space).
Under Countable Choice, Lebesgue measurable sets form a sigma-algebra and countable unions of measurable null sets are null by countable subadditivity (Assuming countable choice, is a sigma-algebra containing every elementary set and is a complete measure extending elementary volume, Finite and countable subadditivity of measures).
The Lebesgue integral is linear on , and the nonnegative integral is monotone (The Lebesgue integral is linear on , Monotonicity and nonnegative homogeneity of the nonnegative integral).
Dependent Choice and Countable Choice are available for the countable dense subset of used in the pointwise equivalence (The axiom of dependent choice: a relation in which every element is related to something admits an -indexed chain, The Axiom of Countable Choice (), Dependent choice implies countable choice).
Proof
Suppose minimizes on and fix . Convexity gives for . Hence for . The first-order expansion [F1] with increment has quotient , so its limit is . This proves the displayed variational inequality.
Suppose the pointwise inequalities hold outside one null set and . For any , substitute outside that null set and the null set on which . The vector lies in because are essentially bounded, is continuous on the compact horizon, and ; [F3] makes integrable. Integrating proves the global variational inequality.
Assume the variational inequality at . For any , [F2] and , give . The linear term is nonnegative by the assumed inequality; hence , with strict inequality if . Thus is the unique minimizer.
Assume the global variational inequality and suppose no common null set makes all pointwise inequalities true. By [F4] and [A1], choose one point from each rational open box meeting ; the resulting countable set is dense. Define , where . These sets are measurable, and is measurable by [F5]. Continuity in and density show that is exactly the set where some violates the pointwise inequality, so the absence of a common null set means . By [F5], some has positive measure. Put on that set and elsewhere. This measurable control lies in . On , ; [F6] and monotonicity give , contradicting the global variational inequality. Therefore one null set suffices for every .
Remarks
For arbitrary active state or terminal constraints the valid first-order condition is the integral inequality over the feasible set. The multiplier in the unconstrained adjoint equation alone does not encode normal multipliers for those additional constraints.
An active terminal constraint invalidates the pointwise control-only variational inequality
Statement refuted
Assume the Axioms of Countable Choice and Dependent Choice, which are the hypotheses used by the reduced-gradient supplier.
The pointwise control-only condition from LQR minimizers satisfy a feasible-set variational inequality holds for an LQR minimizer even when the feasible set includes arbitrary terminal constraints.
Facts & Assumptions
Given: Countable Choice and Dependent Choice. Take , scalar state and control, , dynamics , control set , and terminal constraint . Let , , , and , so . Use the adjoint and derivative conventions of Continuous adjoint equation for the linear-quadratic ODE and The LQR adjoint identity gives the reduced gradient.
Countable Choice and Dependent Choice are assumed for the reduced-gradient supplier (The Axiom of Countable Choice (), The axiom of dependent choice: a relation in which every element is related to something admits an -indexed chain).
A nonnegative function with integral zero vanishes almost everywhere (A nonnegative measurable function has integral exactly when it vanishes almost everywhere).
The adjoint satisfies and ; the reduced gradient is (Continuous adjoint equation for the linear-quadratic ODE, The LQR adjoint identity gives the reduced gradient).
Counterexample
The feasible set in the Given data is determined exactly by the zero terminal-state constraint.
For every feasible , [F1] applied to and gives almost everywhere. Thus and is its unique feasible control and hence a minimizer.
The state is . The adjoint equation becomes with , whose unique solution is . The reduced gradient at is therefore .
For the pointwise control-only condition, choose the admissible point . Then for every , a set of positive measure. Hence the asserted pointwise condition fails, although the global variational inequality over the singleton holds with equality.
Finite-horizon shooting and Runge–Kutta collocation transcription
Definition
Inputs. Supply pointwise smooth data on from Finite-horizon ODE optimal-control transcription data, an original mesh, a piecewise-constant control parameterization, an explicit tableau from Explicit Runge–Kutta tableaus, stage maps, and failure status or a possibly implicit tableau from Runge–Kutta tableaux and stage collocation equations, one of single-shooting, multiple-shooting, or collocation mode, a finite smooth representation of the control constraints when a solver-ready NLP is requested, finite sets of declared path-constraint times, endpoint constraints, the tableau quadrature rule, an initial decision vector and multiplier vector , a stage residual tolerance , a quadrature error tolerance , a stage Newton correction cap , and a maximum number of mesh nodes. For the direct linear-stage branch, optionally supply exact pointwise coefficient maps and satisfying at every queried stage input; only this explicit representation enables that branch. Supply a deterministic derivative evaluator for the actual returned stage maps and resulting finite NLP on an open neighborhood of the queried candidate. On a locally fixed strict stopping branch of the finite stage-iteration procedure, differentiate that finite graph, including when the residual happens to be exactly zero at the queried point. Implicit differentiation as in Implicit differentiation and adjoint formulas under a nonsingular residual Jacobian is permitted only when the selected returned stage map is certified to agree on that neighborhood with the exact local solution branch and its residual Jacobian is nonsingular there; an exact residual at the queried point alone does not establish this agreement. Return derivative-failure when no derivative of the actual returned map is available. Supply a quadrature error evaluator which returns a certified upper bound for the objective quadrature discrepancy or unavailable. Each supplied evaluator returns a value or failure in finite time. An optional trajectory-estimation request supplies the inputs of Finite-budget adaptive Runge–Kutta controller.
Mesh and constraints. Check that the original mesh satisfies and that all declared constraint and quadrature times lie in ; if either check fails, return mesh-domain-failure without evaluation. If the original node count exceeds the supplied cap, return mesh-budget-exhausted. Insert every declared path-constraint time not already a node, unless this exceeds the node cap, in which case return mesh-budget-exhausted. Tie each inserted subcell's control to its original containing cell, so the parameterization is unchanged. On the resulting mesh, check all stage times lie in before querying or ; an invalid time returns mesh-domain-failure with no evaluation. Each tableau stage and its quadrature contribution use the control of that cell, as in the stage equations below. At a declared path- or endpoint-constraint time that is a mesh node before , use the right-hand original-cell value from the half-open representative in Time meshes and piecewise-constant control parameterization; at , use the last original-cell control value unless a separate endpoint-control variable is supplied. Use the same convention at separately declared non-stage quadrature times. An endpoint constraint is evaluated at its declared endpoint. This is finite sampling and does not assert continuous-path feasibility.
Stage evaluation. On each cell write and for its tied constant control. Before forming any stages, check and ; a failed check returns stage-domain-failure with the cell and no objective candidate. For an explicit tableau, form the stages recursively by the displayed equations. Before each query of or , check that the time is in , the state lies in , and the control lies in ; a failed membership check returns stage-domain-failure, and an unavailable function value returns stage-evaluation-failure with the cell and stage index. Apply the same checks to every declared path-constraint evaluation.
For an implicit tableau, do not leave the collocation stages as outer NLP decision variables. Form the coupled slope residual
With the stage times fixed and already checked in , its open evaluation domain consists of stage vectors for which every induced stage state lies in and the cell control lies in ; require to be on this domain. A compact tube used for bounds does not replace this open evaluation domain. If exact coefficient maps were supplied and satisfy at every queried stage input, form the finite matrix with blocks and right-hand side . Use exact Gaussian elimination on the stored sample coefficients: scan columns left to right, pivot on the first nonzero entry at or below the current row, swap, eliminate below, and back-substitute. If no pivot is available, return singular-stage-matrix; otherwise form every induced stage state and check every stage time-state-control input belongs to the smooth-data tube. A failed domain check returns stage-domain-failure with the failing cell and stage index, the partial result record, and no objective candidate. If all checks pass, the exact solution of is the stage vector and the nonlinear-solve status is exact-linear-stage-solve. In all other smooth cases, form the deterministic initial guess after checking that this query is defined. Before calling Newton, check that the entire seed belongs to the declared open domain of , equivalently that every induced stage state lies in and every required control lies in . If this check fails, return stage-domain-failure with the failing cell and stage index, the partial result record, and no objective candidate. Otherwise call Finite-budget Newton for a square vector residual on with that open evaluation domain, tolerance and cap . Record its iterate, residual vector, and exact status for each cell. Only root supplies a stage candidate; it means , not an exact root unless . Any other status returns the partial result record with nlp_status=stage-solve-failure, the failing cell, and no objective candidate. On a returned stage vector use and . A singular stage Jacobian or failed stage query is reported, not interpreted as lack of an exact solution.
Transcription modes. In single shooting, the decision variables are the original-cell controls; set and recursively compute . In multiple shooting, the decision variables are node states and controls; fix and impose the continuity equalities for . In collocation mode, use the same node/control variables, impose the same continuity equalities , and use solved internal stage states; the collocation equations are solved internally by the implicit-stage procedure above. Explicit stages are likewise internal deterministic evaluations. After every interval map in every mode, check before using it as a later start or evaluating a path constraint, terminal cost, or endpoint constraint; otherwise return stage-domain-failure with no objective candidate. Independently of the computed endpoints and defect residuals, check before evaluating or any terminal constraint; in multiple shooting and collocation this node is an independent decision variable even when . Before any endpoint-constraint query, also check every actual state and control argument, including a separately supplied endpoint-control variable, belongs to that function's declared domain. Any failed membership check returns stage-domain-failure with no objective candidate. In every mode the finite feasible set includes for each original cell. The finite objective is , and the finite constraints are exactly the fixed initial-state condition, the continuity equalities in multiple shooting and collocation, the declared node/time constraints, the represented control constraints, and endpoint constraints. Include every continuity defect in the equality residual and its corresponding multiplier in ; in single shooting the initial state and continuity are enforced by recursive elimination. If is available only as a compact set-membership constraint and has no finite smooth representation, return the finite set-constrained model with nlp_status=not-smooth-nlp; the dispatcher must not treat it as an SQP-ready NLP. A QP solver route additionally requires the sampled control constraints to be affine.
Output. Evaluate the supplied initial candidate and return a record containing its ordered decision variables, defect residuals, per-cell implicit-stage residuals, path/endpoint constraint residuals, KKT residuals, and objective value, when available. For equality residual , inequality residual , and multiplier pair , report , , , and . Include a model that can reevaluate these quantities at a later solver candidate. Return separate nlp_status, per-cell implicit_stage_status, optional ivp_status, quadrature_status, mesh_status, and budget_status fields. A quadrature bound at most is bound-met; a larger bound is bound-not-met; an unavailable bound is unavailable. The build-stage budget field is not-run; the solver dispatcher fills its final value. A failed derivative evaluation leaves KKT residuals unavailable with its exact status. An unevaluated optional IVP estimate is not-requested; if requested, report the adaptive controller's exact finite status, not an error certificate.
This direct transcription samples pointwise data; an equivalence class without a chosen representative and sampling rule is not stage-evaluable. For a single-shooting reduced objective represented as the finite state-step graph of Finite parameterized state-step graphs and objectives, its exact real-arithmetic reduced gradient is given by The reverse recursion is the exact gradient of a finite state-step objective. Agreement with the continuous ODE adjoint gradient is only conditional on the weighted discrete-gradient representation and the separate state, adjoint, derivative-data, endpoint, and quadrature estimates in Discrete and continuous ODE gradients agree to order p under augmented error bounds. The optional adaptive RK estimate is separate from the fixed NLP and its embedded difference is not a certified global error bound. If all construction, stage, sample-domain and objective checks succeed, return nlp_status=constructed for a solver-ready NLP, or nlp_status=not-smooth-nlp for a finite set-constrained model without a smooth control representation; set mesh_status=valid and retain budget_status=not-run. The algorithm makes no continuous-path feasibility, convergence-rate, global-optimality, or unconditioned discrete-adjoint accuracy claim.
Exact single and multiple shooting have the same reduced feasible controls
Statement
Fix a mesh, controls , and a successful deterministic Runge–Kutta interval map from Finite-horizon shooting and Runge–Kutta collocation transcription. In the single-shooting NLP, define states recursively from and . In the multiple-shooting NLP, impose the same initial state and continuity equations. Then projection from the multiple-shooting feasible set onto its control coordinates is a bijection onto the single-shooting feasible controls. Any objective and node constraints that use the same recursively determined states have identical reduced values and feasibility. This is an algebraic equivalence of the discrete NLPs; it is not an equivalence to the continuous ODE problem.
Facts & Assumptions
Given: The fixed mesh, the deterministic interval maps, and controls for which every interval map succeeds.
An interval map is available only after its explicit stages or implicit stage residual solve return a successful status; it assigns exactly one deterministic endpoint to that successful start/control pair, and single shooting applies it recursively (Finite-horizon shooting and Runge–Kutta collocation transcription).
The multiple-shooting variables satisfy and (Finite-horizon shooting and Runge–Kutta collocation transcription).
Proof
Given any control tuple feasible in single shooting, calculate , then each later . Uniqueness of each deterministic map makes this recursively defined state tuple well-defined; by construction it satisfies every multiple-shooting continuity equation.
Conversely, a multiple-shooting feasible tuple has fixed and satisfies each continuity equation. Induction on forces its to equal the recursive single-shooting value for the same controls. Hence there is exactly one multiple-shooting state tuple for each feasible control tuple and the projection is bijective.
Under this bijection the states at all shared nodes agree. Therefore every node constraint has the same value and every objective formed from the same node/stage values is identical. Thus reduced feasibility and objective values coincide.
A linear-quadratic transcription with affine constraints is a convex QP
Statement
Consider a finite mesh and an LQR model evaluated by a fixed Runge–Kutta tableau, explicit or implicit, whose stage quadrature weights are nonnegative and whose sampled running and terminal quadratic weights are positive semidefinite. If are supplied as almost-everywhere equivalence classes, choose pointwise representatives and state the sampling rule at every stage and quadrature time; the finite QP claim concerns only that resulting sampled system, since an equivalence class alone has no stage value. For an implicit tableau, require that each cell's sampled linear stage-residual matrix is nonsingular and use its unique solution. Suppose every control, path, terminal, initial, and shooting/collocation constraint is specified by finitely many affine equalities or inequalities in the transcription variables. Then the finite transcription of Finite-horizon shooting and Runge–Kutta collocation transcription is a convex quadratic program (QP): its objective is a convex quadratic polynomial and its equality and inequality constraints are affine. This is the finite NLP/QP branch used with the convex models in Conic, LP, and convex QP primal-dual models.
This algebraic claim does not make an equivalence class a valid input to the pointwise smooth-data procedure. If that procedure is called, its separate pointwise-domain and smoothness hypotheses must also hold; otherwise this lemma concerns only the specified finite sampled equations.
Facts & Assumptions
Given: A finite mesh, chosen pointwise representatives and a sampling rule for any equivalence-class data, linear dynamics, a fixed explicit or implicit Runge–Kutta tableau, nonnegative stage weights, positive-semidefinite sampled quadratic cost weights, nonsingular sampled stage matrices when implicit stages are eliminated, and affine constraints.
An explicit RK stage is a finite affine recursion in prior stages. For an implicit linear cell, the slope equations have matrix and right-hand side ; if is nonsingular, their unique solution and the endpoint are affine in (Explicit Runge–Kutta tableaus, stage maps, and failure status, Runge–Kutta tableaux and stage collocation equations).
The transcription uses the explicit recursions or solved implicit interval maps for the node/defect equations and uses the displayed quadrature objective at the chosen sample values (Finite-horizon shooting and Runge–Kutta collocation transcription).
A convex QP has a positive-semidefinite quadratic objective Hessian and affine equalities/inequalities (Conic, LP, and convex QP primal-dual models, Inequality constrained programs, tangent cones, constraint qualifications, and KKT).
Proof
On each interval with linear dynamics, an explicit tableau has affine stages by recursion: the first stage is affine in the start and control, and if previous stages are affine then and are affine. For an implicit tableau, the sampled slope equations form the affine system described in [F1]. Nonsingularity makes every stage and endpoint an affine function of ; the algorithm's exact linear stage-solve branch reports failure if this matrix is singular. Thus the endpoint/defect equations and any retained stage equations are affine.
Each quadrature term is a nonnegative scalar weight times a positive-semidefinite quadratic form applied to an affine state/control map, hence has positive-semidefinite Hessian; the terminal form has the same property. A finite sum of such Hessians is positive semidefinite, so the objective is convex quadratic. The remaining constraints are affine by hypothesis; thus [F3] identifies the transcription as a convex QP.
Mesh-consistent LQR minimizers converge to the unique continuous minimizer
Statement
Assume the axiom branch of A bounded-control linear-quadratic ODE has a unique minimizer, and let be the unique minimizer of the LQR objective on a nonempty convex weakly sequentially closed feasible set . For each mesh index , let be nonempty, and let be the discrete transcription objective. Assume there are such that for every . Assume also a recovery sequence with . If is a global minimizer of on , then in and uniformly.
For the control-only case and piecewise-constant mesh controls, the cell-average lemma supplies the strong recovery sequence. If active path or terminal constraints are present, preservation or recovery of those constraints is an additional hypothesis; node sampling alone does not establish continuous-path feasibility. This theorem is conditional on a uniform objective consistency bound; an embedded adaptive RK difference alone does not provide that bound.
Facts & Assumptions
Given: The LQR data, its unique minimizer, feasible discrete sets, uniform consistency, recovery controls, and global discrete minimizers.
The continuous LQR minimizer exists uniquely under the stated closedness and choice-axiom hypotheses (A bounded-control linear-quadratic ODE has a unique minimizer).
The control set is bounded in because is compact, and is weakly sequentially closed under Countable Choice (supplied by the theorem's axiom branch) (Finite-horizon bounded-control linear-quadratic ODE problem, Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2).
A bounded sequence in a real reflexive Banach space has a weakly convergent subsequence under the ultrafilter lemma, Dependent Choice, and Hahn–Banach (A bounded sequence in a reflexive Banach space has a weakly convergent subsequence).
The LQR objective is weakly sequentially lower semicontinuous on (Under Countable Choice, the LQR objective is weakly lower semicontinuous).
Weakly convergent controls in have uniformly convergent states (Weakly convergent bounded controls have uniformly convergent states).
The state map is affine and bounded from to the supremum norm, so the LQR objective is continuous under strong convergence (The bounded measurable linear ODE has a unique affine state map, Finite-horizon bounded-control linear-quadratic ODE problem).
The ultrafilter lemma, Dependent Choice, and Hahn–Banach are assumed for [F3] and real Hilbert-space reflexivity (The ultrafilter extension principle (UL/BPI), The axiom of dependent choice: a relation in which every element is related to something admits an -indexed chain, The real dominated-extension principle as an additional hypothesis over ZF, with the integral pairing is a Hilbert space, Hilbert spaces are reflexive).
Proof
Since and is compact, . Real is reflexive by [A1], so [F3] gives a weakly convergent subsequence from every subsequence of .
Let a subsequence converge weakly to . Because each and is weakly sequentially closed, . By [F4] and consistency, . Global discrete minimality gives . To see , [F6] gives ; the control quadratic difference is bounded by , and state and terminal quadratic differences tend to zero by the corresponding bounded-quadratic estimate and uniform state convergence. Hence , so .
Since and is the unique minimizer there, step 2.1 forces . Every subsequence therefore has a weakly convergent subsubsequence whose limit is . If the full sequence failed to converge weakly to , some bounded linear functional and some positive tolerance would witness failure along a subsequence; a weakly convergent subsubsequence from step 1.1 would contradict that witness. Thus .
Apply [F5] to the weakly convergent admissible controls from step 3.1 to obtain uniformly on .
Strong convexity converts transcription objective error into a control bound
Statement
Let minimize the LQR objective on a convex feasible set , with control weight for . Let and let be a recovered comparison control. Suppose the computed objective satisfies for , and . If , then for every , and The conclusion is conditional on the stated objective consistency and comparison bounds. A raw embedded RK error estimate is not a certified value of .
Here are sufficient bounds that derive the two error terms from transcription errors and recovery. Set , , , , and . Suppose, for , a pointwise representative and sampling rule are fixed, has the form where , , , and the chosen samples satisfy . Suppose , , , and where . Then one may take If a feasible recovery sequence also satisfies , then one may take , where with any essential upper bound for . In the control-only case, under Countable Choice the cell-average lemma supplies and . If is Lipschitz with constant , then is a valid rate for mesh size . For a general minimizer, no rate for is asserted.
Facts & Assumptions
Given: The LQR model, , a continuous minimizer, two feasible controls, and the finite objective inequalities in the Statement. For the explicit numerical-error estimate, also assume the stated pointwise sampling, state, and quadrature bounds.
The state map is affine and bounded from to the supremum norm (The bounded measurable linear ODE has a unique affine state map).
Expanding the LQR quadratic forms for gives where and ; this follows from [F1] and the definition of (Finite-horizon bounded-control linear-quadratic ODE problem, The bounded measurable linear ODE has a unique affine state map).
For admissible controls, and by compactness of and the state-map bound (Finite-horizon bounded-control linear-quadratic ODE problem, The bounded measurable linear ODE has a unique affine state map).
Countable Choice is assumed only for the control-only cell-average recovery specialization (The Axiom of Countable Choice (), Cell averages give a strong recovery sequence for compact convex controls).
Proof
Fix and put . Convexity gives for . By [F2], , where . Minimality makes this expression nonnegative for ; divide by and let to get . Also since and . Taking proves .
For the stated sampled objective, subtract the quadrature of evaluated at the exact state. At every quadrature node, the state-cost difference is bounded by ; the control-cost summand is unchanged. Nonnegative weights with sum therefore bound the accumulated state perturbation by . The exact-state quadrature discrepancy is at most . At , the terminal quadratic difference is at most . Thus for with the displayed .
The assumed inequalities and consistency give . Subtract and combine with step 1.1 to get the objective-gap bound.
Apply the growth inequality of step 1.1 at . Substitute the upper objective-gap bound from step 2.1, divide by , and take nonnegative square roots to obtain the control-error estimate.
For any feasible with , [F2] and [F3] bound the absolute difference of the state running terms by , the terminal terms by , and the control terms by . Hence . Under [A1] the cell-average lemma gives strong recovery for the control-only case. If is -Lipschitz, for each in a cell its distance from the cell average is at most , so . Substitution gives the stated rate and completes the sufficient-estimate branch.
Finite-budget barrier or SQP solve for a transcription NLP
Definition
Inputs are a transcription record from Finite-horizon shooting and Runge–Kutta collocation transcription, a primal initial iterate and full multiplier iterate in the fixed equality/inequality constraint ordering, an optional canonical QP start with nonnegative primal variables , free equality multipliers , and nonnegative dual slacks , an SQP model builder, and finite nonnegative tolerances . The stage and quadrature tolerances must match those bound into the transcription record. The KKT tolerances bound primal feasibility, stationarity, and multiplier-feasibility/complementarity; in the QP route also bounds the primal-dual gap. Also supply finite integer SQP and QP update caps , positive finite integer penalty/backtracking caps with , merit parameters , , , and the finite-budget exact-Hessian branch selector and identified active set when that branch is requested. The IVP estimator uses its own declared controller tolerances; its status is not treated as an error certificate.
The SQP model builder is a deterministic finite procedure which, at each queried full state , returns either a failure status or the finite NLP data , its objective gradient, a symmetric positive-definite SQP model matrix when the merit branch is selected, and the exact Lagrangian Hessian when the exact-Hessian branch is selected. The model matrix may depend on the supplied current multiplier vectors. For the exact-Hessian branch with identified active set , evaluate that Hessian with equality multipliers , active inequality multipliers , and zero inactive multipliers; its required positivity is the separate reduced-curvature condition of the exact step, not full positive definiteness. It must use and nonnegative inequality multipliers. In the merit branch, the associated quadratic subproblem is exactly subject to and . For that branch, the builder also supplies the active equality/inequality row data required by L1 merit globalization with finite penalty and backtracking budgets. Solver tolerances are used as follows: bounds the norm of equality and positive inequality violations, bounds the stationarity residual, and bounds multiplier-feasibility and complementarity residuals. The stage and quadrature tolerances are passed to the transcription's corresponding residual and certified-error checks. The IVP estimator uses its own declared controller tolerances and has a separate status; its embedded difference is not a certified error bound. Any called builder, evaluator, canonicalizer, or solver returns a value or failure status in finite time.
First audit the transcription dimensions, sampled domains, and data status fields. If stage construction failed, return the partial record with its stage and NLP statuses and do not call a solver. If the model satisfies A linear-quadratic transcription with affine constraints is a convex QP, map its finite quadratic objective and affine constraints to canonical LP/QP form: replace each free variable by with ; for each affine inequality , add a primal slack and equality ; retain existing equalities; and transform the quadratic objective by substitution. The transcription record supplies finite stored coefficient arrays. Canonicalize using exact rational arithmetic on their dyadic values, then round each resulting coefficient once to the nearest normal representable value under Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add, preserving exact zeros; any range failure makes the QP route inapplicable. Check the resulting equality matrix by exact rational row elimination; if it is rank deficient or the conversion is otherwise inadmissible, mark the QP route inapplicable and proceed to SQP. The optional start is in these converted coordinates and is checked constructively: require every primal coordinate, including each added , and every dual slack coordinate to be strictly positive, and require to be finite with the correct equality dimension. If it is absent or fails this check, record strict-start-unavailable and proceed to SQP; do not infer infeasibility or decide whether some other strict start exists. If it passes, call Finite-budget primal-dual Newton methods for LP, convex QP, and symmetric cones once with centering and fraction-to-boundary parameters both , , , , and cap . The minimum in ensures the supplier's single tolerance for both its dual and complementarity residuals meets each requested bound; separately bounds the certified primal-dual gap. If it returns invalid-input or strict-start-unavailable, record that QP status and proceed to SQP. Return every other status and audited residuals. certified-gap certifies the resulting stored canonical floating-point QP, interpreted as exact dyadic rationals, under Fraction-to-boundary steps preserve positivity and exact primal-dual feasibility certifies a gap; it is not a certificate for the unsampled continuous problem. A residual-candidate remains a candidate. No other QP status is reinterpreted as success.
If the QP route is inapplicable or lacks a supplied strict start, run the SQP branch only when the transcription status is solver-ready constructed; otherwise return its not-smooth-nlp or model-construction status without an SQP call. Initialize and verify the full multiplier dimensions. An invalid state returns model-build-failure with its last available record. For , in order, query the model builder at the entire current state , propagating any builder failure without changing that state, and compute
where positive parts are componentwise. If , , , and , return kkt-residual-met with the current decision and residual record; this is an approximate KKT candidate unless all residuals are exactly zero. If , return budget-exhausted. Otherwise, if the exact-Hessian branch is selected and an active set has been correctly identified, call Full-step exact-Hessian SQP after active-set identification at the current pair with inactive multipliers set to zero, using the exact Hessian evaluated at that same pair. On its successful full Newton-pair return , use , place the equality and active-inequality components of into the full vectors , and set inactive inequality components to zero; any failure stops with that status without changing the current state. In the merit branch, call L1 merit globalization with finite penalty and backtracking budgets with the current model , . On accepted or accepted-soc, use its actual returned accepted point , including the SOC displacement when present, and full returned QP multipliers to set for the next model-builder query. Retain the complete supplier record, including its retained equality basis and selected inequality support. Do not replace the full vectors by reduced support multipliers or infer the true nonlinear active set from QP support. Any other supplier status stops the loop without changing the current state. The exact-Hessian local branch has only the conditional convergence guarantee in Exact-Hessian SQP converges quadratically on the identified active KKT system.
Every return is a result record with the last available decision variables, the full current SQP multiplier vectors when that branch has been reached, its last supplier record when one exists, defect residuals, path/endpoint constraint residuals, KKT residuals, objective value, and separate nlp_status, implicit_stage_status, ivp_status, quadrature_status, mesh_status, and budget_status fields. Fields not reached are marked not-run; failed evaluations carry their failure status and do not supply a candidate value. The finite caps bound the procedure. It does not guarantee a start, solver success, a global solution of a nonconvex problem, continuous-path feasibility from sampled constraints, or a certified approximation error for the continuous ODE problem.
Exact-Hessian SQP converges locally to a regular transcription KKT point
Statement
Fix a mesh and a finite transcription generated from the pointwise smooth data in Finite-horizon ODE optimal-control transcription data. Suppose its NLP functions have continuous derivatives through order three on an open neighborhood of a KKT point , LICQ holds there, every active inequality multiplier is strictly positive, and the second-order sufficient condition holds on the critical cone. Then, after the correct active set is identified, the exact-Hessian full-step branch using Full-step exact-Hessian SQP after active-set identification is well-defined from a sufficiently close primal-dual start and converges quadratically to . The finite-budget dispatch of Finite-budget barrier or SQP solve for a transcription NLP may terminate before this local convergence is realized.
This also has the following conditional mesh-family conclusion. For each mesh index , let be the square active-set KKT residual map of a finite transcription, with finite-dimensional normed spaces , and let be a reference primal-dual pair. Let be a common Banach space containing the continuous primal and multiplier fields, with bounded linear reconstruction maps that use the same fixed norms and satisfy . Suppose a continuous KKT pair and mesh-consistent constraints satisfy and . Suppose the discrete sensitivity maps are invertible with uniformly, and is -Lipschitz on a common radius about each , with constants independent of . For all sufficiently large , require and . Then there is a unique active-set KKT root in the radius- ball, and . If these roots satisfy LICQ, strict complementarity, SOSC, and a common local full-step basin for exact-Hessian SQP, then the exact-Hessian iterates from starts in that basin converge quadratically to for each such mesh. The varying systems are compared through the reconstruction maps and their fixed norms; this conclusion makes no global optimizer, path-feasibility, or finite-budget convergence claim.
Facts & Assumptions
Given: A fixed smooth finite transcription, a KKT pair, LICQ, strict complementarity, the second-order sufficient condition, a correct identified active set, and an initial primal-dual point sufficiently close to the KKT pair.
The transcription is a finite NLP with the objective and constraints returned by Finite-horizon shooting and Runge–Kutta collocation transcription. The C3 regularity of these actual reduced functions on the stated neighborhood is an explicit hypothesis; smooth data alone do not certify a differentiable implicit-stage solve branch (Finite-horizon ODE optimal-control transcription data).
The KKT convention is with nonnegative active multipliers (Inequality constrained programs, tangent cones, constraint qualifications, and KKT).
The exact-Hessian local SQP theorem gives quadratic convergence for a NLP with LICQ, strict complementarity, SOSC, and locally Lipschitz active-KKT Jacobian (Exact-Hessian SQP converges quadratically on the identified active KKT system).
The strict second-order sufficient condition used here is positivity of the Lagrangian Hessian on every nonzero critical-cone direction (Strict second-order positivity on the critical cone gives a strict local minimum).
The actual NLP functions are by [F1]. On a closed ball compactly contained in their open neighborhood, their third derivatives are bounded, so their Hessians and the active KKT Jacobian are locally Lipschitz.
The active-set KKT Jacobian and full-step exact-Hessian SQP branch have the local properties stated in the fixed-system theorem (Exact-Hessian SQP converges quadratically on the identified active KKT system).
Each finite-dimensional normed space is complete (Every finite-dimensional normed space is Banach). A closed ball in is complete: every Cauchy sequence in the ball converges in , and continuity of the norm keeps its limit in the ball. A contraction of a nonempty closed ball into itself therefore has a unique fixed point by A contraction of a nonempty complete metric space into itself has exactly one fixed point, the limit of the iterates from any starting point.
For the mesh-family conclusion, the reconstruction, residual-consistency, uniform inverse, uniform Jacobian-Lipschitz, active-set, and common-basin assumptions in the Statement hold.
Proof
A fixed transcription has finitely many decision variables. By the regularity hypothesis in the Statement and [F1], its actual objective and constraint functions have continuous derivatives through order three on a neighborhood of the KKT point. For an implicit-stage transcription this hypothesis includes the selected local stage-solve branch; no differentiability of that branch is inferred from the smooth-data definition alone.
For the mesh-family branch, set and . If , is already a root. Otherwise take the closed ball of radius . The residual bound gives . For in that ball, the uniform Lipschitz bound gives . Thus maps the ball into itself and is a contraction. Completeness [F7] gives its unique fixed point , which is exactly the unique root of there and satisfies .
The KKT map for the identified active set is built from the first derivatives of those objective and constraint functions. Its Jacobian is locally Lipschitz by continuity and local boundedness of their third derivatives in [F5]. The assumed LICQ, strict complementarity, and SOSC from [F4] are exactly the remaining hypotheses of [F3].
Apply [F3] to the active KKT system. It provides a neighborhood in which exact-Hessian full Newton steps are defined and converge quadratically from a sufficiently close start, which is the asserted fixed-mesh branch. The dispatcher has a finite outer cap, so it can stop before the local sequence converges.
By boundedness of , , which tends to zero. The assumed LICQ, strict complementarity, SOSC, local Lipschitz conditions, and common basin let [F6] apply at each ; hence each exact-Hessian full-step sequence from that basin converges quadratically.
5 · Examples, counterexamples and false statements
None yet.
Sources
- J. Monnier, Optimal Control of ODEs: The Linear-Quadratic (LQ) Case, course notes, Chapter 2 §§2.4–2.5
- W. W. Hager, Runge-Kutta methods in optimal control and the transformed adjoint system, Numerische Mathematik 87 (2000)
- S. Gros and M. Diehl, Numerical Optimal Control, draft course manuscript, Chapter 13 §§13.1–13.4
- J. Monnier, Optimal Control of ODEs: The Linear-Quadratic (LQ) Case, course notes, Chapter 2 §2.4
- J. Monnier, Optimal Control of ODEs: The Linear-Quadratic (LQ) Case, course notes, Chapter 2 §2.3.1
- S. Gros and M. Diehl, Numerical Optimal Control, draft course manuscript, Chapter 13 §§13.1–13.3
- J. Monnier, Optimal Control of ODEs: The Linear-Quadratic (LQ) Case, course notes, Chapter 2 §2.5.1
- S. Gros and M. Diehl, Numerical Optimal Control, draft course manuscript, Chapter 13 §13.3
- J. Monnier, Optimal Control of ODEs: The Linear-Quadratic (LQ) Case, course notes, Chapter 2 §2.5.2
- S. Gros and M. Diehl, Numerical Optimal Control, draft course manuscript, Chapter 13
- Christopher Heil, Absolute Continuity and the Banach-Zaretsky Theorem, Corollary 21 and Lemma 22–Theorem 23
- Alessandro Fonda, The Kurzweil-Henstock Integral for Undergraduates, Theorem 1.4
- J. Monnier, Optimal Control of ODEs: The Linear-Quadratic (LQ) Case, course notes, Chapter 2 §§2.4–2.5.1
- S. Gros and M. Diehl, Numerical Optimal Control, draft course manuscript, Chapter 13 §§13.1–13.2
- J. Monnier, Optimal Control of ODEs: The Linear-Quadratic (LQ) Case, course notes, Chapter 2 §2.5
- S. Gros and M. Diehl, Numerical Optimal Control, draft course manuscript, Chapter 13 §13.4
- Stephen Boyd and Lieven Vandenberghe, Convex Optimization
- Jorge Nocedal and Stephen J. Wright, Numerical Optimization, 2nd ed.