Alphabeta Math
Pipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

Direct transcription and numerical ode optimal control

1 · Prerequisites

2 · Summary

This page separates a measurable-control existence model from the pointwise smooth-data branch required to evaluate Runge–Kutta stages. It proves the bounded linear state map; under their stated Countable Choice hypotheses, it proves weak closedness of compact convex actuator bounds, weak-to-uniform state convergence, and strong recovery by cell averages. The LQR branch gives existence and uniqueness using the stated ultrafilter lemma, Dependent Choice, and Hahn–Banach assumptions, then derives the continuous adjoint, reduced gradient, and feasible-set variational inequality under their explicit choice hypotheses. The pointwise Hamiltonian condition is shown only for control-only constraints; a terminal-state example refutes the broader claim.

The transcription procedures cover single and multiple shooting, explicit stages, and implicit collocation with coupled stage residuals solved internally and their nonlinear-solve statuses returned. Declared path-constraint times are inserted as mesh nodes; sampled constraints do not certify continuous-path feasibility. Every equivalence-class datum used at a stage or quadrature time needs a chosen pointwise representative and sampling rule. Exact single/multiple shooting equivalence is finite-dimensional, and convex quadratic transcriptions reduce to QPs when sampled weights and constraints meet the stated assumptions. Mesh convergence is conditional on uniform objective consistency and feasible recovery. Strong convexity converts uniform state/quadrature and comparison-recovery bounds into an objective and control rate; an embedded RK difference alone is not a global error certificate.

The finite dispatcher reports decision variables, defects, constraints, KKT residuals, objective, and separate NLP, stage, IVP, quadrature, mesh, and budget statuses. Exact-Hessian SQP convergence is local for a fixed transcription under LICQ, strict complementarity, SOSC, and smoothness. A mesh-family KKT limit is also proved conditionally from residual consistency, uniformly bounded discrete KKT sensitivities, and reconstruction into common normed spaces; finite solver budgets may stop before convergence.

3 · Logical flowchart

4 · Definitions, theorems and proofs

DefinitionDefinition: Literature-sourcedProof: Not applicablejudge pass (gpt-6-luna)Open item page →

Finite-horizon bounded-control linear-quadratic ODE problem

Definition

Fix a finite horizon T>0, state and control dimensions n,m≥1, and the real quotient space L2(0,T;Rm) of measurable controls modulo equality almost everywhere (The space Lp(μ) as the quotient by null functions). Let A∈L∞(0,T;Rn×n) and B∈L∞(0,T;Rn×m) be equivalence classes, let x0,xT∈Rn, and let xd∈L2(0,T;Rn). Let Uc⊂Rm be nonempty, compact and convex. The pointwise control set is

Uc:={u∈L2(0,T;Rm):u(t)∈Uc for almost every t}.

Let Q∈L∞(0,T;Rn×n) and R∈L∞(0,T;Rm×m) be symmetric almost everywhere, with Q(t)⪰0 and rI⪯R(t)⪯MI almost everywhere for constants 0<r≤M<∞. Let P∈Rn×n be symmetric positive semidefinite. For each u∈Uc, its state is the unique continuous solution of the Volterra equation

xu(t)=x0+∫0t(A(s)xu(s)+B(s)u(s)) ds.

The same state equation is defined for every u∈L2(0,T;Rm), and the running and terminal cost on that ambient space is

J(u)=12∫0T ⁣((xu(t)−xd(t))TQ(t)(xu(t)−xd(t))+u(t)TR(t)u(t))dt+12(xu(T)−xT)TP(xu(T)−xT).

The constrained problem minimizes this ambient functional over F, where additional path or terminal constraints are represented by a nonempty convex weakly sequentially closed set F⊆Uc; with no additional state constraints, F=Uc. “Weakly sequentially closed” means that every weakly convergent sequence in F has its weak limit in F (Weak convergence of nets and sequences). The definition asserts no optimizer or adjoint existence; the state-map well-definedness is supplied by The bounded measurable linear ODE has a unique affine state map ↗.

DefinitionDefinition: Literature-sourcedProof: Not applicableOpen item page →

Finite-horizon ODE optimal-control transcription data

Definition

For pointwise numerical transcription on [0,T], the data consist of integers n,m≥1, open sets Ωx⊆Rn and Ωu⊆Rm, a nonempty compact convex control set Uc⊂Ωu, an initial state x0∈Ωx, a pointwise-defined vector field f:[0,T]×Ωx×Ωu→Rn, a pointwise-defined running cost L:[0,T]×Ωx×Ωu→R, and a terminal cost ϕ:Ωx→R. The admissible state solves x˙(t)=f(t,x(t),u(t)) almost everywhere and the continuous objective is ∫0TL(t,x(t),u(t))dt+ϕ(x(T)). Optional path and endpoint constraints are pointwise-defined functions evaluated at declared continuous times or transcription nodes. A compact tube is a compact subset of [0,T]×Ωx×Ωu containing the state/control triples used by stages and trajectories. On such a tube, f,L,ϕ and any constraint functions used in a local NLP theorem are continuous and have continuous state/control derivatives through order three (the C3 convention of Ck Euclidean maps and diffeomorphisms), with those derivatives bounded. An L∞ equivalence class alone has no specified value at a Runge–Kutta stage time, so it is not an admissible stage-evaluation input without an additional pointwise representative and sampling rule. This definition makes no existence, convergence, or continuous-path-feasibility claim.

LemmaStatement: Literature-sourcedProof: AI-generatedjudge pass (gpt-6-luna)Open item page →

The bounded measurable linear ODE has a unique affine state map

Statement

Let T>0, A∈L∞(0,T;Rn×n), B∈L∞(0,T;Rn×m), u∈L2(0,T;Rm), and x0∈Rn. Write ∥A∥∞ and ∥B∥∞ for the essential suprema of their Euclidean operator norms. There is a unique absolutely continuous x:[0,T]→Rn satisfying

x(t)=x0+∫0t(A(s)x(s)+B(s)u(s)) ds.

Under Countable Choice it satisfies x˙=Ax+Bu almost everywhere, and it always satisfies

∥x∥∞≤e∥A∥∞T(∥x0∥2+∥B∥∞T ∥u∥2).

For fixed A,B,x0, the map u↦xu is affine into C([0,T];Rn), and its zero-initial-state linear part is bounded from L2 to the supremum norm.

The almost-everywhere derivative assertion uses Countable Choice, as required by the cited L1 fundamental theorem. The integral-equation existence, uniqueness, bound, and affine-map claims do not require that axiom.

Facts & Assumptions

Given: T>0, essentially bounded matrix classes A,B, a control u∈L2, an initial state x0, and the standard Lebesgue integral.

[F1]

The scalar Lebesgue integral is linear and satisfies ∣∫h∣≤∫∣h∣ for h∈L1; it is monotone on nonnegative integrable functions. Euclidean Cauchy--Schwarz gives ∣qTh∣≤∥q∥2∥h∥2 (The Lebesgue integral is linear on L1(μ), The modulus of an integral is bounded by the integral of the modulus, Monotonicity and nonnegative homogeneity of the nonnegative integral, Cauchy-Schwarz ∣⟨x,y⟩∣≤∥x∥2∥y∥2 with its equality case, the triangle inequality for ∥⋅∥2, the parallelogram law and polarisation).

[F2]

The indefinite integral of an L1 function is absolutely continuous; under Countable Choice its derivative equals the integrand almost everywhere (The indefinite integral of an L1 function is absolutely continuous, The indefinite integral of an L1 function is differentiable almost everywhere).

[F3]

C([a,b];R) is complete in the supremum metric; the finite product C([a,b];Rn) is therefore complete componentwise (C(K,R) is complete in the supremum metric for every nonempty compact metric space K).

[F4]

If v(t)≤c+M∫0tv(s)ds for continuous v≥0 and constants c,M≥0, then v(t)≤ceMt (Gronwall's integral inequality with variable and constant coefficients).

[F5]

∥u∥L1(0,T)≤T ∥u∥L2(0,T) (Cauchy-Schwarz inequality for L2).

[F6]

The Lebesgue integral is linear on L1; changing an integrand on a null set does not change the integral (The Lebesgue integral is linear on L1(μ)).

[F7]

For 0≤q<1, the geometric series ∑k=0∞qk converges to 1/(1−q) (For ∣r∣<1, ∑k≥0rk=1/(1−r), and for ∣r∣≥1 the series diverges).

[A1]

Countable Choice is assumed only for the almost-everywhere derivative conclusion (The Axiom of Countable Choice (ACω)).

Proof

1.1F1F2F5choosealgebra

For any Lebesgue-integrable vector function h with ∫∥h∥2<∞, write I=∫h. If I=0, the norm inequality is immediate. Otherwise put q=I/∥I∥2. Then ∥I∥2=∫qTh≤∫∣qTh∣≤∫∥h∥2, by [F1], linearity componentwise, and ∥q∥2=1. Thus the vector integral estimate needed below holds for these Lebesgue integrands. Now put g=Bu∈L1(0,T;Rn); this follows from B∈L∞, u∈L2, and [F5]. Choose a finite partition 0=t0<⋯<tN=T with ∥A∥∞(tj+1−tj)<1 on each subinterval when ∥A∥∞>0; if ∥A∥∞=0, use N=1. Given the already constructed value x(tj), define Tz(t)=x(tj)+∫tjt(A(s)z(s)+g(s))ds on C([tj,tj+1];Rn). By [F2], T maps continuous functions to continuous functions, and the vector-integral estimate just proved gives ∥Tz−Tw∥∞≤qj∥z−w∥∞ with qj=∥A∥∞(tj+1−tj)<1.

2.1F3F7step 1.1algebrainduction

Starting from the constant function z0=x(tj), let zk+1=Tzk. Then ∥zk+1−zk∥∞≤qjk∥z1−z0∥∞. By [F7], the geometric majorant has finite sum, so the iterates are Cauchy in the supremum norm. Each coordinate converges uniformly by [F3], and the finite coordinate limit is a continuous vector function z. The integral estimate in step 1.1 makes T continuous in the supremum norm, hence z=Tz. If z,w are two fixed points, ∥z−w∥∞≤qj∥z−w∥∞, so z=w. Solving the finitely many subintervals in order gives one continuous solution on [0,T], and the same uniqueness on each subinterval proves global uniqueness.

3.1A1F2F6step 2.1

The integrand Ax+Bu lies in L1. Its indefinite integral is absolutely continuous by [F2], as required in the Statement. Under [A1], the L1 fundamental theorem in [F2] differentiates the integral equation almost everywhere and yields x˙=Ax+Bu. The same equation is independent of the chosen representatives of A,B,u by [F6].

3.2F4F5step 1.1step 2.1algebra

From the integral equation and step 1.1, ∥x(t)∥2≤∥x0∥2+∥B∥∞∥u∥L1+∥A∥∞∫0t∥x(s)∥2ds. Apply [F4] with c=∥x0∥2+∥B∥∞∥u∥L1 and then [F5]; this gives the displayed supremum bound.

4.1F6step 2.1step 3.2algebra∎

Linearity of the integral [F6] shows that a linear combination of two zero-initial-state solutions is the solution for the same linear combination of controls; uniqueness from step 2.1 makes the zero-initial-state map linear. Step 3.2 with x0=0 bounds this linear map in the L2 and supremum norms, while the fixed initial-state contribution is independent of u. Hence the full map is affine and bounded as claimed.

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2

Statement

Assume the Axiom of Countable Choice.

Let Uc⊂Rm be nonempty, compact and convex, and let Uc be the pointwise admissible set in Finite-horizon bounded-control linear-quadratic ODE problem. If uk∈Uc and uk⇀u weakly in real L2(0,T;Rm), then u∈Uc. Thus Uc is weakly sequentially closed.

Facts & Assumptions

Given: Countable Choice, a finite horizon T>0, a nonempty compact convex set Uc⊂Rm, its pointwise admissible set Uc, and a weakly convergent sequence in real L2(0,T;Rm).

[F1]

Uc={u∈L2:u(t)∈Uc for almost every t} (Finite-horizon bounded-control linear-quadratic ODE problem). The pairing ∫qTw is well-defined for vector-valued L2 classes and bounded by ∥q∥2∥w∥2: apply Euclidean Cauchy--Schwarz pointwise and scalar L2 Cauchy--Schwarz to the norm functions (Cauchy-Schwarz ∣⟨x,y⟩∣≤∥x∥2∥y∥2 with its equality case, the triangle inequality for ∥⋅∥2, the parallelogram law and polarisation, Cauchy-Schwarz inequality for L2).

[F2]

Weak convergence means convergence under every bounded linear functional; by [F1], w↦∫EqTw is bounded on L2 whenever E⊂[0,T] is measurable (Weak convergence of nets and sequences).

[F3]

A continuous real function on a nonempty compact metric space attains its minimum (A continuous real-valued function on a nonempty compact metric space is bounded and attains a greatest and a least value).

[F4]

The Lebesgue integral is linear on L1, and the nonnegative integral is monotone (The Lebesgue integral is linear on L1(μ), Monotonicity and nonnegative homogeneity of the nonnegative integral).

[F6]

Under Countable Choice, Lebesgue measurable sets form a sigma-algebra and a countable union of measurable null sets is null, by countable subadditivity (Assuming countable choice, L(Rn) is a sigma-algebra containing every elementary set and λn is a complete measure extending elementary volume, Finite and countable subadditivity of measures).

Given: The set and sequence in the Statement.

Proof

Given: The set and sequence in the Statement.

1.1F1F3F5choosealgebra

For q∈Rm set h(q)=sup⁡c∈UcqTc, which is finite because Uc is compact and hence bounded. If z∉Uc, [F3] gives a nearest point y∈Uc to z. For each c∈Uc and 0<θ≤1, convexity gives y+θ(c−y)∈Uc; minimality of y implies ∥z−y−θ(c−y)∥22≥∥z−y∥22, and division by θ followed by θ↓0 gives (z−y)T(c−y)≤0. Thus q0=z−y satisfies q0Tz−h(q0)≥∥z−y∥22>0. If Mc=sup⁡c∈Uc∥c∥2, then ∣h(q)−h(q0)∣≤Mc∥q−q0∥2 and ∣(q−q0)Tz∣≤∥q−q0∥2∥z∥2. By [F5], rational vectors are dense in Euclidean Rm, so one can choose rational q close enough to q0 that qTz>h(q). Therefore a point z belongs to Uc exactly when qTz≤h(q) for every rational vector q.

1.2A1F1F2F4givenalgebra

Fix a rational q. Every uk is in Uc, so h(q)−qTuk(t)≥0 almost everywhere. For any measurable E⊆[0,T], the test function q1E lies in L2 because T<∞; weak convergence, [F2], and [F4] give ∫EqTu dt=lim⁡k∫EqTuk dt≤h(q)∣E∣. If qTu>h(q) on a set of positive measure, then for some integer r≥1 the measurable set Er={t:qTu(t)≥h(q)+1/r} has positive measure, contradicting the integral inequality with E=Er. Hence qTu(t)≤h(q) almost everywhere.

2.1A1F1F5F6step 1.1step 1.2algebra∎

The rational vectors form a countable set by [F5], so the exceptional null sets from step 1.2 have a null union by [A1, F6]. Outside that union all rational support inequalities hold simultaneously; step 1.1 then gives u(t)∈Uc almost everywhere. This is exactly u∈Uc.

DefinitionDefinition: Literature-sourcedProof: Not applicablejudge pass (gpt-6-luna)Open item page →

Time meshes and piecewise-constant control parameterization

Definition

For the horizon [0,T] of Finite-horizon bounded-control linear-quadratic ODE problem, a time mesh is a finite partition 0=t0<t1<⋯<tN=T with N≥1. Its cell widths are hj=tj+1−tj>0 and its mesh size is ∣Δ∣=max⁡0≤j<Nhj. A piecewise-constant control vector is (u0,…,uN−1) and represents the measurable control uΔ(t)=uj for t∈[tj,tj+1); its value at T is immaterial in L2. If uj∈Uc for every j, then uΔ∈Uc. A mesh family is refining when its mesh sizes tend to zero.

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

Weakly convergent bounded controls have uniformly convergent states

Statement

For the data of Finite-horizon bounded-control linear-quadratic ODE problem, if uk,u∈Uc and uk⇀u weakly in L2(0,T;Rm), then xuk→xu uniformly on [0,T].

Facts & Assumptions

Given: The bounded measurable linear state equation, the compact control set Uc, and a sequence uk⇀u in the pointwise admissible set.

[F1]

The state map has a unique continuous solution and its zero-initial-state part is bounded and linear from L2 to C([0,T];Rn) (The bounded measurable linear ODE has a unique affine state map).

[F2]

Every control in Uc satisfies ∥uk(t)∥2≤Mc:=sup⁡v∈Uc∥v∥2<∞ almost everywhere (Finite-horizon bounded-control linear-quadratic ODE problem and compactness of Uc).

[F3]

Weak convergence means convergence under every bounded linear functional on L2 (Weak convergence of nets and sequences).

[F4]

For a Lebesgue-integrable vector function h, the componentwise integral obeys ∥∫h∥2≤∫∥h∥2: if I=∫h≠0, test the integral against I/∥I∥2 and use componentwise linearity, Euclidean Cauchy--Schwarz, scalar integral monotonicity, and ∣∫qTh∣≤∫∣qTh∣ (The Lebesgue integral is linear on L1(μ), Cauchy-Schwarz ∣⟨x,y⟩∣≤∥x∥2∥y∥2 with its equality case, the triangle inequality for ∥⋅∥2, the parallelogram law and polarisation, The modulus of an integral is bounded by the integral of the modulus, Monotonicity and nonnegative homogeneity of the nonnegative integral); if I=0 the bound is immediate.

Proof

1.1F1F2F4algebra

By [F1] and [F2], the states have a common bound Mx in supremum norm. For s,t∈[0,T], the integral equation and [F4] give ∥xuk(t)−xuk(s)∥2≤L∣t−s∣, where L:=∥A∥∞Mx+∥B∥∞Mc. The same bound holds for xu.

1.2F1F3

For each fixed t, evaluation at t composed with the bounded linear zero-initial-state map in [F1] is a bounded linear functional on L2. Thus [F3] gives xuk(t)→xu(t) coordinatewise.

2.1step 1.1step 1.2choosealgebra∎

If L=0, step 1.1 makes each state constant, and step 1.2 gives uniform convergence. If L>0, fix ε>0 and choose a finite partition of [0,T] with mesh smaller than ε/(3L). By step 1.2 and finiteness of its nodes, there is an index after which ∥xuk−xu∥2<ε/3 at every node. Any t is within the mesh of a node, so step 1.1 gives ∥xuk(t)−xu(t)∥2≤L∣t−tj∣+∥xuk(tj)−xu(tj)∥2+L∣t−tj∣<ε. Hence the convergence is uniform.

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

Cell averages give a strong recovery sequence for compact convex controls

Statement

Assume the Axiom of Countable Choice.

Assume the constraint set in Finite-horizon bounded-control linear-quadratic ODE problem is only the pointwise box F=Uc. For the uniform mesh 0=t0<⋯<tN=T, h=T/N, define PNu on [tj,tj+1) by h−1∫tjtj+1u(s)ds. Then PNu∈Uc for every u∈Uc, PNu is piecewise constant, and ∥PNu−u∥L2→0 as N→∞. This recovery statement need not hold for additional state or terminal constraints unless they are separately shown to be preserved or approximated.

Facts & Assumptions

Given: Countable Choice, T>0, a nonempty compact convex Uc⊂Rm, its admissible control set, and the uniform meshes in Time meshes and piecewise-constant control parameterization.

[F1]

Finite linear combinations of interval indicators are dense in scalar L2(R) under Countable Choice; applying this componentwise gives density of finite vector-valued interval step functions, and extending by zero applies it on (0,T) (Finite linear combinations of box indicators are dense in Lp(Rn) for 1≤p<∞, The Axiom of Countable Choice (ACω)).

[F2]

The componentwise Lebesgue vector integral is linear. For h∈L2(I;Rm) on a cell I of length hI, put Ih=∫Ih. If Ih≠0, then q=Ih/∥Ih∥2 satisfies ∥Ih∥2=∫IqTh≤∫I∥h∥2≤hI∥h∥L2(I), using pointwise Euclidean Cauchy--Schwarz, monotonicity, scalar Cauchy--Schwarz, and componentwise linearity; the zero case is immediate (The Lebesgue integral is linear on L1(μ), Cauchy-Schwarz ∣⟨x,y⟩∣≤∥x∥2∥y∥2 with its equality case, the triangle inequality for ∥⋅∥2, the parallelogram law and polarisation, Cauchy-Schwarz inequality for L2, The modulus of an integral is bounded by the integral of the modulus, Monotonicity and nonnegative homogeneity of the nonnegative integral).

[F3]

A continuous distance function attains its minimum on the nonempty compact set Uc (A continuous real-valued function on a nonempty compact metric space is bounded and attains a greatest and a least value).

[F4]

For v,w∈L2(0,T;Rm), the pointwise Euclidean triangle inequality gives ∥v+w∥2≤∥v∥2+∥w∥2. Squaring, integrating by monotonicity, and applying scalar Minkowski to the scalar functions ∥v(⋅)∥2 and ∥w(⋅)∥2 yields ∥v+w∥L2≤∥ ∥v(⋅)∥2+∥w(⋅)∥2 ∥L2≤∥v∥L2+∥w∥L2 (Cauchy-Schwarz ∣⟨x,y⟩∣≤∥x∥2∥y∥2 with its equality case, the triangle inequality for ∥⋅∥2, the parallelogram law and polarisation, Monotonicity and nonnegative homogeneity of the nonnegative integral, Minkowski's inequality for integrals, including p=∞).

Proof

1.1F2F3givenalgebra

On each interval Ij=[tj,tj+1], let mj=h−1∫Iju(s)ds. If mj∉Uc, compactness and [F3] give a nearest point y∈Uc. For every c∈Uc, the segment y+θ(c−y) belongs to Uc for 0≤θ≤1; minimality of y gives ∥mj−y−θ(c−y)∥22≥∥mj−y∥22. Divide by θ>0 and let θ↓0 to get (mj−y)T(c−y)≤0. With q0=mj−y≠0, this implies q0Tmj>sup⁡c∈Ucq0Tc. But q0Tu(s)≤sup⁡c∈Ucq0Tc almost everywhere, so integration contradicts the strict inequality. Thus every cell average lies in Uc and PNu is pointwise admissible.

1.2F2F3F4algebra

For any w∈L2, [F2] on a cell Ij gives h∥h−1∫Ijw∥22≤∫Ij∥w(s)∥22ds; summing proves ∥PNw∥2≤∥w∥2. For an interval indicator, PN agrees with it on cells not meeting an endpoint, and at most two endpoint cells contribute to the squared error, at most 2h. By linearity of PN and the triangle inequality [F4], PNs→s for every finite linear combination s of interval indicators.

2.1F1F4step 1.2algebra∎

Fix u∈L2 and ε>0. By [F1] choose such an interval step function s with ∥u−s∥2<ε. The contraction bound in step 1.2 and the triangle inequality [F4] give ∥PNu−u∥2≤2ε+∥PNs−s∥2. Taking N→∞ yields lim sup⁡N∥PNu−u∥2≤2ε. Since ε is arbitrary, PNu→u strongly in L2.

DefinitionDefinition: Literature-sourcedProof: Not applicableOpen item page →

Runge–Kutta tableaux and stage collocation equations

Definition

Let s≥1 be a stage count, A=(aik)∈Rs×s, and b,c∈Rs satisfy ci=∑k=1saik for each i. This is a (possibly implicit) Runge–Kutta tableau. On mesh cell [tj,tj+1] with width hj, a start state Xj,0 and piecewise-constant control uj, define stage times tj,i=tj+cihj and the collocation stage equations Xj,i=Xj,0+hj∑k=1saikf(tj,k,Xj,k,uj),i=1,…,s. The equations are admissibly defined only for Xj,0∈Ωx, uj∈Ωu, and stage inputs (tj,i,Xj,i,uj)∈[0,T]×Ωx×Ωu for every i, using the domains in Finite-horizon ODE optimal-control transcription data. A transcription procedure must check these memberships before each query of f or L, including trial stages of an implicit solve, and report a stage-time-domain failure for an invalid time or a stage-domain failure for an invalid state or control without making that query. The corresponding endpoint equation is Xj+1,0=Xj,0+hj∑i=1sbif(tj,i,Xj,i,uj). In a finite transcription, an implicit tableau's coupled stage residuals are solved internally and the stage variables are eliminated from the outer NLP; the procedure returns the nonlinear stage-solve status and residuals. The quadrature contribution of the cell is hj∑i=1sbiL(tj,i,Xj,i,uj). This definition asserts no stage-solution existence, uniqueness, order, stability, or error bound. If A is strictly lower triangular, evaluate stages in increasing order i=1,…,s: form Xj,i=Xj,0+hj∑k<iaikFj,k, check the stated time-state-control memberships, and then evaluate Fj,i=f(tj,i,Xj,i,uj), reporting an unavailable value as a stage-evaluation failure. This uses the explicit tableau coefficients and algebraic recursion of Explicit Runge–Kutta tableaus, stage maps, and failure status, with the finite-horizon domain checks specified here; it does not invoke that item's open-time-domain stage map or require an extension of f beyond [0,T].

DefinitionDefinition: Literature-sourcedProof: Not applicablejudge pass (gpt-6-luna)Open item page →

Continuous adjoint equation for the linear-quadratic ODE

Definition

For the data of Finite-horizon bounded-control linear-quadratic ODE problem and an admissible control u with state xu, a continuous LQR adjoint is a curve p:[0,T]→Rn whose coordinates are absolutely continuous in the scalar sense of Absolute continuity on a compact interval, satisfying, almost everywhere,

−p˙(t)=A(t)Tp(t)+Q(t)(xu(t)−xd(t)),p(T)=P(xu(T)−xT).

The equation defines the adjoint notion without asserting existence. Existence and uniqueness for each admissible control are established under Countable Choice by The backward LQR adjoint equation has a unique solution ↗. This sign convention is the one for the minimization Hamiltonian H(t,x,p,u)=L(t,x,u)+pT(A(t)x+B(t)u).

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

Under Countable Choice, the LQR objective is weakly lower semicontinuous

Statement

Assume the Axiom of Countable Choice.

For the data of Finite-horizon bounded-control linear-quadratic ODE problem, if uk∈Uc and uk⇀u weakly in L2(0,T;Rm), then J(u)≤lim inf⁡k→∞J(uk).

Facts & Assumptions

Given: Countable Choice, the LQR data, the associated costs and states, and a weakly convergent sequence uk⇀u in real L2.

[F1]

The state and cost are those of Finite-horizon bounded-control linear-quadratic ODE problem; Q(t)⪰0, P⪰0, and R(t)⪰rI almost everywhere.

[F2]

Weak convergence of controls in Uc implies uniform convergence of their states (Weakly convergent bounded controls have uniformly convergent states).

[F3]

The pairing ⟨v,w⟩=∫0Tv(t)Tw(t)dt is well-defined on vector-valued L2 classes. Pointwise Euclidean Cauchy--Schwarz followed by scalar L2 Cauchy--Schwarz gives ∣⟨v,w⟩∣≤∥v∥2∥w∥2 (Cauchy-Schwarz ∣⟨x,y⟩∣≤∥x∥2∥y∥2 with its equality case, the triangle inequality for ∥⋅∥2, the parallelogram law and polarisation, Cauchy-Schwarz inequality for L2).

[F4]

Under Countable Choice, the pointwise admissible set Uc is weakly sequentially closed (Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2).

Proof

1.1A1F1F2F4algebra

By [A1] and [F4], the weak limit u belongs to Uc, so [F2] applies. Put ek=xuk−xd and e=xu−xd; their difference ek−e=xuk−xu tends to zero uniformly. Since Q is essentially bounded, the estimate ∣aTQ(t)a−bTQ(t)b∣≤∥Q(t)∥2(∥a∥2+∥b∥2)∥a−b∥2 shows that ∫0TekTQek dt→∫0TeTQe dt. The terminal terms converge by the same estimate with P and xuk(T)→xu(T).

1.2F1F3givenalgebra

Let Rv=R(⋅)v(⋅). The bounds on R imply ∥Rv∥2≤M∥v∥2 and ⟨Rv,v⟩≥0; symmetry gives ⟨Rv,w⟩=⟨v,Rw⟩. For every fixed w∈L2, ⟨Ruk,uk⟩≥2⟨Ruk,w⟩−⟨Rw,w⟩, because the difference is ⟨R(uk−w),uk−w⟩≥0. The right-hand side converges to 2⟨Ru,w⟩−⟨Rw,w⟩ by weak convergence, as [F3] makes v↦⟨Rv,w⟩=⟨v,Rw⟩ bounded. Taking the supremum over w gives lim inf⁡k⟨Ruk,uk⟩≥⟨Ru,u⟩, with equality in the supremum at w=u.

2.1step 1.1step 1.2algebra∎

The state and terminal cost terms converge by step 1.1, while the control quadratic term is lower semicontinuous by step 1.2. Multiplying by 1/2 and adding these three terms gives J(u)≤lim inf⁡kJ(uk).

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

AC zero-derivative constancy and integrable-derivative reconstruction under Countable Choice

Statement

Assume Countable Choice (The Axiom of Countable Choice (ACω)) and let a≤b.

  1. If F:[a,b]→R is absolutely continuous and F′=0 almost everywhere on (a,b), then F is constant.
  2. Let n≥1, let y:[a,b]→Rn have absolutely continuous coordinates, and let h∈L1([a,b];Rn). If yj′=hj almost everywhere for each coordinate j, then, for every t∈[a,b], y(t)=y(a)+∫ath(s) ds. Here h∈L1([a,b];Rn) means that each coordinate hj is Lebesgue integrable, and the integral is the componentwise Lebesgue integral. For a=b it is zero.

Facts & Assumptions

Given: Countable Choice, a compact interval, and the scalar or vector data in the Statement.

[F1]

Absolute continuity controls sums of absolute endpoint increments over finite families with pairwise disjoint interiors and sufficiently small total length (Absolute continuity on a compact interval).

[F2]

Every gauge on a compact interval admits one finite fine tagged partition; every cell lies in its tag's open gauge neighborhood (Cousin's lemma: every gauge on a compact interval admits a fine tagged partition, Gauges and gauge-fine tagged partitions of a compact interval).

[F3]
[F4]

Under Countable Choice, Lebesgue measure is complete, monotone and additive on disjoint measurable sets and agrees with interval length; finite sets are null and finite unions of null sets are null (Assuming countable choice, L(Rn) is a sigma-algebra containing every elementary set and λn is a complete measure extending elementary volume, Assuming countable choice, Lebesgue outer measure is an outer measure that restricts to elementary volume).

[F6]

For hj∈L1, its indefinite Lebesgue integral is absolutely continuous and, under Countable Choice, has derivative hj almost everywhere (The indefinite integral of an L1 function is absolutely continuous, The indefinite integral of an L1 function is differentiable almost everywhere).

Proof

1.1givenF1F3F4choose

If a=b, both conclusions hold directly. Otherwise fix a≤s<t≤b and ε>0 for claim 1. Let E be a null exceptional set for F′=0 on [s,t], enlarged by s,t; it is null by [F4]. Restricting [F1] to [s,t], choose d>0 so that total interval length below d implies total absolute increment below ε/2. Put η=ε/(2(t−s+1)). By [F3], choose one open U⊇E with λ(U)<d.

2.1F2F5F7step 1.1construct

For x∉E, define k(x) as the least k∈N0 such that ∣F(y)−F(x)∣≤η∣y−x∣ whenever y∈[s,t] and ∣y−x∣<2−k. This set is nonempty by F′(x)=0, [F7] and [F5], including y=x by equality. For x∈E, instead take the least k with (x−2−k,x+2−k)⊆U; openness and [F5] give existence. Set γ(x)=2−k(x). These uniquely specified least integers define one positive gauge; no arbitrary pointwise radius selections are needed. Obtain one finite γ-fine partition {([xi−1,xi],ξi)}i=1m from [F2].

3.1F1F4step 1.1step 2.1algebra

Cells tagged in E lie in U. Their interiors are disjoint, and their total length is the measure of their finite union, since shared endpoints form a finite null set. By [F4] this sum is at most λ(U)<d, so [F1] bounds their total absolute F-increment by ε/2; for an empty family the sum is zero.

4.1F2step 1.1step 2.1step 3.1algebra

For every other cell, strict fineness and step 2.1 give ∣F(xi)−F(xi−1)∣≤∣F(xi)−F(ξi)∣+∣F(ξi)−F(xi−1)∣≤η(xi−xi−1), because the tag lies in the cell. The sum over these cells is at most η(t−s)<ε/2. Telescoping all cells and applying step 3.1 yields ∣F(t)−F(s)∣<ε. Arbitrary positive ε gives equality, and arbitrary s,t prove claim 1.

5.1givenF1F4F6F7step 4.1algebra∎

For claim 2 with a<b, fix a coordinate j and put Ij(t)=∫athj(s) ds. By [F6], Ij is absolutely continuous and Ij′=hj almost everywhere. The function Hj=yj−yj(a)−Ij is absolutely continuous: for each positive tolerance use the [F1] moduli for yj,Ij at half that tolerance and take their minimum. Outside the union of the two exceptional null sets, [F7] gives Hj′=0. Claim 1 makes Hj constant, and Hj(a)=0, so yj(t)=yj(a)+Ij(t) for all t. Applying this argument to the finitely many coordinates proves the displayed vector identity.

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

The backward LQR adjoint equation has a unique solution

Statement

Assume the Axiom of Countable Choice.

For every LQR data set in Finite-horizon bounded-control linear-quadratic ODE problem and every admissible control u, the adjoint in Continuous adjoint equation for the linear-quadratic ODE exists and is unique.

Facts & Assumptions

Given: Countable Choice; the bounded measurable matrices A,Q, state xu, target xd∈L2, and terminal value P(xu(T)−xT).

[F1]

The linear state lemma supplies a unique absolutely continuous solution of its Volterra integral equation for C,D∈L∞ and v∈L2; under Countable Choice this constructed solution also satisfies y˙=C(t)y+D(t)v(t) almost everywhere (The bounded measurable linear ODE has a unique affine state map, The Axiom of Countable Choice (ACω)).

[F2]

The adjoint is defined by −p˙=ATp+Q(xu−xd) and p(T)=P(xu(T)−xT) (Continuous adjoint equation for the linear-quadratic ODE).

[F3]

Under Countable Choice, an absolutely continuous vector curve with known L1 derivative equals its initial value plus the componentwise Lebesgue integral of that derivative (AC zero-derivative constancy and integrable-derivative reconstruction under Countable Choice).

[F4]

An absolutely continuous scalar function is continuous, and a continuous scalar function on a compact interval is bounded; these apply to each of the finitely many coordinates (C1 implies Lipschitz, Lipschitz implies absolutely continuous, and absolutely continuous implies continuous and bounded variation, A continuous real function on a compact subset of R is bounded).

[F5]

On the finite horizon, ∥g∥L1≤T ∥g∥L2 componentwise (Cauchy-Schwarz inequality for L2).

[F6]

The reflection τ(s)=T−s is a C1 diffeomorphism of (0,T) onto itself with ∣τ′(s)∣=1. The L1 change-of-variables formula therefore preserves integrals and null sets under τ, so reflection preserves the L2 and L∞ classes used below (A C^1 diffeomorphism satisfies the change-of-variables formula for L^1 functions).

Proof

1.1F1F2F4F6givenconstruct

The forcing g(s):=Q(T−s)(xu(T−s)−xd(T−s)) lies in L2(0,T;Rn) by [F6]: Q is essentially bounded, xu is continuous on a compact interval and hence bounded, and xd∈L2. Also C(s):=A(T−s)T∈L∞ by [F6]. Apply [F1] with D(s)=I and initial value q(0)=P(xu(T)−xT) to obtain an absolutely continuous q satisfying the forward Volterra integral equation and q˙=Cq+g almost everywhere.

2.1F6step 1.1F2algebra

Set p(t)=q(T−t). Each coordinate remains absolutely continuous because reflection preserves interval lengths and disjoint interiors in the defining finite-family condition of Absolute continuity on a compact interval. At points where the coordinate derivatives exist, the difference-quotient definition and the chain rule for t↦T−t give p˙(t)=−q˙(T−t); [F6] carries the exceptional null set to a null set. The forward equation for q therefore gives −p˙(t)=A(t)Tp(t)+Q(t)(xu(t)−xd(t)) almost everywhere, and p(T)=q(0)=P(xu(T)−xT). Thus p satisfies [F2].

3.1F1F3F4F5F6step 1.1step 2.1algebra∎

If p~ is another adjoint solution, reflection gives a coordinatewise absolutely continuous q~(s)=p~(T−s) as in step 2.1, with q~(0)=q(0) and q~˙=Cq~+g almost everywhere by [F6]. By [F4], q~ is continuous and bounded componentwise. Since C∈L∞, g∈L2 and [F5] gives g∈L1, the function h=Cq~+g belongs to L1 componentwise. Apply [F3] to obtain q~(s)=q(0)+∫0s(C(r)q~(r)+g(r)) dr for every s. This is exactly the forward Volterra equation used to construct q in step 1.1. Its actual integral-equation uniqueness in [F1] gives q~=q, hence p~=p.

TheoremStatement: AI-adaptedProof: AI-generatedOpen item page →

A bounded-control linear-quadratic ODE has a unique minimizer

Statement

Assume the ultrafilter lemma, Dependent Choice, and Hahn–Banach. For the LQR data of Finite-horizon bounded-control linear-quadratic ODE problem, if the feasible-control set F is nonempty, convex, and weakly sequentially closed, then J attains its minimum on F at a unique control u∗. The direct-method branch uses exactly these three principles; Dependent Choice also supplies Countable Choice for the L2 Hilbert-space/reflexivity suppliers. No use of the full Axiom of Choice is asserted.

Facts & Assumptions

Given: The LQR data, a nonempty convex weakly sequentially closed F⊆Uc, the ultrafilter lemma, Dependent Choice, and Hahn–Banach.

[A1]

The ultrafilter lemma, Dependent Choice and Hahn–Banach are the exact axiom assumptions of the direct-method supplier; the uses below are weak-subsequence extraction and the stated reflexivity route (The ultrafilter extension principle (UL/BPI), The axiom of dependent choice: a relation in which every element is related to something admits an N-indexed chain, The real dominated-extension principle as an additional hypothesis over ZF).

[F1]

Under Countable Choice, real L2(0,T;Rm) with its integral pairing is a Hilbert space (L2 with the integral pairing is a Hilbert space).

[F2]

A real Hilbert space is reflexive under Countable Choice (Hilbert spaces are reflexive).

[F3]

Dependent Choice implies Countable Choice (Dependent choice implies countable choice).

[F4]

Under the ultrafilter lemma, Dependent Choice and Hahn–Banach, a proper coercive weakly sequentially lower-semicontinuous functional on a nonempty weakly sequentially closed subset of a real reflexive Banach space attains its infimum (The direct method in a reflexive Banach space).

[F5]

Under Countable Choice (supplied by Dependent Choice through [F3]), the pointwise control set is weakly sequentially closed; additional path/terminal constraints are included only through the assumed weakly sequentially closed set F (Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2, Finite-horizon bounded-control linear-quadratic ODE problem).

[F6]

The quadratic objective J is weakly lower semicontinuous (Under Countable Choice, the LQR objective is weakly lower semicontinuous).

[F7]

The state map is unique, affine, and bounded from L2 to continuous states (The bounded measurable linear ODE has a unique affine state map).

Proof

1.1A1F1F2F3

By [A1] and [F3], Countable Choice is available. Hence [F1] makes L2(0,T;Rm) a real Hilbert space and [F2] makes it reflexive.

1.2F5F7givenalgebra

The set F is nonempty by hypothesis and weakly sequentially closed by [F5]. For u∈F, every state and terminal quadratic term in J is nonnegative, while R(t)⪰rI gives J(u)≥r2∥u∥22. The cost is finite on F by [F7], so J is proper and coercive there.

2.1A1F1F2F4F6step 1.1step 1.2

By [F6], J is weakly sequentially lower semicontinuous on F. The axioms in [A1] and the reflexivity and admissibility checks in steps 1.1–1.2 verify every hypothesis of [F4]; therefore there exists u∗∈F with J(u∗)=inf⁡u∈FJ(u).

3.1F1F5F7step 1.2step 2.1algebra∎

The state map is affine by [F7]. For 0<θ<1, each positive-semidefinite quadratic state or terminal form satisfies q(θa+(1−θ)b)=θq(a)+(1−θ)q(b)−θ(1−θ)q(a−b)≤θq(a)+(1−θ)q(b). The control form satisfies 12⟨R(θu+(1−θ)v),θu+(1−θ)v⟩=θ2⟨Ru,u⟩+1−θ2⟨Rv,v⟩−θ(1−θ)2⟨R(u−v),u−v⟩. If u≠v, then ⟨R(u−v),u−v⟩≥r∥u−v∥22>0, so J is strictly convex on the convex set F. Two distinct minimizers would have a feasible strict convex combination with smaller cost, contradicting the minimum value established in step 2.1. Thus u∗ is unique.

Remarks

The source notes' direct-method outline is not used as a substitute for lower semicontinuity: Under Countable Choice, the LQR objective is weakly lower semicontinuous proves that requirement for this objective. The proof does not claim an axiom-minimal version without the three principles in [A1].

AlgorithmAlgorithm: AI-adaptedProof: Not applicableOpen item page →

Finite-budget indirect shooting for an interior-control ODE optimality system

Definition

This procedure is restricted to a smooth, unconstrained-interior control branch. Let the smooth data be those of Finite-horizon ODE optimal-control transcription data, with no active path or endpoint constraints apart from the prescribed initial state. Any optional inequality constraints must remain strictly inactive throughout the branch; additional endpoint equalities or active endpoint inequalities require an augmented boundary residual and are outside this procedure. Let H(t,x,p,u)=L(t,x,u)+pTf(t,x,u). Supply a pointwise-defined twice continuously differentiable feedback ψ(t,x,p) on an open tube such that Hu(t,x,p,ψ(t,x,p))=0 and ψ(t,x,p)∈int⁡Uc throughout that tube; differentiability uses the convention of Ck Euclidean maps and diffeomorphisms. Every successful IVP evaluation must keep its trajectory in this tube. If the evaluator cannot certify that condition for a queried trajectory, return inadmissible-interior-branch with no shooting result. Define Hxfix(t,x,p,u):=Dx[L(t,x,u)+pTf(t,x,u)], with the derivative taken holding u fixed, and only then substitute u=ψ(t,x,p). Define z=(x,p)∈R2n and G(t,z)=(f(t,x,ψ(t,x,p))−Hxfix(t,x,p,ψ(t,x,p))),B(zinit,zterm)=(xinit−x0pterm−ϕx(xterm)), where zinit=(xinit,pinit) and zterm=(xterm,pterm). The indirect shooting procedure takes a certified differentiable IVP evaluator for z′=G(t,z), an initial trial z0, residual tolerance τ≥0, and correction cap M∈N0, and calls Finite-budget single shooting for a nonlinear two-point BVP on the square BVP (G,B). It returns that algorithm's trajectory and status without changing the root-tolerance meaning. In particular, root-tolerance-met certifies only the computed boundary residual for the numerical IVP map; it is not an exact BVP, optimality, global-optimality, or discretization-error certificate. If the control is on a boundary or no such smooth feedback is supplied, this procedure is inapplicable.

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

The LQR adjoint identity gives the reduced gradient

Statement

Assume the Axioms of Countable Choice and Dependent Choice.

For the LQR problem of Finite-horizon bounded-control linear-quadratic ODE problem, let u∈Uc, let x=xu, and let p be its adjoint from Continuous adjoint equation for the linear-quadratic ODE. Define the bounded linear map DJ(u):L2(0,T;Rm)→R by DJ(u)[w]=∫0T(B(t)Tp(t)+R(t)u(t))Tw(t) dt. It is the first-order norm derivative of J at u in the precise sense that J(u+w)−J(u)−DJ(u)[w]=O(∥w∥22) as ∥w∥2→0.

Facts & Assumptions

Given: The LQR data, u,w∈L2, the state variation δx=xu+w−xu, and the adjoint p.

[F1]

The state map is affine; its difference δx satisfies δx˙=Aδx+Bw and δx(0)=0 (The bounded measurable linear ODE has a unique affine state map).

[F2]

The adjoint is absolutely continuous and satisfies −p˙=ATp+Q(x−xd) and p(T)=P(x(T)−xT) (Continuous adjoint equation for the linear-quadratic ODE, The backward LQR adjoint equation has a unique solution).

[F3]

For absolutely continuous scalar functions, integration by parts gives ∫0TpTδx˙+p˙Tδx=p(T)Tδx(T)−p(0)Tδx(0) componentwise (Integration by parts for absolutely continuous functions).

[F4]

The integral pairing is bounded by the product of the L2 norms (Cauchy-Schwarz inequality for L2).

[A1]

Proof

1.1F1givenalgebra

By [F1], the state variation δx=xu+w−x is linear in w and satisfies ∥δx∥∞≤C0∥w∥2 for a fixed constant C0. Expanding the running and terminal quadratic forms gives the linear term ∫0T(x−xd)TQδx dt+∫0TuTRw dt+(x(T)−xT)TPδx(T) and a remainder 12∫0T(δxTQδx+wTRw)dt+12δx(T)TPδx(T). Boundedness of Q,R,P and the state-map estimate bound this remainder by C∥w∥22. Thus the displayed linear term is the first-order norm derivative before rewriting its state contributions through the adjoint.

1.2F1F2F3A1algebra

Apply [F3] to p and δx, whose absolute continuity follows from [F1] and [F2]. Using their differential equations gives p(T)Tδx(T)−p(0)Tδx(0)=−∫0T(x−xd)TQδx dt+∫0TpTBw dt. Since δx(0)=0 and p(T)=P(x(T)−xT), rearranging yields ∫0T(x−xd)TQδx dt+(x(T)−xT)TPδx(T)=∫0TpTBw dt.

2.1F1F2F4step 1.1step 1.2algebra∎

Substitute the identity from step 1.2 into the derivative coefficient of step 1.1 and use (pTBw)=(BTp)Tw and (uTRw)=(Ru)Tw because R=RT almost everywhere. The resulting coefficient is DJ(u)[w]. Moreover, BTp+Ru∈L2 since B,R are essentially bounded, p is continuous, and u∈L2; [F4] therefore makes DJ(u) a bounded linear map. The quadratic remainder bound in step 1.1 proves the stated first-order norm expansion.

TheoremStatement: AI-adaptedProof: AI-generatedOpen item page →

LQR minimizers satisfy a feasible-set variational inequality

Statement

Assume the Axioms of Countable Choice and Dependent Choice.

For the LQR data of Finite-horizon bounded-control linear-quadratic ODE problem, let F be nonempty and convex and let u∈F. Put g(t)=B(t)Tp(t)+R(t)u(t), with the adjoint from Continuous adjoint equation for the linear-quadratic ODE. If u minimizes J on F, then ∫0Tg(t)T(v(t)−u(t)) dt≥0(v∈F). Conversely, if this variational inequality holds at u, then u is the unique minimizer on F.

If F=Uc, the variational inequality is equivalent (under Dependent Choice, hence Countable Choice) to the existence of one null set N such that g(t)T(c−u(t))≥0 for every t∉N and every c∈Uc. The pointwise condition is not asserted for additional state or terminal constraints.

Facts & Assumptions

Given: The LQR data, a nonempty convex feasible set F, a control u∈F, its continuous adjoint, and the variational-inequality hypothesis when proving sufficiency or the reverse pointwise implication.

[F1]

The objective has bounded first-order map DJ(u)[w]=∫0T(BTp+Ru)Tw dt, with remainder O(∥w∥22) (The LQR adjoint identity gives the reduced gradient).

[F2]

The state map is affine, and for every u,v∈L2 the quadratic expansion has the exact remainder J(v)−J(u)−DJ(u)[v−u]=12∫0T(δxTQδx+(v−u)TR(v−u))dt+12δx(T)TPδx(T), where δx=xv−xu (Finite-horizon bounded-control linear-quadratic ODE problem, The bounded measurable linear ODE has a unique affine state map).

[F3]

Cauchy–Schwarz makes the integral pairing finite for L2 factors (Cauchy-Schwarz inequality for L2).

[F5]

Under Countable Choice, Lebesgue measurable sets form a sigma-algebra and countable unions of measurable null sets are null by countable subadditivity (Assuming countable choice, L(Rn) is a sigma-algebra containing every elementary set and λn is a complete measure extending elementary volume, Finite and countable subadditivity of measures).

[F6]

The Lebesgue integral is linear on L1, and the nonnegative integral is monotone (The Lebesgue integral is linear on L1(μ), Monotonicity and nonnegative homogeneity of the nonnegative integral).

[A1]

Dependent Choice and Countable Choice are available for the countable dense subset of Uc used in the pointwise equivalence (The axiom of dependent choice: a relation in which every element is related to something admits an N-indexed chain, The Axiom of Countable Choice (ACω), Dependent choice implies countable choice).

Proof

1.1F1givenchoosealgebra

Suppose u minimizes J on F and fix v∈F. Convexity gives uθ=u+θ(v−u)∈F for 0≤θ≤1. Hence (J(uθ)−J(u))/θ≥0 for 0<θ≤1. The first-order expansion [F1] with increment θ(v−u) has quotient DJ(u)[v−u]+O(θ∥v−u∥22), so its limit is DJ(u)[v−u]. This proves the displayed variational inequality.

1.2F3givenalgebra

Suppose the pointwise inequalities hold outside one null set and F=Uc. For any v∈Uc, substitute c=v(t) outside that null set and the null set on which v(t)∉Uc. The vector g=BTp+Ru lies in L2 because B,R are essentially bounded, p is continuous on the compact horizon, and u∈L2; [F3] makes gT(v−u) integrable. Integrating proves the global variational inequality.

1.3F2givenalgebra

Assume the variational inequality at u. For any v∈F, [F2] and Q⪰0, R⪰rI give J(v)−J(u)≥DJ(u)[v−u]+r2∥v−u∥22. The linear term is nonnegative by the assumed inequality; hence J(v)≥J(u), with strict inequality if v≠u. Thus u is the unique minimizer.

2.1A1F3F4F5F6givenchoosealgebra∎

Assume the global variational inequality and suppose no common null set makes all pointwise inequalities true. By [F4] and [A1], choose one point from each rational open box meeting Uc; the resulting countable set D⊆Uc is dense. Define M=⋃d∈D,k≥1Ed,k, where Ed,k={t:g(t)T(d−u(t))≤−1/k}. These sets are measurable, and M is measurable by [F5]. Continuity in c and density show that M is exactly the set where some c∈Uc violates the pointwise inequality, so the absence of a common null set means ∣M∣>0. By [F5], some Ed,k has positive measure. Put v(t)=d on that set and v(t)=u(t) elsewhere. This measurable control lies in Uc. On Ed,k, −g(t)T(d−u(t))≥1/k; [F6] and monotonicity give ∫0TgT(v−u)dt≤−∣Ed,k∣/k<0, contradicting the global variational inequality. Therefore one null set suffices for every c∈Uc.

Remarks

For arbitrary active state or terminal constraints the valid first-order condition is the integral inequality over the feasible set. The multiplier p in the unconstrained adjoint equation alone does not encode normal multipliers for those additional constraints.

CounterexampleConstruction: AI-generatedVerification: AI-generatedOpen item page →

An active terminal constraint invalidates the pointwise control-only variational inequality

Statement refuted

Assume the Axioms of Countable Choice and Dependent Choice, which are the hypotheses used by the reduced-gradient supplier.

The pointwise control-only condition from LQR minimizers satisfy a feasible-set variational inequality holds for an LQR minimizer even when the feasible set includes arbitrary terminal constraints.

Facts & Assumptions

Given: Countable Choice and Dependent Choice. Take T=1, scalar state and control, x(0)=0, dynamics x˙=u, control set Uc=[0,2], and terminal constraint x(1)=0. Let Q=R=1, xd(t)=1, P=0, and xT=0, so F={u∈L2(0,1):0≤u(t)≤2 a.e.,∫01u(t)dt=0}. Use the adjoint and derivative conventions of Continuous adjoint equation for the linear-quadratic ODE and The LQR adjoint identity gives the reduced gradient.

[F1]

A nonnegative function with integral zero vanishes almost everywhere (A nonnegative measurable function has integral 0 exactly when it vanishes almost everywhere).

[F2]

The adjoint satisfies −p˙=x−xd and p(1)=P(x(1)−xT); the reduced gradient is p+u (Continuous adjoint equation for the linear-quadratic ODE, The LQR adjoint identity gives the reduced gradient).

Counterexample

The feasible set in the Given data is determined exactly by the zero terminal-state constraint.

1.1F1given

For every feasible u, [F1] applied to u≥0 and ∫01u=0 gives u=0 almost everywhere. Thus F={0} and u∗=0 is its unique feasible control and hence a minimizer.

2.1A1F2step 1.1algebra

The state is x(t)=0. The adjoint equation becomes −p˙=−1 with p(1)=0, whose unique solution is p(t)=t−1. The reduced gradient at u∗ is therefore g(t)=p(t)=t−1.

3.1step 1.1step 2.1algebra∎

For the pointwise control-only condition, choose the admissible point c=1. Then g(t)(c−u∗(t))=t−1<0 for every t∈[0,1), a set of positive measure. Hence the asserted pointwise condition fails, although the global variational inequality over the singleton F holds with equality.

AlgorithmAlgorithm: AI-adaptedProof: Not applicableOpen item page →

Finite-horizon shooting and Runge–Kutta collocation transcription

Definition

Inputs. Supply pointwise smooth data on [0,T] from Finite-horizon ODE optimal-control transcription data, an original mesh, a piecewise-constant control parameterization, an explicit tableau from Explicit Runge–Kutta tableaus, stage maps, and failure status or a possibly implicit tableau from Runge–Kutta tableaux and stage collocation equations, one of single-shooting, multiple-shooting, or collocation mode, a finite smooth representation of the control constraints when a solver-ready NLP is requested, finite sets of declared path-constraint times, endpoint constraints, the tableau quadrature rule, an initial decision vector z0 and multiplier vector μ0, a stage residual tolerance τs≥0, a quadrature error tolerance τq≥0, a stage Newton correction cap Ms∈N0, and a maximum number of mesh nodes. For the direct linear-stage branch, optionally supply exact pointwise coefficient maps A:[0,T]→Rn×n and B:[0,T]→Rn×m satisfying f(t,x,u)=A(t)x+B(t)u at every queried stage input; only this explicit representation enables that branch. Supply a deterministic derivative evaluator for the actual returned stage maps and resulting finite NLP on an open neighborhood of the queried candidate. On a locally fixed strict stopping branch of the finite stage-iteration procedure, differentiate that finite graph, including when the residual happens to be exactly zero at the queried point. Implicit differentiation as in Implicit differentiation and adjoint formulas under a nonsingular residual Jacobian is permitted only when the selected returned stage map is certified to agree on that neighborhood with the exact local solution branch and its residual Jacobian is nonsingular there; an exact residual at the queried point alone does not establish this agreement. Return derivative-failure when no derivative of the actual returned map is available. Supply a quadrature error evaluator which returns a certified upper bound for the objective quadrature discrepancy or unavailable. Each supplied evaluator returns a value or failure in finite time. An optional trajectory-estimation request supplies the inputs of Finite-budget adaptive Runge–Kutta controller. Xj,i=Xj,0+hj∑k<iaikFj,k,tj,i=tj+cihj,Fj,i=f(tj,i,Xj,i,uj),Φj(Xj,0,uj)=Xj,0+hj∑ibiFj,i.

Mesh and constraints. Check that the original mesh satisfies 0=t0<⋯<tN=T and that all declared constraint and quadrature times lie in [0,T]; if either check fails, return mesh-domain-failure without evaluation. If the original node count exceeds the supplied cap, return mesh-budget-exhausted. Insert every declared path-constraint time not already a node, unless this exceeds the node cap, in which case return mesh-budget-exhausted. Tie each inserted subcell's control to its original containing cell, so the parameterization is unchanged. On the resulting mesh, check all stage times tj+cihj lie in [0,T] before querying f or L; an invalid time returns mesh-domain-failure with no evaluation. Each tableau stage and its quadrature contribution use the control uj of that cell, as in the stage equations below. At a declared path- or endpoint-constraint time that is a mesh node before T, use the right-hand original-cell value from the half-open representative in Time meshes and piecewise-constant control parameterization; at T, use the last original-cell control value unless a separate endpoint-control variable is supplied. Use the same convention at separately declared non-stage quadrature times. An endpoint constraint is evaluated at its declared endpoint. This is finite sampling and does not assert continuous-path feasibility.

Stage evaluation. On each cell write hj=tj+1−tj and uj for its tied constant control. Before forming any stages, check Xj,0∈Ωx and uj∈Ωu; a failed check returns stage-domain-failure with the cell and no objective candidate. For an explicit tableau, form the stages recursively by the displayed equations. Before each query of f or L, check that the time is in [0,T], the state lies in Ωx, and the control lies in Ωu; a failed membership check returns stage-domain-failure, and an unavailable function value returns stage-evaluation-failure with the cell and stage index. Apply the same checks to every declared path-constraint evaluation.

For an implicit tableau, do not leave the collocation stages as outer NLP decision variables. Form the coupled slope residual Rj(K;Xj,0,uj)i=Ki−f ⁣(tj+cihj,Xj,0+hj∑kaikKk,uj),i=1,…,s. With the stage times fixed and already checked in [0,T], its open evaluation domain consists of stage vectors for which every induced stage state lies in Ωx and the cell control lies in Ωu; require Rj to be C1 on this domain. A compact tube used for bounds does not replace this open evaluation domain. If exact coefficient maps A,B were supplied and satisfy f(t,x,u)=A(t)x+B(t)u at every queried stage input, form the finite matrix Mj with blocks (Mj)ik=δikI−hjaikA(tj,i) and right-hand side ri=A(tj,i)Xj,0+B(tj,i)uj. Use exact Gaussian elimination on the stored sample coefficients: scan columns left to right, pivot on the first nonzero entry at or below the current row, swap, eliminate below, and back-substitute. If no pivot is available, return singular-stage-matrix; otherwise form every induced stage state and check every stage time-state-control input belongs to the smooth-data tube. A failed domain check returns stage-domain-failure with the failing cell and stage index, the partial result record, and no objective candidate. If all checks pass, the exact solution of MjK=r is the stage vector and the nonlinear-solve status is exact-linear-stage-solve. In all other smooth cases, form the deterministic initial guess Ki(0)=f(tj,Xj,0,uj) after checking that this query is defined. Before calling Newton, check that the entire seed K(0) belongs to the declared open domain of Rj, equivalently that every induced stage state lies in Ωx and every required control lies in Ωu. If this check fails, return stage-domain-failure with the failing cell and stage index, the partial result record, and no objective candidate. Otherwise call Finite-budget Newton for a square vector residual on Rj with that open evaluation domain, tolerance τs and cap Ms. Record its iterate, residual vector, and exact status for each cell. Only root supplies a stage candidate; it means ∥Rj∥2≤τs, not an exact root unless τs=0. Any other status returns the partial result record with nlp_status=stage-solve-failure, the failing cell, and no objective candidate. On a returned stage vector use Xj,i=Xj,0+hj∑kaikKk and Φj=Xj,0+hj∑ibiKi. A singular stage Jacobian or failed stage query is reported, not interpreted as lack of an exact solution.

Transcription modes. In single shooting, the decision variables are the original-cell controls; set X0,0=x0 and recursively compute Xj+1,0=Φj(Xj,0,uj). In multiple shooting, the decision variables are node states and controls; fix X0,0=x0 and impose the continuity equalities dj=Xj+1,0−Φj(Xj,0,uj)=0 for j=0,…,N−1. In collocation mode, use the same node/control variables, impose the same continuity equalities dj=0, and use solved internal stage states; the collocation equations are solved internally by the implicit-stage procedure above. Explicit stages are likewise internal deterministic evaluations. After every interval map in every mode, check Φj∈Ωx before using it as a later start or evaluating a path constraint, terminal cost, or endpoint constraint; otherwise return stage-domain-failure with no objective candidate. Independently of the computed endpoints and defect residuals, check XN,0∈Ωx before evaluating ϕ(XN,0) or any terminal constraint; in multiple shooting and collocation this node is an independent decision variable even when ΦN−1∈Ωx. Before any endpoint-constraint query, also check every actual state and control argument, including a separately supplied endpoint-control variable, belongs to that function's declared domain. Any failed membership check returns stage-domain-failure with no objective candidate. In every mode the finite feasible set includes uj∈Uc for each original cell. The finite objective is ∑jhj∑ibiL(tj,i,Xj,i,uj)+ϕ(XN,0), and the finite constraints are exactly the fixed initial-state condition, the continuity equalities dj=0 in multiple shooting and collocation, the declared node/time constraints, the represented control constraints, and endpoint constraints. Include every continuity defect in the equality residual h and its corresponding multiplier in ν; in single shooting the initial state and continuity are enforced by recursive elimination. If Uc is available only as a compact set-membership constraint and has no finite smooth representation, return the finite set-constrained model with nlp_status=not-smooth-nlp; the dispatcher must not treat it as an SQP-ready NLP. A QP solver route additionally requires the sampled control constraints to be affine.

Output. Evaluate the supplied initial candidate and return a record containing its ordered decision variables, defect residuals, per-cell implicit-stage residuals, path/endpoint constraint residuals, KKT residuals, and objective value, when available. For equality residual h, inequality residual g≤0, and multiplier pair (ν,λ), report rp=(h,[g]+), rd=∇JN+DhTν+DgTλ, rλ=[−λ]+, and rc=λ⊙g. Include a model that can reevaluate these quantities at a later solver candidate. Return separate nlp_status, per-cell implicit_stage_status, optional ivp_status, quadrature_status, mesh_status, and budget_status fields. A quadrature bound at most τq is bound-met; a larger bound is bound-not-met; an unavailable bound is unavailable. The build-stage budget field is not-run; the solver dispatcher fills its final value. A failed derivative evaluation leaves KKT residuals unavailable with its exact status. An unevaluated optional IVP estimate is not-requested; if requested, report the adaptive controller's exact finite status, not an error certificate.

This direct transcription samples pointwise data; an L∞ equivalence class without a chosen representative and sampling rule is not stage-evaluable. For a single-shooting reduced objective represented as the finite state-step graph of Finite parameterized state-step graphs and objectives, its exact real-arithmetic reduced gradient is given by The reverse recursion is the exact gradient of a finite state-step objective. Agreement with the continuous ODE adjoint gradient is only conditional on the weighted discrete-gradient representation and the separate state, adjoint, derivative-data, endpoint, and quadrature estimates in Discrete and continuous ODE gradients agree to order p under augmented error bounds. The optional adaptive RK estimate is separate from the fixed NLP and its embedded difference is not a certified global error bound. If all construction, stage, sample-domain and objective checks succeed, return nlp_status=constructed for a solver-ready NLP, or nlp_status=not-smooth-nlp for a finite set-constrained model without a smooth control representation; set mesh_status=valid and retain budget_status=not-run. The algorithm makes no continuous-path feasibility, convergence-rate, global-optimality, or unconditioned discrete-adjoint accuracy claim.

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

Exact single and multiple shooting have the same reduced feasible controls

Statement

Fix a mesh, controls u0,…,uN−1, and a successful deterministic Runge–Kutta interval map Φj from Finite-horizon shooting and Runge–Kutta collocation transcription. In the single-shooting NLP, define states recursively from X0,0=x0 and Xj+1,0=Φj(Xj,0,uj). In the multiple-shooting NLP, impose the same initial state and continuity equations. Then projection from the multiple-shooting feasible set onto its control coordinates is a bijection onto the single-shooting feasible controls. Any objective and node constraints that use the same recursively determined states have identical reduced values and feasibility. This is an algebraic equivalence of the discrete NLPs; it is not an equivalence to the continuous ODE problem.

Facts & Assumptions

Given: The fixed mesh, the deterministic interval maps, and controls for which every interval map succeeds.

[F1]

An interval map is available only after its explicit stages or implicit stage residual solve return a successful status; it assigns exactly one deterministic endpoint to that successful start/control pair, and single shooting applies it recursively (Finite-horizon shooting and Runge–Kutta collocation transcription).

[F2]

The multiple-shooting variables satisfy X0,0=x0 and Xj+1,0=Φj(Xj,0,uj) (Finite-horizon shooting and Runge–Kutta collocation transcription).

Proof

1.1F1givenconstruct

Given any control tuple feasible in single shooting, calculate X1,0=Φ0(x0,u0), then each later Xj+1,0=Φj(Xj,0,uj). Uniqueness of each deterministic map makes this recursively defined state tuple well-defined; by construction it satisfies every multiple-shooting continuity equation.

2.1F1F2step 1.1induction

Conversely, a multiple-shooting feasible tuple has fixed X0,0=x0 and satisfies each continuity equation. Induction on j forces its Xj,0 to equal the recursive single-shooting value for the same controls. Hence there is exactly one multiple-shooting state tuple for each feasible control tuple and the projection is bijective.

3.1step 1.1step 2.1givenalgebra∎

Under this bijection the states at all shared nodes agree. Therefore every node constraint has the same value and every objective formed from the same node/stage values is identical. Thus reduced feasibility and objective values coincide.

LemmaStatement: AI-adaptedProof: AI-generatedOpen item page →

A linear-quadratic transcription with affine constraints is a convex QP

Statement

Consider a finite mesh and an LQR model evaluated by a fixed Runge–Kutta tableau, explicit or implicit, whose stage quadrature weights are nonnegative and whose sampled running and terminal quadratic weights are positive semidefinite. If A,B,Q,R,xd are supplied as almost-everywhere equivalence classes, choose pointwise representatives and state the sampling rule at every stage and quadrature time; the finite QP claim concerns only that resulting sampled system, since an equivalence class alone has no stage value. For an implicit tableau, require that each cell's sampled linear stage-residual matrix is nonsingular and use its unique solution. Suppose every control, path, terminal, initial, and shooting/collocation constraint is specified by finitely many affine equalities or inequalities in the transcription variables. Then the finite transcription of Finite-horizon shooting and Runge–Kutta collocation transcription is a convex quadratic program (QP): its objective is a convex quadratic polynomial and its equality and inequality constraints are affine. This is the finite NLP/QP branch used with the convex models in Conic, LP, and convex QP primal-dual models.

This algebraic claim does not make an L∞ equivalence class a valid input to the pointwise smooth-data procedure. If that procedure is called, its separate pointwise-domain and smoothness hypotheses must also hold; otherwise this lemma concerns only the specified finite sampled equations.

Facts & Assumptions

Given: A finite mesh, chosen pointwise representatives and a sampling rule for any equivalence-class data, linear dynamics, a fixed explicit or implicit Runge–Kutta tableau, nonnegative stage weights, positive-semidefinite sampled quadratic cost weights, nonsingular sampled stage matrices when implicit stages are eliminated, and affine constraints.

[F1]

An explicit RK stage is a finite affine recursion in prior stages. For an implicit linear cell, the slope equations have matrix Mik=δikI−haikA(ti) and right-hand side A(ti)X0+B(ti)u; if M is nonsingular, their unique solution and the endpoint are affine in (X0,u) (Explicit Runge–Kutta tableaus, stage maps, and failure status, Runge–Kutta tableaux and stage collocation equations).

[F2]

The transcription uses the explicit recursions or solved implicit interval maps for the node/defect equations and uses the displayed quadrature objective at the chosen sample values (Finite-horizon shooting and Runge–Kutta collocation transcription).

[F3]

A convex QP has a positive-semidefinite quadratic objective Hessian and affine equalities/inequalities (Conic, LP, and convex QP primal-dual models, Inequality constrained programs, tangent cones, constraint qualifications, and KKT).

Proof

1.1F1F2giveninductionalgebra

On each interval with linear dynamics, an explicit tableau has affine stages by recursion: the first stage is affine in the start and control, and if previous stages are affine then Xi=X0+h∑k<iaikFk and Fi=A(ti)Xi+B(ti)u are affine. For an implicit tableau, the sampled slope equations form the affine system MK=AX0+Bu described in [F1]. Nonsingularity makes every stage and endpoint an affine function of (X0,u); the algorithm's exact linear stage-solve branch reports failure if this matrix is singular. Thus the endpoint/defect equations and any retained stage equations are affine.

2.1F2F3givenstep 1.1algebra∎

Each quadrature term is a nonnegative scalar weight times a positive-semidefinite quadratic form applied to an affine state/control map, hence has positive-semidefinite Hessian; the terminal form has the same property. A finite sum of such Hessians is positive semidefinite, so the objective is convex quadratic. The remaining constraints are affine by hypothesis; thus [F3] identifies the transcription as a convex QP.

TheoremStatement: AI-adaptedProof: AI-generatedOpen item page →

Mesh-consistent LQR minimizers converge to the unique continuous minimizer

Statement

Assume the axiom branch of A bounded-control linear-quadratic ODE has a unique minimizer, and let u∗ be the unique minimizer of the LQR objective J on a nonempty convex weakly sequentially closed feasible set F⊆Uc. For each mesh index N, let FN⊆F be nonempty, and let JN be the discrete transcription objective. Assume there are εN→0 such that ∣JN(v)−J(v)∣≤εN for every v∈FN. Assume also a recovery sequence vN∈FN with ∥vN−u∗∥L2→0. If uN is a global minimizer of JN on FN, then uN⇀u∗ in L2 and xuN→xu∗ uniformly.

For the control-only case F=Uc and piecewise-constant mesh controls, the cell-average lemma supplies the strong recovery sequence. If active path or terminal constraints are present, preservation or recovery of those constraints is an additional hypothesis; node sampling alone does not establish continuous-path feasibility. This theorem is conditional on a uniform objective consistency bound; an embedded adaptive RK difference alone does not provide that bound.

Facts & Assumptions

Given: The LQR data, its unique minimizer, feasible discrete sets, uniform consistency, recovery controls, and global discrete minimizers.

[F1]

The continuous LQR minimizer exists uniquely under the stated closedness and choice-axiom hypotheses (A bounded-control linear-quadratic ODE has a unique minimizer).

[F2]

The control set Uc is bounded in L2 because Uc is compact, and is weakly sequentially closed under Countable Choice (supplied by the theorem's axiom branch) (Finite-horizon bounded-control linear-quadratic ODE problem, Under Countable Choice, pointwise compact convex control constraints are weakly closed in L2).

[F3]

A bounded sequence in a real reflexive Banach space has a weakly convergent subsequence under the ultrafilter lemma, Dependent Choice, and Hahn–Banach (A bounded sequence in a reflexive Banach space has a weakly convergent subsequence).

[F4]

The LQR objective is weakly sequentially lower semicontinuous on Uc (Under Countable Choice, the LQR objective is weakly lower semicontinuous).

[F5]

Weakly convergent controls in Uc have uniformly convergent states (Weakly convergent bounded controls have uniformly convergent states).

[F6]

The state map is affine and bounded from L2 to the supremum norm, so the LQR objective is continuous under strong L2 convergence (The bounded measurable linear ODE has a unique affine state map, Finite-horizon bounded-control linear-quadratic ODE problem).

Proof

1.1F2F3A1givenalgebra

Since uN∈FN⊆Uc and Uc is compact, sup⁡N∥uN∥2≤Tsup⁡c∈Uc∥c∥2<∞. Real L2 is reflexive by [A1], so [F3] gives a weakly convergent subsequence from every subsequence of (uN).

2.1F1F4F6givenstep 1.1algebra

Let a subsequence uNk converge weakly to uˉ. Because each uNk∈F and F is weakly sequentially closed, uˉ∈F. By [F4] and consistency, J(uˉ)≤lim inf⁡kJ(uNk)≤lim sup⁡k(JNk(uNk)+εNk). Global discrete minimality gives JNk(uNk)≤JNk(vNk)≤J(vNk)+εNk. To see J(vNk)→J(u∗), [F6] gives ∥xvNk−xu∗∥∞≤C∥vNk−u∗∥2→0; the control quadratic difference is bounded by M2(∥vNk∥2+∥u∗∥2)∥vNk−u∗∥2, and state and terminal quadratic differences tend to zero by the corresponding bounded-quadratic estimate and uniform state convergence. Hence J(vNk)→J(u∗), so J(uˉ)≤J(u∗).

3.1F1step 1.1step 2.1algebra

Since uˉ∈F and u∗ is the unique minimizer there, step 2.1 forces uˉ=u∗. Every subsequence therefore has a weakly convergent subsubsequence whose limit is u∗. If the full sequence failed to converge weakly to u∗, some bounded linear functional and some positive tolerance would witness failure along a subsequence; a weakly convergent subsubsequence from step 1.1 would contradict that witness. Thus uN⇀u∗.

4.1F5step 3.1∎

Apply [F5] to the weakly convergent admissible controls from step 3.1 to obtain xuN→xu∗ uniformly on [0,T].

TheoremStatement: AI-adaptedProof: AI-generatedOpen item page →

Strong convexity converts transcription objective error into a control bound

Statement

Let u∗ minimize the LQR objective J on a convex feasible set F, with control weight R(t)⪰rI for r>0. Let uN∈F and let vN∈F be a recovered comparison control. Suppose the computed objective JN satisfies ∣JN(w)−J(w)∣≤δN for w=uN,vN, and JN(uN)≤JN(vN)+ηN. If J(vN)≤J(u∗)+ρN, then J(v)−J(u∗)≥r2∥v−u∗∥22 for every v∈F, and 0≤J(uN)−J(u∗)≤2δN+ηN+ρN,∥uN−u∗∥L2≤2(2δN+ηN+ρN)r. The conclusion is conditional on the stated objective consistency and comparison bounds. A raw embedded RK error estimate is not a certified value of δN.

Here are sufficient bounds that derive the two error terms from transcription errors and recovery. Set Cs=e∥A∥∞T∥B∥∞T, Mc=sup⁡c∈Uc∥c∥2, Mx=e∥A∥∞T(∥x0∥2+∥B∥∞TMc), E=TMx+∥xd∥2, and MT=Mx+∥xT∥2. Suppose, for w=uN,vN, a pointwise representative and sampling rule are fixed, JN(w) has the form JN(w)=∑kωNkℓ~N,w(τNk)+12(x~N[w](T)−xT)TP(x~N[w](T)−xT), where ℓ~N,w(t)=12((x~N[w](t)−xd(t))TQ(t)(x~N[w](t)−xd(t))+w(t)TR(t)w(t)), ωNk≥0, ∑kωNk=T, and the chosen samples satisfy ∥Q(τNk)∥2≤∥Q∥∞. Suppose ∥x~N[w]−xw∥∞≤eN, ∥xw(τNk)−xd(τNk)∥2≤EN, ∥xw(T)−xT∥2≤MT, and ∣∑kωNkℓw(τNk)−∫0Tℓw(t)dt∣≤qN, where ℓw(t)=12((xw(t)−xd(t))TQ(t)(xw(t)−xd(t))+w(t)TR(t)w(t)). Then one may take δN=qN+T2∥Q∥∞(2EN+eN)eN+12∥P∥(2MT+eN)eN. If a feasible recovery sequence also satisfies ∥vN−u∗∥2≤σN, then one may take ρN=CJσN, where CJ=∥Q∥∞ETCs+∥P∥MTCs+MTMc, with M any essential upper bound for ∥R(t)∥2. In the control-only case, under Countable Choice the cell-average lemma supplies vN=PNu∗ and σN→0. If u∗ is Lipschitz with constant Lu, then σN=TLuhN is a valid rate for mesh size hN. For a general L2 minimizer, no rate for σN is asserted.

Facts & Assumptions

Given: The LQR model, r>0, a continuous minimizer, two feasible controls, and the finite objective inequalities in the Statement. For the explicit numerical-error estimate, also assume the stated pointwise sampling, state, and quadrature bounds.

[F1]

The state map is affine and bounded from L2 to the supremum norm (The bounded measurable linear ODE has a unique affine state map).

[F2]

Expanding the LQR quadratic forms for d=v−u gives J(v)−J(u)=Gu[d]+12∫0T(δxTQδx+dTRd)dt+12δx(T)TPδx(T), where δx=xv−xu and Gu[d]=∫0T((xu−xd)TQδx+uTRd)dt+(xu(T)−xT)TPδx(T); this follows from [F1] and the definition of J (Finite-horizon bounded-control linear-quadratic ODE problem, The bounded measurable linear ODE has a unique affine state map).

[F3]

For admissible controls, ∥u∥2≤TMc and ∥xu∥∞≤Mx by compactness of Uc and the state-map bound (Finite-horizon bounded-control linear-quadratic ODE problem, The bounded measurable linear ODE has a unique affine state map).

[A1]

Countable Choice is assumed only for the control-only cell-average recovery specialization (The Axiom of Countable Choice (ACω), Cell averages give a strong recovery sequence for compact convex controls).

Proof

1.1F2givenalgebra

Fix v∈F and put d=v−u∗. Convexity gives u∗+θd∈F for 0≤θ≤1. By [F2], J(u∗+θd)−J(u∗)=θGu∗[d]+θ2Rd, where Rd=12∫0T(δxdTQδxd+dTRd)dt+12δxd(T)TPδxd(T). Minimality makes this expression nonnegative for 0<θ≤1; divide by θ and let θ↓0 to get Gu∗[d]≥0. Also Rd≥r2∥d∥22 since Q,P⪰0 and R⪰rI. Taking θ=1 proves J(v)−J(u∗)≥r2∥v−u∗∥22.

1.2givenF3algebra

For the stated sampled objective, subtract the quadrature of ℓw evaluated at the exact state. At every quadrature node, the state-cost difference is bounded by 12∥Q∥∞(2EN+eN)eN; the control-cost summand is unchanged. Nonnegative weights with sum T therefore bound the accumulated state perturbation by T2∥Q∥∞(2EN+eN)eN. The exact-state quadrature discrepancy is at most qN. At T, the terminal quadratic difference is at most 12∥P∥(2MT+eN)eN. Thus ∣JN(w)−J(w)∣≤δN for w=uN,vN with the displayed δN.

2.1givenstep 1.1algebra

The assumed inequalities and consistency give J(uN)≤JN(uN)+δN≤JN(vN)+ηN+δN≤J(vN)+ηN+2δN≤J(u∗)+ρN+ηN+2δN. Subtract J(u∗) and combine with step 1.1 to get the objective-gap bound.

3.1step 1.1step 2.1algebra

Apply the growth inequality of step 1.1 at v=uN. Substitute the upper objective-gap bound from step 2.1, divide by r/2>0, and take nonnegative square roots to obtain the control-error estimate.

4.1A1F1F2F3givenalgebra∎

For any feasible v with ∥v−u∗∥2≤σ, [F2] and [F3] bound the absolute difference of the state running terms by ∥Q∥∞ETCsσ, the terminal terms by ∥P∥MTCsσ, and the control terms by MTMcσ. Hence J(v)−J(u∗)≤CJσ. Under [A1] the cell-average lemma gives strong recovery for the control-only case. If u∗ is Lu-Lipschitz, for each t in a cell its distance from the cell average is at most LuhN, so ∥PNu∗−u∗∥2≤TLuhN. Substitution gives the stated ρN rate and completes the sufficient-estimate branch.

AlgorithmAlgorithm: AI-adaptedProof: Not applicableOpen item page →

Finite-budget barrier or SQP solve for a transcription NLP

Definition

Inputs are a transcription record from Finite-horizon shooting and Runge–Kutta collocation transcription, a primal initial iterate z0 and full multiplier iterate μ0=(ν0,λ0) in the fixed equality/inequality constraint ordering, an optional canonical QP start (x0,y0,s0) with nonnegative primal variables x0, free equality multipliers y0, and nonnegative dual slacks s0, an SQP model builder, and finite nonnegative tolerances τp,τd,τc,τstage,τquad. The stage and quadrature tolerances must match those bound into the transcription record. The KKT tolerances τp,τd,τc bound primal feasibility, stationarity, and multiplier-feasibility/complementarity; in the QP route τc also bounds the primal-dual gap. Also supply finite integer SQP and QP update caps K,N∈N0, positive finite integer penalty/backtracking caps R,Jmax∈N with R,Jmax≥1, merit parameters ρ0>0, γ>1, 0<β,σ<1, and the finite-budget exact-Hessian branch selector and identified active set when that branch is requested. The IVP estimator uses its own declared controller tolerances; its status is not treated as an error certificate.

The SQP model builder is a deterministic finite procedure which, at each queried full state (zk,νk,λk), returns either a failure status or the finite NLP data fk,hk,gk,Dhk,Dgk, its objective gradient, a symmetric positive-definite SQP model matrix Wk when the merit branch is selected, and the exact Lagrangian Hessian when the exact-Hessian branch is selected. The model matrix may depend on the supplied current multiplier vectors. For the exact-Hessian branch with identified active set I, evaluate that Hessian with equality multipliers νk, active inequality multipliers (λk)I, and zero inactive multipliers; its required positivity is the separate reduced-curvature condition of the exact step, not full positive definiteness. It must use gi≤0 and nonnegative inequality multipliers. In the merit branch, the associated quadratic subproblem is exactly min⁡p∇fkTp+12pTWkp subject to hk+Dhkp=0 and gk+Dgkp≤0. For that branch, the builder also supplies the active equality/inequality row data required by L1 merit globalization with finite penalty and backtracking budgets. Solver tolerances are used as follows: τp bounds the norm of equality and positive inequality violations, τd bounds the stationarity residual, and τc bounds multiplier-feasibility and complementarity residuals. The stage and quadrature tolerances are passed to the transcription's corresponding residual and certified-error checks. The IVP estimator uses its own declared controller tolerances and has a separate status; its embedded difference is not a certified error bound. Any called builder, evaluator, canonicalizer, or solver returns a value or failure status in finite time.

First audit the transcription dimensions, sampled domains, and data status fields. If stage construction failed, return the partial record with its stage and NLP statuses and do not call a solver. If the model satisfies A linear-quadratic transcription with affine constraints is a convex QP, map its finite quadratic objective and affine constraints to canonical LP/QP form: replace each free variable zi by zi+−zi− with zi+,zi−≥0; for each affine inequality aiTz+di≤0, add a primal slack ξi≥0 and equality aiTz+ξi=−di; retain existing equalities; and transform the quadratic objective by substitution. The transcription record supplies finite stored coefficient arrays. Canonicalize using exact rational arithmetic on their dyadic values, then round each resulting coefficient once to the nearest normal representable value under Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add, preserving exact zeros; any range failure makes the QP route inapplicable. Check the resulting equality matrix by exact rational row elimination; if it is rank deficient or the conversion is otherwise inadmissible, mark the QP route inapplicable and proceed to SQP. The optional start (x0,y0,s0) is in these converted coordinates and is checked constructively: require every primal coordinate, including each added ξi, and every dual slack coordinate s0 to be strictly positive, and require y0 to be finite with the correct equality dimension. If it is absent or fails this check, record strict-start-unavailable and proceed to SQP; do not infer infeasibility or decide whether some other strict start exists. If it passes, call Finite-budget primal-dual Newton methods for LP, convex QP, and symmetric cones once with centering and fraction-to-boundary parameters both 1/2, ϵp=τp, ϵd=min⁡(τd,τc), ϵg=τc, and cap N. The minimum in ϵd ensures the supplier's single tolerance for both its dual and complementarity residuals meets each requested bound; ϵg separately bounds the certified primal-dual gap. If it returns invalid-input or strict-start-unavailable, record that QP status and proceed to SQP. Return every other status and audited residuals. certified-gap certifies the resulting stored canonical floating-point QP, interpreted as exact dyadic rationals, under Fraction-to-boundary steps preserve positivity and exact primal-dual feasibility certifies a gap; it is not a certificate for the unsampled continuous problem. A residual-candidate remains a candidate. No other QP status is reinterpreted as success.

If the QP route is inapplicable or lacks a supplied strict start, run the SQP branch only when the transcription status is solver-ready constructed; otherwise return its not-smooth-nlp or model-construction status without an SQP call. Initialize (z,ν,λ)=(z0,ν0,λ0) and verify the full multiplier dimensions. An invalid state returns model-build-failure with its last available record. For k=0,1,…,K, in order, query the model builder at the entire current state (zk,νk,λk), propagating any builder failure without changing that state, and compute rp=(hk,[gk]+),rd=∇fk+DhkTνk+DgkTλk,rλ=[−λk]+,rc=(λk,igk,i)i, where positive parts are componentwise. If ∥rp∥≤τp, ∥rd∥≤τd, ∥rλ∥≤τc, and ∥rc∥≤τc, return kkt-residual-met with the current decision and residual record; this is an approximate KKT candidate unless all residuals are exactly zero. If k=K, return budget-exhausted. Otherwise, if the exact-Hessian branch is selected and an active set I has been correctly identified, call Full-step exact-Hessian SQP after active-set identification at the current pair (zk,(νk,(λk)I)) with inactive multipliers set to zero, using the exact Hessian evaluated at that same pair. On its successful full Newton-pair return (z+,μ+), use z+, place the equality and active-inequality components of μ+ into the full vectors (ν,λ), and set inactive inequality components to zero; any failure stops with that status without changing the current state. In the merit branch, call L1 merit globalization with finite penalty and backtracking budgets with the current model Wk, ρ0,γ,β,σ,R,Jmax. On accepted or accepted-soc, use its actual returned accepted point z+, including the SOC displacement when present, and full returned QP multipliers (νQP,λQP) to set (z,ν,λ)=(z+,νQP,λQP) for the next model-builder query. Retain the complete supplier record, including its retained equality basis and selected inequality support. Do not replace the full vectors by reduced support multipliers or infer the true nonlinear active set from QP support. Any other supplier status stops the loop without changing the current state. The exact-Hessian local branch has only the conditional convergence guarantee in Exact-Hessian SQP converges quadratically on the identified active KKT system.

Every return is a result record with the last available decision variables, the full current SQP multiplier vectors when that branch has been reached, its last supplier record when one exists, defect residuals, path/endpoint constraint residuals, KKT residuals, objective value, and separate nlp_status, implicit_stage_status, ivp_status, quadrature_status, mesh_status, and budget_status fields. Fields not reached are marked not-run; failed evaluations carry their failure status and do not supply a candidate value. The finite caps bound the procedure. It does not guarantee a start, solver success, a global solution of a nonconvex problem, continuous-path feasibility from sampled constraints, or a certified approximation error for the continuous ODE problem.

TheoremStatement: AI-adaptedProof: AI-generatedOpen item page →

Exact-Hessian SQP converges locally to a regular transcription KKT point

Statement

Fix a mesh and a finite transcription generated from the pointwise smooth data in Finite-horizon ODE optimal-control transcription data. Suppose its NLP functions have continuous derivatives through order three on an open neighborhood of a KKT point (z∗,μ∗), LICQ holds there, every active inequality multiplier is strictly positive, and the second-order sufficient condition holds on the critical cone. Then, after the correct active set is identified, the exact-Hessian full-step branch using Full-step exact-Hessian SQP after active-set identification is well-defined from a sufficiently close primal-dual start and converges quadratically to (z∗,μ∗). The finite-budget dispatch of Finite-budget barrier or SQP solve for a transcription NLP may terminate before this local convergence is realized.

This also has the following conditional mesh-family conclusion. For each mesh index N, let KN:ZN→YN be the square active-set KKT residual map of a finite transcription, with finite-dimensional normed spaces ZN,YN, and let zN0∈ZN be a reference primal-dual pair. Let Z be a common Banach space containing the continuous primal and multiplier fields, with bounded linear reconstruction maps EN:ZN→Z that use the same fixed norms and satisfy sup⁡N∥EN∥≤CE. Suppose a continuous KKT pair z†∈Z and mesh-consistent constraints satisfy ∥ENzN0−z†∥Z→0 and ∥KN(zN0)∥YN≤εN→0. Suppose the discrete sensitivity maps DKN(zN0):ZN→YN are invertible with ∥DKN(zN0)−1∥≤β uniformly, and DKN is L-Lipschitz on a common radius r about each zN0, with constants independent of N. For all sufficiently large N, require 2βεN≤r and 2β2LεN≤12. Then there is a unique active-set KKT root zN∗ in the radius-2βεN ball, and ∥ENzN∗−z†∥Z≤∥ENzN0−z†∥Z+2CEβεN→0. If these roots satisfy LICQ, strict complementarity, SOSC, and a common local full-step basin for exact-Hessian SQP, then the exact-Hessian iterates from starts in that basin converge quadratically to zN∗ for each such mesh. The varying systems are compared through the reconstruction maps and their fixed norms; this conclusion makes no global optimizer, path-feasibility, or finite-budget convergence claim.

Facts & Assumptions

Given: A fixed smooth finite transcription, a KKT pair, LICQ, strict complementarity, the second-order sufficient condition, a correct identified active set, and an initial primal-dual point sufficiently close to the KKT pair.

[F1]

The transcription is a finite NLP with the objective and constraints returned by Finite-horizon shooting and Runge–Kutta collocation transcription. The C3 regularity of these actual reduced functions on the stated neighborhood is an explicit hypothesis; smooth data alone do not certify a differentiable implicit-stage solve branch (Finite-horizon ODE optimal-control transcription data).

[F2]

The KKT convention is gi≤0 with nonnegative active multipliers (Inequality constrained programs, tangent cones, constraint qualifications, and KKT).

[F3]

The exact-Hessian local SQP theorem gives quadratic convergence for a C2 NLP with LICQ, strict complementarity, SOSC, and locally Lipschitz active-KKT Jacobian (Exact-Hessian SQP converges quadratically on the identified active KKT system).

[F4]

The strict second-order sufficient condition used here is positivity of the Lagrangian Hessian on every nonzero critical-cone direction (Strict second-order positivity on the critical cone gives a strict local minimum).

[F5]

The actual NLP functions are C3 by [F1]. On a closed ball compactly contained in their open C3 neighborhood, their third derivatives are bounded, so their Hessians and the active KKT Jacobian are locally Lipschitz.

[F6]

The active-set KKT Jacobian and full-step exact-Hessian SQP branch have the local properties stated in the fixed-system theorem (Exact-Hessian SQP converges quadratically on the identified active KKT system).

[F7]

Each finite-dimensional normed space ZN is complete (Every finite-dimensional normed space is Banach). A closed ball in ZN is complete: every Cauchy sequence in the ball converges in ZN, and continuity of the norm keeps its limit in the ball. A contraction of a nonempty closed ball into itself therefore has a unique fixed point by A contraction of a nonempty complete metric space into itself has exactly one fixed point, the limit of the iterates from any starting point.

[A1]

For the mesh-family conclusion, the reconstruction, residual-consistency, uniform inverse, uniform Jacobian-Lipschitz, active-set, and common-basin assumptions in the Statement hold.

Proof

1.1F1given

A fixed transcription has finitely many decision variables. By the regularity hypothesis in the Statement and [F1], its actual objective and constraint functions have continuous derivatives through order three on a neighborhood of the KKT point. For an implicit-stage transcription this hypothesis includes the selected local stage-solve branch; no differentiability of that branch is inferred from the smooth-data definition alone.

1.2A1F7algebra

For the mesh-family branch, set AN=DKN(zN0) and TN(z)=z−AN−1KN(z). If εN=0, zN0 is already a root. Otherwise take the closed ball of radius RN=2βεN. The residual bound gives ∥TN(zN0)−zN0∥≤βεN=RN/2. For z in that ball, the uniform Lipschitz bound gives ∥DTN(z)∥=∥I−AN−1DKN(z)∥≤βLRN≤1/2. Thus TN maps the ball into itself and is a contraction. Completeness [F7] gives its unique fixed point zN∗, which is exactly the unique root of KN there and satisfies ∥zN∗−zN0∥≤RN.

2.1F2F3F4F5givenstep 1.1

The KKT map for the identified active set is built from the first derivatives of those objective and constraint functions. Its Jacobian is locally Lipschitz by continuity and local boundedness of their third derivatives in [F5]. The assumed LICQ, strict complementarity, and SOSC from [F4] are exactly the remaining hypotheses of [F3].

3.1F3givenstep 2.1algebra

Apply [F3] to the active KKT system. It provides a neighborhood in which exact-Hessian full Newton steps are defined and converge quadratically from a sufficiently close start, which is the asserted fixed-mesh branch. The dispatcher has a finite outer cap, so it can stop before the local sequence converges.

4.1A1F6step 1.2algebra∎

By boundedness of EN, ∥ENzN∗−z†∥Z≤CE∥zN∗−zN0∥+∥ENzN0−z†∥Z≤2CEβεN+∥ENzN0−z†∥Z, which tends to zero. The assumed LICQ, strict complementarity, SOSC, local Lipschitz conditions, and common basin let [F6] apply at each zN∗; hence each exact-Hessian full-step sequence from that basin converges quadratically.

5 · Examples, counterexamples and false statements

None yet.

Sources