How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Directional Jacobian and Hessian differences retain Taylor and evaluation-noise errors
Statement
Let , be open, , , and with the required line segments contained in . Use the estimators of Forward and central finite-difference Jacobian-vector and Hessian-vector products. For a vector-valued map, means that each component is in . For , suppose each component satisfies for , with ; put . For , suppose for , with ; put . Then
For , set , suppose on , with , and put . For , suppose on , with , and put . Then
If each vector evaluation has Euclidean error at most , the forward evaluation contribution is at most and the central contribution at most (hence also at most ). For a scalar output coordinate on a common probability space, suppose its two square-integrable evaluation noises are centered, with variances and covariance . Their forward-difference noise variance is ; the central formula has the same numerator divided by . If these centered noises are independent and both have variance , then the formulas reduce to forward and central. No variance sum or root-sum-square total-error claim is made without the stated centering and covariance information.
If every evaluation call used in a given estimate has Euclidean error at most a common , then the inexact estimates of Forward and central finite-difference Jacobian-vector and Hessian-vector products satisfy
The central evaluation contribution is at most , so the conservative contribution is also valid for the central estimates.
Facts & Assumptions
Given: The domains, smoothness, component derivative bounds and evaluation-error hypotheses in the statement.
Forward and central finite-difference Jacobian-vector and Hessian-vector products: the exact products and four directional estimators are as stated there; the inexact estimates replace each function or gradient evaluation by its inexact value, with error bounds applying per call.
Repeated derivatives along a line expand by the multinomial formula: for a scalar field on an open set, derivatives of its restriction to an affine line are the corresponding directional partial-derivative sums through order .
Continuous mixed partials of order are invariant under permutations: for a scalar field and , permuting the order of the coordinate differentiations does not change the result.
The Lagrange and Cauchy forms of Taylor's remainder and Taylor polynomials and their remainders: for a real or function on an interval, the remainder after degree or degree is or .
The -norms for rational , and and Each is a norm on , and the induced metrics are exactly , and of the published metric-spaces page: for nonempty finite-dimensional real output vectors, is the Euclidean norm and obeys the triangle inequality and absolute homogeneity.
Moments, variance, and covariance on a probability space and Variance and covariance identities for random variables: variance and covariance are centered second moments, and covariance is symmetric and bilinear on finite linear combinations of square-integrable real random variables.
Expectations factor over finite products of independent random variables: expectations of products of integrable functions of independent real random variables factor into products of expectations.
Absolute value in an ordered field and Basic properties of the absolute value: and for real .
On a probability space, every square-integrable real random variable is integrable: gives .
Proof
Given: The hypotheses listed above.
For each component , [F2] identifies . Apply [F4] through degree on to obtain . By [F8], these absolute values and bounds are nonnegative; squaring preserves their order because when . Sum over and use [F5] and the definition of to obtain the stated Euclidean vector bound.
For either the Jacobian-vector or gradient-difference Hessian-vector estimate, the forward evaluation perturbation is . [F5] bounds its norm by . For the central quotient the denominator is , giving .
For centered square-integrable coordinate noises , [F6] and the definitions of variance and covariance give . Bilinearity and symmetry then yield . Dividing by or gives the forward and central formulas. If the noises are independent with common variance , [F9] makes them integrable, so [F7] gives ; their covariance is by [F6], yielding and .
For each component , apply [F4] through degree at both and to . The constant and quadratic terms cancel in the central quotient, leaving . The same nonnegative-square comparison from step 1.1, [F8], and the sum defining give the central Jacobian-vector bound by [F5].
For , [F2] gives . By [F3] and the Hessian convention in [F1], this equals . Applying [F4] through degree to each yields the component forward bound ; the nonnegative-square comparison from step 1.1 gives the sum bound, and [F5] then yields .
Applying [F4] through degree at and to each cancels the even terms and yields component error at most . The same nonnegative-square comparison from step 1.1, together with [F5], gives the central Hessian-vector bound.
Combining the two Jacobian-vector truncation bounds in steps 1.1 and 2.1, the two Hessian-vector truncation bounds in steps 2.2 and 2.3, and the corresponding evaluation bounds in step 1.2 by the Euclidean triangle inequality [F5] gives all four hatted-estimate bounds in the Statement. For random errors, the covariance identity in step 1.3 applies; absent centering/covariance hypotheses no root-sum-square conclusion follows.
Depends on
- Forward and central finite-difference Jacobian-vector and Hessian-vector products
- Repeated derivatives along a line expand by the multinomial formula
- Continuous mixed partials of order $k$ are invariant under permutations
- The Lagrange and Cauchy forms of Taylor's remainder
- Taylor polynomials and their remainders
- The $p$-norms $\lVert x\rVert_p$ for rational $p \ge 1$, and $\lVert x\rVert_\infty$
- Each $\lVert\cdot\rVert_p$ is a norm on $\mathbb{R}^n$, and the induced metrics are exactly $d_1$, $d_2$ and $d_\infty$ of the published metric-spaces page
- Absolute value in an ordered field
- Basic properties of the absolute value
- Moments, variance, and covariance on a probability space
- Variance and covariance identities for random variables
- Expectations factor over finite products of independent random variables
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
62 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Tobin A. Driscoll and Richard J. Braun, Fundamentals of Numerical Computation, finite differences (standard reference, not scraped)
- Andreas Buttenschoen, Introduction to Scientific Computing, Numerical Differentiation (standard reference, not scraped)