How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Reverse-mode automatic differentiation for a scalar graph output
Definition
Input a graph from Finite straight-line computational programs and real-arithmetic tapes and an admissible point . Require every primitive to be on its declared open domain or supplied as a piecewise- primitive with the branch rules of the graph definition. Evaluate and store all primal values in topological order. Initialize every operation cotangent and every input cotangent to zero. Seed the scalar output by setting its cotangent to : if is an operation, set ; if is input coordinate , set . For , and for every parent slot , compute the contribution and add it to the cotangent accumulator of that parent: use if the parent is input coordinate , and if it is operation node . If the same parent node occurs in multiple slots, add every slot contribution. Return the scalar output and the input cotangents as the Euclidean gradient. A point outside the admissible domain returns DOMAIN_ERROR; a branch boundary or ambiguous active branch returns NONDIFFERENTIABLE and no gradient. The procedure differentiates the real-arithmetic graph; it makes no floating-point error claim.
Depends on
Used by
- Forward-over-reverse Hessian-vector products Algorithm
- Uniform-block and binomial checkpoint schedules for reverse sweeps Algorithm
- Reverse-mode differentiation of an Euler trajectory tape Example
- Reverse mode computes the exact gradient of the real-arithmetic graph Theorem
- Reverse-mode work is a fixed multiple of primal work under explicit primitive-cost bounds Theorem
- The reverse recursion is the exact gradient of a finite state-step objective Theorem
- Uniform-block and binomial checkpoint schedules preserve reverse adjoints with stated costs Theorem
Dependency tree · two levels
3 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- MIT OpenCourseWare 18.S096, Matrix Calculus for Machine Learning and Beyond, complete lecture notes, Chapter 8 §§8.3–8.4.1 (standard reference, not scraped)