How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Forward-over-reverse Hessian-vector products
Definition
Input a graph, a point , and direction . Run Forward-mode automatic differentiation on a finite computational graph and retain its primal tape and all input and operation tangents. If that call returns DOMAIN_ERROR or NONDIFFERENTIABLE, return the same status and stop without a Hessian-vector product. Otherwise initialize every operation and input cotangent and tangent-cotangent accumulator to zero. Seed the output by setting its cotangent/tangent-cotangent pair to : if is an operation, set ; if is input coordinate , set . In reverse topological order, for each node and parent slot , let , compute and add and to the parent's cotangent and tangent-cotangent accumulators. Use for input coordinate and for operation node . If the same parent occurs in multiple slots, add every slot contribution. Return . Repeated parent slots receive separate additions. The admissible case requires every primitive evaluation to be in its declared domain and, for a piecewise primitive, on a unique strict active branch; a branch boundary or ambiguous selection returns NONDIFFERENTIABLE through the initial call. The transpose is the real Euclidean transpose, not a complex adjoint.
Depends on
Used by
Dependency tree · two levels
5 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- MIT OpenCourseWare 18.S096, Matrix Calculus for Machine Learning and Beyond, complete lecture notes, Chapter 8 §8.4.1 (standard reference, not scraped)