How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
A biased simulator gradient has limiting squared gradient
Example
Let the probability space be the one-point space with and the trivial filtration for every . Let , so and . A deterministic simulator returns the biased gradient for fixed . Starting at with constant step , compute the iterates and their average squared true gradient.
Facts & Assumptions
Given: The one-dimensional objective, biased oracle, initial value, and stepsize in the Example.
The Axiom of Choice: AC is used by the conditional-expectation formulation of the bias-floor theorem.
Filtration-adapted stochastic-gradient oracles and Robbins–Monro updates: the unconstrained update is .
Biased SGD has an explicit weighted stationarity floor: for an -smooth objective and steps , bounded bias and variance give an asymptotic average squared-gradient bound .
The Euclidean inner product on : in dimension one, .
The principle of mathematical induction: a formula true at and preserved by the recurrence holds for every natural index.
The derivative of at a point that is a limit point of , and differentiability on a set: is the limit of as when that limit exists.
Basic algebra and order properties of conditional expectation: conditional expectation preserves real constants, so for every .
Conditional variance: conditional variance is the conditional expectation of the squared deviation from the conditional mean.
Verification
With , [F1] gives . [F5] applies to : it holds at , and substitution gives . Thus [F3] implies and .
The difference quotient tends to , so [F6] gives . For all , by [F4], and the stated objective satisfies . The recurrence in step 1.1 makes each deterministic; [F7] then gives conditional mean , and [F8] gives conditional variance . Also is square-integrable. For every , The two fractions tend to zero because their numerators are bounded and their denominators grow linearly in . With , , , and , [F2] applies and gives the (valid, though nonsharp) upper limit , while the exact average tends to .
Depends on
- Filtration-adapted stochastic-gradient oracles and Robbins–Monro updates
- Biased SGD has an explicit weighted stationarity floor
- For $|r| < 1$ the sequence $r^k$ is null, and for $|r| > 1$ the sequence $|r|^k$ diverges to $+\infty$
- The Axiom of Choice
- The Euclidean inner product $\langle x,y\rangle = \sum_{k<n} x_k y_k$ on $\mathbb{R}^n$
- The principle of mathematical induction
- The derivative $f'(c) = \lim_{x \to c} \frac{f(x) - f(c)}{x - c}$ of $f : A \to \mathbb{R}$ at a point $c \in A$ that is a limit point of $A$, and differentiability on a set
- Basic algebra and order properties of conditional expectation
- Conditional variance
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
63 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.