How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
A two-arm deterministic gap and explore-then-commit
Example
Let be an integer, let , and fix . In a two-arm -round bandit, let every reward-stack entry of arm 1 equal and every reward-stack entry of arm 2 equal . Under explore-then-commit with exploration count , the algorithm commits to arm 1 and has expected reward regret exactly . The expected-regret theorem gives the upper bound for this instance.
Example references
Finite stochastic bandit model, gaps, and regret: arm means, gaps, and expected reward regret.
Centered 1-sub-Gaussian reward: the mean-centred MGF condition checked for deterministic rewards.
The exponential is positive and satisfies : the exponential factor in the regret bound is positive.
Explore-then-commit for a finite stochastic bandit: the fixed round-robin exploration and empirical-mean commitment rule.
Expected regret of explore-then-commit: the expected-regret bound compared with the exact regret.
Facts & Assumptions
Given: The deterministic reward table and explore-then-commit parameters in the example.
Arm means, gaps, and expected reward regret are defined by the stochastic-bandit model (Finite stochastic bandit model, gaps, and regret).
Each reward is 1-sub-Gaussian exactly when its mean-centred MGF satisfies the stated bound (Centered 1-sub-Gaussian reward).
Explore-then-commit samples each arm times, commits to a least-index empirical-mean maximizer, then repeats it (Explore-then-commit for a finite stochastic bandit).
Under the finite-mean 1-sub-Gaussian assumptions, the theorem bounds expected reward regret by the stated ETC expression (Expected regret of explore-then-commit).
The real exponential is positive at every real input (The exponential is positive and satisfies ).
Verification
The arm laws are point masses at and , so , , and . Each centered reward is identically , so its MGF is for every real and [F4] applies.
The exploration means equal the deterministic rewards, so [F3] commits to arm 1. During exploration it pulls arm 2 exactly times, each with gap ; all other pulls have gap . Therefore both the realized reward regret and its expectation equal .
Substituting and into [F4] gives , which is at least because , , and [F5] makes the exponential factor positive.
Depends on
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
21 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.