Alphabeta Math

Average-reward regret and UCRL2 — Examples

About this page
Pipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

1 · Prerequisites
Abstract Algebra
Combinatorics
Linear Algebra
Machine Learning Algorithms
Measure Theory
Probability
Real Analysis
Set Theory
Topology
2 · Logical flowchart

3 · Items

Example

A noncommunicating MDP can have state-dependent average reward

Example

One-state MDP and normalized diameter

Example

A random reward separates pathwise and expected regret

Sources