Alphabeta Math

Preference learning and direct preference optimization — Examples

About this page
Pipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

1 · Prerequisites
Abstract Algebra
Combinatorics
Information Theory
Linear Algebra
Machine Learning Algorithms
Mathematical Statistics
Measure Theory
Probability
Real Analysis
Set Theory
Statistical Learning and Classical Models
Topology
2 · Logical flowchart

3 · Items

Example

A two-response Gibbs policy with exact probabilities

Counterexample

Disconnected comparison support does not identify Gibbs policy mass

Example

A prompt-only reward offset leaves Bradley–Terry comparisons and policy unchanged

Counterexample

Zero reference support makes the DPO reward ratio undefined

Sources