How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Training accuracy, algorithmic stability, and class-wide Rademacher bounds
Example
Assume the Axiom of Choice. Let with and its discrete sigma-algebra, let with its discrete sigma-algebra, and let for every . Use the zero-one loss and the hypothesis class . Define a constant learner that always outputs . Define a memorizing learner by predicting the majority label among sample observations at the queried feature, resolving a tie by predicting , and predicting at any feature absent from the sample; on the empty sample it predicts everywhere. Both learners are permutation-invariant. For every one-point sample , the constant learner has zero training and population risk and deletion-stability coefficient . The memorizing learner also has zero training risk, but has population risk and deletion-stability coefficient . For the full finite loss class , define for a one-point sample and . Both values are . Under AC, the two-sided Rademacher uniform-deviation bound is for , with probability at least ; the natural logarithm makes its right-hand side at least , the trivial zero-one loss range.
Example references
Uniform deletion stability is defined by Uniform algorithmic stability under deletion.
Population and empirical risk use the integral and finite-average conventions in Population and empirical risk.
The one-sided complexity normalization is fixed by One-sided Rademacher complexity.
The two-sided uniform-deviation bound and its AC hypothesis are stated in Rademacher uniform generalization bounds.
Confidence terms use the natural logarithm The natural logarithm as the inverse of the exponential function.
Its strict monotonicity and value at follow from Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm.
The IID and choice assumptions are specified by Identical distribution and IID families
and The Axiom of Choice.
Facts & Assumptions
Given: The finite supervised domain, law , binary hypothesis class, two learning rules, and Axiom of Choice stated in the Example.
Assume AC only for applying the Rademacher concentration theorem; the explicit learner risks, stability coefficients, and finite sign average below are choice-free. The Axiom of Choice
The supervised loss on is the prediction loss evaluated at and . Supervised prediction problems
Population risk is the expectation of the loss under , and training risk is its sample average. Population and empirical risk
Uniform deletion stability is the supremum loss change between the full output and the output after deleting one indexed observation. Uniform algorithmic stability under deletion
The empirical one-sided Rademacher complexity is the sign average of , and expected complexity averages this quantity over an IID sample. One-sided Rademacher complexity
For a nonempty measurable loss class with measurable suprema and AC, the two-sided expected-complexity bound is with probability at least . Rademacher uniform generalization bounds
IID means mutually independent observations with the same law. Identical distribution and IID families
For , is the unique real with . The natural logarithm as the inverse of the exponential function
is strictly increasing and , so implies . Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm
The finite discrete domain makes every loss measurable and every supremum over the nonempty finite class measurable.
Verification
Both rules depend only on the sample multiset, so they are permutation-invariant. Under , has zero loss at every feature, so its population and empirical risks are both . For , the memorizing learner predicts at and at the other features. Thus its empirical risk is and its population risk is .
Fix any and one-point sample . Since contains every binary labeling, some has loss and some has . For sign , ; for sign , the supremum is . The two equiprobable signs therefore give for every , and averaging over gives .
The constant learner returns on both and its deletion, so its size-one stability coefficient is . The empty-sample memorizer predicts at , whereas the full-sample memorizer predicts there; at test point the loss changes by . Every zero-one loss difference is at most , hence the memorizer's coefficient is exactly .
With , [F5] has complexity term , and [F7]–[F8] make its confidence term positive for every . Every zero-one loss deviation is at most , so this class-wide upper bound is no sharper than the trivial range, while step 1.1 gives the constant learner an exact zero gap and the memorizer zero training risk with a large population risk.
Depends on
- Uniform algorithmic stability under deletion
- Supervised prediction problems
- Population and empirical risk
- One-sided Rademacher complexity
- Rademacher uniform generalization bounds
- The natural logarithm as the inverse of the exponential function
- Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm
- The Axiom of Choice
- Identical distribution and IID families
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
31 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.