How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
A sample-size consequence for compression schemes
Statement
Let with . Let be a measurable space, let be measurable, and let be a probability measure on . Put with its product sigma-algebra. For each , let be a fixed jointly measurable reconstruction map, with measurable on . Draw independent observations , each with law , and form . A deterministic compressor selects an index subset with and outputs , where is the ordered tuple of selected labeled entries; for , use . Assume the reconstruction is consistent on every such sample, meaning for each , and assume the learner's output-risk event is measurable. Define . Fix . If and , or if and where is the base of the real exponential function, then with probability at least over the independent observations.
Statement references
The sample-compression generalization bound: the probability of any consistent bad reconstruction among all index subsets is bounded by the exact binomial sum.
Deterministic sample-compression schemes: a deterministic scheme selects at most labeled entries and reconstructs a binary classifier from those entries alone, consistently on the full sample.
A binomial-sum bound for compression sample sizes: for , .
for every real , hence : for and natural .
The natural logarithm as the inverse of the exponential function: is the inverse of the real exponential on the positive reals.
Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm: the natural logarithm is increasing and obeys the product and reciprocal laws.
The real exponential function and the number by a power series: .
The exponential addition formula : .
The exponential function is strictly increasing: the real exponential is increasing.
The exponential is positive and satisfies : the real exponential is positive and .
Floyd and Warmuth, Sample Compression, Learnability, and the Vapnik–Chervonenkis Dimension, Theorem 5 and §5: sample-size consequences are derived from the compression probability bound.
Facts & Assumptions
Given: The hypotheses in the Statement.
The exact bad-subset probability is at most . The sample-compression generalization bound
For and natural , . for every real , hence
The natural logarithm and real exponential are defined on their stated domains; the logarithm is increasing, inverse to the exponential, and satisfies the product and reciprocal laws, while the exponential is increasing and positive and obeys the addition law. The natural logarithm as the inverse of the exponential function, Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm, The real exponential function and the number by a power series, The exponential addition formula , The exponential function is strictly increasing, The exponential is positive and satisfies
Proof
Given: The hypotheses in the Statement.
If , [F1] reduces the bad-subset probability to . By [F3] this is at most , which is at most when by [F4].
If , then for every , [F3] with gives . Since and , monotonicity of the exponential [F4] gives . Thus [F1] and [F2] bound the bad-subset probability by . The displayed sample-size condition makes the exponent at most , so monotonicity of the exponential gives a bound at most .
A consistent learner's output is one of the reconstructions counted by the bad-subset event in [F1]. Therefore its measurable failure event has probability at most in either case, proving the conclusion.
Depends on
- The sample-compression generalization bound
- A binomial-sum bound for compression sample sizes
- $1+x\le\exp(x)$ for every real $x$, hence $(1-p)^m\le\exp(-mp)$
- The natural logarithm as the inverse of the exponential function
- The real exponential function and the number $e$ by a power series
- Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm
- The exponential addition formula $\exp(x+y)=\exp(x)\exp(y)$
- The exponential function is strictly increasing
- The exponential is positive and satisfies $\exp(-x)=1/\exp(x)$
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
40 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Sally Floyd and Manfred Warmuth, Sample Compression, Learnability, and the Vapnik–Chervonenkis Dimension, Theorem 5 and §5 (standard reference, not scraped)