How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Sauer–Shelah growth bound for indexed samples
Statement
Let be a nonempty measurable space and let be a nonempty class of measurable functions with finite VC dimension . For every integer ,
where for . Consequently, when ; and when ,
where .
Statement references
Indexed shattering and VC dimension of a binary class: shattering uses indexed tuples and is the largest shattered length.
Growth function of a binary hypothesis class: is the largest number of distinct binary traces on an indexed -tuple.
Sauer–Shelah: a family on of VC dimension at most has at most members: a family in with VC dimension at most has at most members.
Mohri et al., Theorem 3.17 and Corollary 3.18: Sauer’s trace bound and its estimate.
Bartlett and Mendelson, Theorems 5–6: empirical VC dimension enters the classification complexity bound.
Facts & Assumptions
Given: A nonempty measurable binary class , finite , and an integer .
A tuple is shattered when its trace is all binary vectors; repeated coordinates are retained as distinct indices. Indexed shattering and VC dimension of a binary class
is the supremum of the finite trace cardinalities on indexed -tuples. Growth function of a binary hypothesis class
If has finite-set-family VC dimension at most , then . Sauer–Shelah: a family on of VC dimension at most has at most members
counts -element subsets of and is zero for . The set of -element subsets and the binomial coefficient
In , for every real and natural . The binomial theorem in :
For every real , ; ; and . for every real , hence , The real exponential function and the number by a power series, The exponential addition formula
Proof
Given: The hypotheses in the Statement.
Fix an indexed tuple . Associate to it the family . The map from a trace vector to its set of -indices is a bijection, so . If shatters , then every binary labeling of the subtuple occurs in ; hence is a shattered indexed tuple for and . Thus the finite-family VC dimension of is at most .
Apply [F3] to to get . This bound holds for every tuple, so taking the supremum over tuples gives the first inequality.
If , the first inequality gives , while nonemptiness of makes every trace nonempty; hence .
Suppose and identify natural binomial counts with their real images under . For , , so . The second inequality adds nonnegative terms. By [F5], the last factor satisfies , where the first inequality follows by multiplying by itself times and the equality follows from [F6]. Therefore by step 2.1.
Depends on
- Indexed shattering and VC dimension of a binary class
- Growth function of a binary hypothesis class
- Sauer–Shelah: a family on $[n]$ of VC dimension at most $d$ has at most $\sum_{i=0}^{d}\binom{n}{i}$ members
- The set $[A]^{k}$ of $k$-element subsets and the binomial coefficient $\binom{n}{k} := \lvert [n]^{k}\rvert$
- The binomial theorem in $\mathbb{R}$: $(x+y)^{n} = \sum_{k<n+1} \iota\!\binom{n}{k}\, x^{k} y^{\,n-k}$
- $1+x\le\exp(x)$ for every real $x$, hence $(1-p)^m\le\exp(-mp)$
- The exponential addition formula $\exp(x+y)=\exp(x)\exp(y)$
- The real exponential function and the number $e$ by a power series
Used by
Dependency tree · two levels
50 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar, Foundations of Machine Learning, 2nd ed., Theorem 3.17 and Corollary 3.18 (standard reference, not scraped)
- Peter L. Bartlett and Shahar Mendelson, Rademacher and Gaussian Complexities: Risk Bounds and Structural Results, Theorems 5–6 (standard reference, not scraped)