How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite-pool version-space invariant and query bound
Statement
Let be a finite nonempty class of binary classifiers, let be a finite ordered pool with , let , let the deterministic oracle return at every query, and run the finite-pool version-space query procedure with any integer budget . At every stage the current version space contains and is nonempty; each pool label recorded as a unanimous prediction equals at that point; and the procedure terminates after at most pool iterations. If it makes queries, then . Moreover, on any execution for which each oracle-selected branch has size at most times its pre-query version space, for a fixed , one has , where is the natural logarithm.
Statement references
Finite pool-based realizable active-learning instance: fixes the finite measurable binary class, pool, target, and pointwise exact oracle.
Finite-pool version-space query procedure: scans each pool index once, queries only disagreements while budget permits, and restricts the version space to hypotheses matching each exact answer.
The natural logarithm as the inverse of the exponential function: defines for as the inverse of the real exponential.
Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm: proves that is strictly increasing, , and .
Steve Hanneke, Theory of Active Learning, version 1.1, §5.1
Daniel Joseph Hsu, Algorithms for Active Learning, Chapter 2 §2.2.2
Facts & Assumptions
Given: A finite nonempty class , ordered pool , target , exact oracle , and query budget .
Finite pool-based realizable active-learning instance: the pool is finite and ordered, belongs to , and every queried label is the pointwise target label.
Finite-pool version-space query procedure: the procedure starts at , queries only when current classifiers disagree and , increments once per response, and on a query replaces by the classifiers matching that oracle answer; unanimous positions are recorded without querying, including when .
The natural logarithm as the inverse of the exponential function: for every , is the unique real satisfying .
Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm: is strictly increasing, for positive , and .
No choice axiom is assumed or used; the proof uses finite sets, finite filtering, and induction over the pool scan and query count.
Proof
Initially , so [F1] gives . If a query is made at , [F1] gives its answer , and [F2] replaces by , which still contains . If no query is made, is unchanged. Induction over the scan therefore keeps in every current , so is never empty. The finite filters make no arbitrary selections, as recorded in [A1].
At each loop pass the algorithm either advances from index to or returns. Since has indices, after at most such advances it returns, including when . It queries at most once per visited index, hence .
Initially . The only update that increases is made in the branch , so it preserves ; when , the algorithm does not query and either records a unanimous label or returns at a disagreement. Induction over the scan gives , in particular no queries when .
When [F2] records a unanimous label at , every has that value there. Since by step 1.1, the recorded value equals .
At every query, [F2] says the current classifiers disagree at the queried point. One of them is by step 1.1, so at least one current classifier has label different from the exact answer and is removed. Version spaces only shrink; consequently each query removes at least one distinct member of . After queries at least such members have been removed, while remains, giving .
Combining the pool-index bound in step 1.2 with step 2.2 gives .
Under the additional branch-size hypothesis, after queries induction gives . Step 1.1 gives , so . Since , [F4] gives , where the product law is applied repeatedly to the integer power . Also , so [F4] gives and, by applying its product law to , . Rearranging yields . For the same conclusion follows from .
Depends on
Used by
- Exact labels, slow version-space shrinkage, and abstention limits Remark
- Unanimous version-space prediction and disagreement abstention Theorem
Cited to discharge well-definedness by Finite-pool version-space query procedure.
Dependency tree · two levels
11 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Steve Hanneke, Theory of Active Learning, version 1.1, §5.1 (standard reference, not scraped)
- Daniel Joseph Hsu, Algorithms for Active Learning, Chapter 2 §2.2.2 (standard reference, not scraped)