How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
The finite-list ERM selector is measurable
Statement
For a sample of positive length, a finite ordered nonempty list of measurable predictors, and finite tolerance , let be the index returned by the finite-list empirical-risk algorithm. Then is measurable into the finite index set with its discrete sigma-algebra, the evaluation map is jointly measurable, and the returned predictor is an -approximate empirical risk minimizer as defined in the algorithm's input conditions. When , it is an exact minimizer.
Facts & Assumptions
Given: A supervised prediction problem, sample size , an ordered list of measurable predictors with , and finite tolerance .
The algorithm returns index when every list risk is infinite; otherwise it returns the first finite-risk index within of the finite list minimum. Finite-list empirical risk minimization
For each fixed predictor, the empirical-risk map on the sample space is extended-real measurable. Population and empirical risks are measurable
A finite-list exact or approximate ERM is defined by its empirical risk relative to the list infimum, with a separate all-infinite case. Empirical risk minimizers
Finite sums of measurable extended-real functions are measurable when pointwise defined; real scalar multiples of real-valued measurable functions, functions for nonnegative measurable extended-real and measurable , countable infima, and increasing pointwise limits of measurable extended-real functions are measurable. Closure properties of measurable functions used by the integral
The finite sample-and-instance product sigma-algebra contains measurable rectangles and is closed under finite unions and differences. The product sigma-algebra and its finite iterates
An extended-real function is measurable when preimages of Borel sets, including the finite-value ray, are measurable. Extended-real-valued measurable functions
A map between measurable spaces is measurable exactly when preimages of measurable sets are measurable. A measurable function between measurable spaces
Proof
For , put and . By [F2] each is measurable. The finite minimum is the infimum of the measurable sequence , so [F4] makes measurable. Thus is measurable by [F6].
Define finite nonnegative measurable functions and . Their measurability follows from [F4], including the convention . The sets and are measurable by [F6]. On , and each finite equals , so is measurable by [F4, F6]. At every a finite minimizing index lies in some .
The algorithm's selected-index events are and, for , . They are measurable by step 2.1, so is measurable into the finite discrete index set by [F7]. For each measurable , the evaluation preimage is , a finite union of measurable rectangles by [F5]; hence is jointly measurable by [F7].
On all list risks are , so the returned first predictor is an exact minimizer by [F3]. On , at least one finite minimizer exists in the finite list, belongs to some , and the first selected has finite risk at most by its definition. If , this inequality forces the selected risk to equal . Thus the output has the asserted ERM property in both branches.
Depends on
- Finite-list empirical risk minimization
- Empirical risk minimizers
- Population and empirical risks are measurable
- The product sigma-algebra and its finite iterates
- Extended-real-valued measurable functions
- A measurable function between measurable spaces
- Closure properties of measurable functions used by the integral
Used by
- Finite-class agnostic ERM bound Theorem
- Finite-class realizable PAC bound Theorem
Cited to discharge well-definedness by Finite-list empirical risk minimization.
Dependency tree · two levels
19 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Shai Shalev-Shwartz and Shai Ben-David, Understanding Machine Learning: From Theory to Algorithms, Chapter 3 Remark 3.1 (standard reference, not scraped)