How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Calibration and both outcome-balance criteria force equal base rates or perfect prediction
Statement
Let and be nonempty finite sets. In group , feature type has proportion , where , and total mass . The positive binary outcome has probability for feature type , with the same in both groups. A common randomized assignment chooses bin from feature type with probability , where ; this choice is independent of group and outcome. Bin has score , and . Define and . Assume for both groups. Define the positive- and negative-outcome mean scores by
Suppose and , and the assignment is calibrated within each group, meaning
for every group and bin , and suppose the mean score among positive outcomes is equal across groups and the mean score among negative outcomes is equal across groups. Then either or almost surely under each group law. In the latter case, every feature type with positive mass in either group has , so the instance permits perfect prediction.
Statement references
Kleinberg, Mullainathan, and Raghavan, complete 23-page paper: Theorem 1.1 and the complete proof in §2 establish the equal-base-rate or perfect-prediction alternatives under these three named score criteria.
Applied Statistics: From Data to Decisions, full chapter: the section “The impossibility: you cannot satisfy them all” states the real-valued score theorem and distinguishes it from the separate binary-classifier theorem.
Facts & Assumptions
Given: The finite two-group risk-score model in the statement, groupwise calibration, and balance of the positive-class and negative-class mean scores. Prove equal base rates or perfect prediction.
KMR's finite group-conditioned risk-score assignment and calibration: the group law is finite, and the same row-stochastic feature-to-bin assignment is used independently of group and outcome, with scores in .
KMR's finite group-conditioned risk-score assignment and calibration: for every group and bin, calibration gives .
Balance for positive and negative outcomes: the class-conditioned means are and ; balance means and .
Class-conditional mean risk scores are areas under threshold rates: in each group, and .
Proof
Set and by [F3]; since , both common means lie in . By [F4], these means are the respective areas under the groups' true-positive-rate and false-positive-rate threshold functions. Summing the calibration identity [F2] over all bins gives for each . Partitioning this finite expectation by gives , hence .
If , then and , so the last identity yields for both groups. Therefore ; cross-multiplication gives . If instead , the identity and give .
In the branch and , each group has positive and negative mass by hypothesis. The score has finite support in , so a conditional mean of one on is possible only when every positive-mass score value is ; a conditional mean of zero on is possible only when every positive-mass score value is . Thus almost surely in both groups. If a feature type with positive mass had , both outcomes would have positive mass at . The same assignment row is used for both outcomes [F1], so their conditional score laws would agree, contradicting concentration at scores and , respectively. Hence every occupied feature type has , which permits perfect prediction.
Remarks
The proof is choice-free: it uses finite sums, finite conditional means, and algebra only. The theorem concerns the named calibration and class-conditioned score means; it does not assert a theorem about demographic parity, equalized odds, causal fairness, or all fairness criteria. The approximate result in KMR Theorem 1.2 is not asserted here; it requires its own exact approximation definitions and function .
Depends on
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
4 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan, Inherent Trade-Offs in the Fair Determination of Risk Scores, arXiv:1609.05807v2 (2016), Theorem 1.1 and §2 proof (standard reference, not scraped)
- Applied Statistics: From Data to Decisions, MS&E 125, Fairness in Algorithmic Decision-Making, section ‘The impossibility: you cannot satisfy them all’ (standard reference, not scraped)