How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
IRLS equals the Fisher-scoring step when information is invertible
Statement
Under the admissibility hypotheses of One minimum-norm IRLS step, assume also that each map is differentiable, each map is differentiable with finite nonzero derivative , and . Each response has finite second moment, its density has the fixed common support and locally uniform integrable envelopes for its first and second derivatives required by Explicit exponential-family response contracts, and each component score has finite second moment. If is invertible, let and be the score and expected score outer-product information from General-link score and Fisher information. Then the weighted least-squares output satisfies
Facts & Assumptions
Given: The algorithm's finite admissible current , common scale, finite nonzero link derivative, and finite positive variance values; the differentiable natural-parameter map; finite component response second moments; fixed common support and locally integrable first- and second-derivative envelopes; finite component score second moments; and invertible .
One minimum-norm IRLS step: , , and minimizes .
For a linear map between finite-dimensional inner-product spaces, minimises if and only if , equivalently ; minimisers exist and any two differ by an element of : a minimizer of satisfies ; minimizers exist and differ by .
Proof
For every , [F2] gives . Since , multiplying by and using [F1] yields .
Apply [F3] to the weighted least-squares map and target . Its normal equation is , so by step 1.1. The assumed invertibility of now gives .
Depends on
Used by
Dependency tree · two levels
16 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Philippe Rigollet, MIT 18.650 Statistics for Applications, Lecture 10: Generalized Linear Models, PDF pp. 47–52 (standard reference, not scraped)
- Ryan Tibshirani, Generalized Linear Models, CMU Advanced Methods for Data Analysis, PDF p. 5 (standard reference, not scraped)