How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
General-link score and Fisher information
Statement
Consider Generalized linear model with explicit conditioning at an admissible finite with common scale . Assume each is differentiable, each is differentiable with , , the component scores have finite second moments, and the common-support, differentiability, and local integrable derivative-envelope conditions from Explicit exponential-family response contracts hold. Put
For every observed with for each , the score and expected score outer-product information are
In particular, if has full column rank, then is positive definite.
Facts & Assumptions
Given: The finite independent-response GLM, common scale, differentiable link and component natural-parameter maps, an observed response vector with positive component densities, fixed common support, local derivative envelopes, and finite second moments in the Statement.
Generalized linear model with explicit conditioning: , , the score is the gradient of the product log likelihood, and when finite.
Explicit exponential-family response contracts: the component responses are independent, have the displayed common-support response densities, and use the stated product sampling law.
Mean and variance from the cumulant function: and under the common-scale restriction.
The chain rule, in one line from Carathéodory: if is differentiable at and is differentiable at , then is differentiable at with : differentiating a composition multiplies the outer and inner derivatives under its stated hypotheses.
Expectations factor over finite products of independent random variables: for independent real random variables, expectations of products of integrable measurable coordinate functions factor.
Proof
Differentiate with respect to . The chain rule [F4] gives , so . Differentiating the component log density therefore gives the scalar score . Since , the full score is .
By [F3], and . These second moments are finite by the hypotheses, and makes each integrable. For , independence and [F5] give . Expanding now leaves only . If and has full column rank, then and because each , proving positive definiteness.
Depends on
- Generalized linear model with explicit conditioning
- Explicit exponential-family response contracts
- The product response law has the product density
- Mean and variance from the cumulant function
- The chain rule, in one line from Carathéodory: if $g$ is differentiable at $c$ and $f$ is differentiable at $g(c)$, then $f \circ g$ is differentiable at $c$ with $(f \circ g)'(c) = f'(g(c))\,g'(c)$
- Expectations factor over finite products of independent random variables
Used by
- One minimum-norm IRLS step Algorithm
- A one-observation Bernoulli-logit Fisher-scoring step Example
- A one-observation Poisson-log Fisher-scoring step Example
- Rank deficiency gives singular information and nonunique weighted least squares Example
- The Bernoulli identity-link boundary leaves the regular family Example
- IRLS equals the Fisher-scoring step when information is invertible Theorem
Dependency tree · two levels
36 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Philippe Rigollet, MIT 18.650 Statistics for Applications, Lecture 10: Generalized Linear Models, PDF pp. 43–48 (standard reference, not scraped)
- Ryan Tibshirani, Generalized Linear Models, CMU Advanced Methods for Data Analysis, PDF pp. 4–5 (standard reference, not scraped)