How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Dirichlet normal-mixture posterior contraction
Statement
Assume AC. Let be a finite-valued probability density on with compact support. Assume and, with the integrands set to zero on , and assume there is such that for all sufficiently small . Here is the root-L2 Hellinger distance of Root-L2 Hellinger distance between density laws, and is the centered normal density with standard deviation . Let , where is a finite nonzero measure with a continuous, strictly positive Lebesgue density on an open interval containing , and independently let on . For , define and observe IID from . Suppose and, for some and , Here means eventually for a fixed constant . For every fixed , put Then for every sufficiently large fixed , in -probability. If is compactly supported in , the middle term may be omitted. The conclusion is only in probability; it supplies no almost-sure contraction or generic minimax-optimality assertion.
Facts & Assumptions
Given: Full AC; the compactly supported smooth truth and displayed smoothness/convolution conditions; the finite DP base measure with its density condition; independent scale law; polynomial bandwidth and scale-tail hypotheses; and an IID sample from .
Full AC supplies the normalized-gamma DP construction and the directional KL convention. The Axiom of Choice Existence of a Dirichlet process by normalized gamma Poisson random measure Kullback–Leibler divergence
Dirichlet process and Existence of a Dirichlet process by normalized gamma Poisson random measure: is a measurable random probability measure with the stated Dirichlet finite-partition laws.
The Dirichlet normal-mixture density is jointly measurable and normalized: is jointly measurable, positive, finite, and integrates to one.
The mixture prior places local KL and log-square mass near a compact smooth truth: for , the local KL and log-square neighborhood has mass at least , with both quantities at most .
KL prior mass gives a posterior denominator lower bound in probability: local KL/log-square mass at least gives, with probability at least , a likelihood denominator at least .
The posterior excludes large scales and mixing mass far from compact data: given that denominator bound, for any compact interval containing the truth, put and . If , for , where is the standard normal distribution function, and , then the posterior complement of vanishes, provided and the DP base density is bounded below near .
The dyadic scale bands satisfy the weighted entropy condition: for a fixed and dyadic scale bands whose sieve satisfies , the weighted entropy condition holds when dominates the displayed first and middle rate terms; for compact scale support it holds with only the first term.
Countably partitioned sieves yield posterior contraction by weighted entropy: local KL/log-square mass, a sieve with vanishing posterior complement, and the weighted countable-band entropy condition imply contraction in the same Hellinger metric at every sufficiently large fixed multiple of the target radius.
Dominated statistical experiments and Likelihood densities: the sampling experiment is dominated by Lebesgue measure, and the supplied jointly measurable mixture densities define its likelihoods.
Root-L2 Hellinger distance between density laws: in the conclusion is the root-L2 Hellinger distance between square-root densities.
Proof
Given: The hypotheses in the Statement.
Put . By [F3], choose so the prior mass is at least on a set where both local quantities are at most . Set . Then the mass is at least and both quantities are at most . By [F4], except on an event of probability at most , the likelihood denominator is at least . Also .
Choose a compact interval containing in its interior and contained in the open interval where the density of is continuous and strictly positive. Such an interval exists because the support is compact; its base density is bounded below on . Put and . The polynomial bandwidth bounds give . Choose with large enough that for some , eventually: integrating the standard normal density on gives the claimed lower bound once . Hence . Set for a fixed sufficiently large , and . We have and : if , use for all large , and otherwise is fixed. Choose with and large enough that . Then . Applying [F5] gives posterior concentration on . Since , the larger sieve also has .
Partition into dyadic scale bands for . Their prior masses are bounded by . Since , [F6] applies at radius and gives For compactly supported , only finitely many bands have positive prior mass and the first rate term suffices.
If is compactly supported, put , and . Since , and . Thus and . Also . Retain from step 1.2: its denominator, leakage bound, and exponential factor do not depend on the target radius, so the hypotheses of [F5] hold with and in place of and . It yields posterior sieve complement convergence for . The compact branch of [F6] supplies the weighted entropy condition at radius using only the first rate term.
The prior is the measurable DP law from [F1], and [F2], [F8] give its jointly measurable density likelihoods. We have , so increasing if necessary ensures ; also . Thus [F3] supplies the local prior-mass condition for [F7]. For general , steps 1.2 and 1.3 provide a sieve with vanishing posterior complement and its weighted entropy condition. If is compactly supported, step 2.1 instead provides these two conditions at radius , and its bound allows to be chosen so . Apply [F7] with local radius and target radius in the general case, or in the compact case. It follows that for every sufficiently large fixed , the posterior outside (respectively ) tends to zero in -probability. Since can be any sufficiently large fixed constant, this proves the stated rates. The measurability and dominated-likelihood requirements are supplied by [F1], [F2], and [F8], and [F9] fixes the conclusion's metric convention.
Depends on
- The Dirichlet normal-mixture density is jointly measurable and normalized
- The dyadic scale bands satisfy the weighted entropy condition
- The mixture prior places local KL and log-square mass near a compact smooth truth
- Countably partitioned sieves yield posterior contraction by weighted entropy
- The posterior excludes large scales and mixing mass far from compact data
- KL prior mass gives a posterior denominator lower bound in probability
- Dirichlet process
- Existence of a Dirichlet process by normalized gamma Poisson random measure
- Dominated statistical experiments
- Likelihood densities
- Root-L2 Hellinger distance between density laws
- Kullback–Leibler divergence
- The Axiom of Choice
Used by
Dependency tree · two levels
120 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Subhashis Ghosal and Aad W. van der Vaart, Posterior convergence rates of Dirichlet mixtures at smooth densities, Theorem 1 and complete proof (standard reference, not scraped)
- Subhashis Ghosal and Aad W. van der Vaart, Fundamentals of Nonparametric Bayesian Inference, Chapter 5 Theorem 5.19 and Chapter 6 Theorem 6.6 (standard reference, not scraped)
- Subhashis Ghosal, The Dirichlet Process, Related Priors and Posterior Asymptotics, §§2.5.2–2.5.3 (standard reference, not scraped)