How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Conditional typical-set fan cardinality bound
Statement
Let be the joint law of a finite-alphabet IID -source on , and fix nonempty . Put and . For every there is such that, for every , every fixed , and every ,
Facts & Assumptions
Given: The finite source law , the fixed nonempty subset , and .
Jointly typical blocks for a finite IID multisource: every block in has an empirical joint type with ; its additional information conditions only restrict membership further.
Empirical types, n-types, and type classes: an attainable joint type is determined by its integer symbol counts, and its type classes are the fibers of the empirical-type map.
Conditional type-class cardinality bound: for fixed and a feasible joint type , the number of compatible is at most .
Continuity of finite conditional entropy in the joint law: is continuous at the fixed joint law .
Finite conditional entropy: conditional entropy is the finite weighted sum of conditional-law entropies, with zero-mass conditioning values omitted.
Finite distributions, entropy, divergence, and stochastic matrices: finite entropy uses natural logarithms and .
Proof
By [F4], choose so that every joint probability vector with satisfies . The joint alphabet is identified with by a coordinate permutation, so the same coordinatewise neighborhood applies to the joint type of .
For the fixed , each in the set has a unique joint empirical type by [F2]. There are at most possible such types, since each of the joint symbol counts is an integer from to ; the sum constraint can only reduce this count.
For each feasible type arising from a typical block, [F1] and step 1.1 give . By [F3], its conditional type class has size at most . Summing this bound over the at most types from step 1.2 proves the claimed inequality. The empty-complement case uses its singleton alphabet and the same count.
Depends on
Used by
Dependency tree · two levels
16 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, second edition, Chapter 15 (standard reference, not scraped)
- Yury Polyanskiy and Yihong Wu, Information Theory: From Coding to Learning, author-hosted book draft (standard reference, not scraped)