How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
A correlated binary source is sent uncoded over an adder MAC
Statement
Let have probabilities and , and let the binary-adder MAC be . The uncoded source maps give zero-error transmission because sums correspond respectively to source pairs . The source joint entropy is , while the maximum sum mutual information over independent product inputs is . Thus separate lossless source descriptions followed by the independent-private-message product-input MAC region cannot carry this source pair at its joint entropy, whereas the correlated source-channel code does.
Facts & Assumptions
Given: A finite correlated IID source pair on the stated support and the deterministic binary-adder DM-MAC.
Lossless transmission of two correlated IID sources over a DM-MAC: each encoder observes its own source block and the common decoder reconstructs both; error is average joint block error.
Two-user discrete memoryless multiple-access channel: the channel is memoryless with a kernel from the two input bits to their sum.
Finite mutual information: is the finite KL sum in nats.
Independent-private-message DM-MAC capacity region: the sum-rate constraint is for conditional product input laws.
Finite-alphabet Fano inequality: for an estimator of a finite random variable with error probability , .
Finite entropy and mutual-information chain rules: finite entropy satisfies both conditional chain-rule orderings and .
Proof
The only positive-probability source pairs are . Under their outputs are , which are distinct; applying the inverse table at every coordinate reconstructs both source blocks with error exactly zero under [F1]–[F2].
The three equiprobable source atoms give . Since and is increasing, .
Let independent product inputs have and . Since is deterministic, expansion of [F3] gives . Put , , and . Then The two endpoint masses sum to , and their difference has absolute value .
If , equal endpoint masses are feasible by taking and . At fixed middle mass , write the endpoint masses as and . Their entropy contribution is , because is positive for and negative for , with continuity at the endpoints. Since , This function has derivative for , so it is at most its value at .
If , and have the same sign and . For fixed endpoint total, entropy is maximized when the endpoint imbalance is smallest, attained at ; hence it is enough to consider or their simultaneous complements. By symmetry take , where the output law is . Its entropy derivative is Indeed, with , satisfies and , while . Therefore the entropy is at most its value at . Continuity covers the endpoints.
Uniform product inputs give output probabilities and entropy . Steps 1.4 and 1.5 show no independent product input gives greater output entropy; by determinism and step 1.3 this is the maximum product-input sum mutual information. For any finite time-sharing variable, [F4] makes an average of these product-input informations, so the same upper bound holds.
Consider separate fixed-length source encoders with message indices of sizes , channel output , and reconstruction with error . Since the source-block alphabet has size , Fano's inequality [F5] gives . The encoders make a deterministic function of , and the channel output depends on the source blocks only through , so the finite chain rules [F6] give . Therefore If is the law of , concavity of gives . Thus , so reliable separate descriptions require asymptotic sum rate at least .
By step 2.1, the independent-private-message product-input MAC region has sum rate at most , strictly below by step 1.2. Therefore that separated rate region cannot carry this source pair at its entropy rate, while step 1.1 gives the uncoded zero-error correlated source-channel code.
Depends on
Used by
Nothing in the library uses this result yet.
Dependency tree · two levels
20 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Abbas El Gamal and Thomas M. Cover, Multiple User Information Theory, Proceedings of the IEEE 68 (1980), §VII (standard reference, not scraped)
- Abbas El Gamal and Young-Han Kim, Network Information Theory, Lecture Notes 15, transmission of correlated sources over a DM-MAC (standard reference, not scraped)