Alphabeta Math
ExampleConstruction: Literature-sourcedVerification: AI-adaptedPipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

A correlated binary source is sent uncoded over an adder MAC

Statement

Let (S1,S2) have probabilities P(0,0)=P(0,1)=P(1,1)=1/3 and P(1,0)=0, and let the binary-adder MAC be Y=X1+X2∈{0,1,2}. The uncoded source maps Xj=Sj give zero-error transmission because sums 0,1,2 correspond respectively to source pairs (0,0),(0,1),(1,1). The source joint entropy is ln⁡3, while the maximum sum mutual information over independent product inputs is 32ln⁡2<ln⁡3. Thus separate lossless source descriptions followed by the independent-private-message product-input MAC region cannot carry this source pair at its joint entropy, whereas the correlated source-channel code does.

Facts & Assumptions

Given: A finite correlated IID source pair on the stated support and the deterministic binary-adder DM-MAC.

[F1]

Lossless transmission of two correlated IID sources over a DM-MAC: each encoder observes its own source block and the common decoder reconstructs both; error is average joint block error.

[F2]

Two-user discrete memoryless multiple-access channel: the channel is memoryless with a kernel from the two input bits to their sum.

[F3]

Finite mutual information: I(A;B) is the finite KL sum in nats.

[F4]

Independent-private-message DM-MAC capacity region: the sum-rate constraint is R1+R2≤I(X1,X2;Y∣Q) for conditional product input laws.

[F5]

Finite-alphabet Fano inequality: for an estimator of a finite random variable S with error probability ϵ, H(S∣S^)≤ln⁡2+ϵln⁡∣S∣.

[F6]

Finite entropy and mutual-information chain rules: finite entropy satisfies both conditional chain-rule orderings and H(S)−H(S∣J)=I(S;J)=H(J)−H(J∣S).

Proof

1.1F1F2givenconstruct

The only positive-probability source pairs are (0,0),(0,1),(1,1). Under Xj=Sj their outputs are 0,1,2, which are distinct; applying the inverse table at every coordinate reconstructs both source blocks with error exactly zero under [F1]–[F2].

1.2F1algebra

The three equiprobable source atoms give H(S1,S2)=−(3)(1/3)ln⁡(1/3)=ln⁡3. Since 32=9>8=23 and ln⁡ is increasing, ln⁡3>32ln⁡2.

1.3F2F3algebra

Let independent product inputs have X1∼Bern⁡(p) and X2∼Bern⁡(q). Since Y=X1+X2 is deterministic, expansion of [F3] gives I(X1,X2;Y)=H(Y). Put A=2p−1, B=2q−1, and T=AB. Then PY(0)=(1−A)(1−B)4,PY(1)=1−T2,PY(2)=(1+A)(1+B)4. The two endpoint masses sum to (1+T)/2, and their difference has absolute value ∣A+B∣/2.

1.4algebraalgebra

If T≤0, equal endpoint masses are feasible by taking B=−A and A2=−T. At fixed middle mass b=PY(1), write the endpoint masses as (1−b)t and (1−b)(1−t). Their entropy contribution is (1−b)hb(t)≤(1−b)ln⁡2, because hb′(t)=ln⁡((1−t)/t) is positive for t<1/2 and negative for t>1/2, with continuity at the endpoints. Since b=(1−T)/2≥1/2, H(Y)≤hb(b)+(1−b)ln⁡2. This function has derivative ln⁡((1−b)/b)−ln⁡2<0 for b≥1/2, so it is at most its value 32ln⁡2 at b=1/2.

1.5algebraalgebra

If T≥0, A and B have the same sign and ∣A+B∣≥2T. For fixed endpoint total, entropy is maximized when the endpoint imbalance is smallest, attained at ∣A∣=∣B∣=T; hence it is enough to consider p=q=r or their simultaneous complements. By symmetry take 0≤r≤1/2, where the output law is ((1−r)2,2r(1−r),r2). Its entropy derivative is 2[ln⁡1−rr−(1−2r)ln⁡2]≥0. Indeed, with x=1−2r∈[0,1), g(x)=ln⁡((1+x)/(1−x))−2x satisfies g(0)=0 and g′(x)=2x2/(1−x2)≥0, while 2x≥xln⁡2. Therefore the entropy is at most its value 32ln⁡2 at r=1/2. Continuity covers the endpoints.

2.1F2F3F4step 1.3step 1.4step 1.5algebra

Uniform product inputs p=q=1/2 give output probabilities (1/4,1/2,1/4) and entropy 32ln⁡2. Steps 1.4 and 1.5 show no independent product input gives greater output entropy; by determinism and step 1.3 this is the maximum product-input sum mutual information. For any finite time-sharing variable, [F4] makes I(X1,X2;Y∣Q) an average of these product-input informations, so the same 32ln⁡2 upper bound holds.

2.2F5F6step 1.2algebra

Consider separate fixed-length source encoders with message indices J=(J1,J2) of sizes M1,M2, channel output Yn, and reconstruction S^n=g(Yn) with error ϵn. Since the source-block alphabet has size 4n, Fano's inequality [F5] gives H(S1n,S2n∣Yn)≤ln⁡2+2nϵnln⁡2. The encoders make J a deterministic function of (S1n,S2n), and the channel output depends on the source blocks only through J, so the finite chain rules [F6] give I(S1n,S2n;Yn)=I(J;Yn). Therefore nln⁡3=H(S1n,S2n)≤I(J;Yn)+H(S1n,S2n∣Yn)≤H(J)+ln⁡2+2nϵnln⁡2. If π is the law of J, concavity of ln⁡ gives H(J)=∑j:πj>0πjln⁡(1/πj)≤ln⁡∑j:πj>01≤ln⁡(M1M2). Thus nln⁡3≤ln⁡M1+ln⁡M2+ln⁡2+2nϵnln⁡2, so reliable separate descriptions require asymptotic sum rate at least ln⁡3.

3.1F4step 1.1step 1.2step 2.1step 2.2algebra∎

By step 2.1, the independent-private-message product-input MAC region has sum rate at most 32ln⁡2, strictly below ln⁡3 by step 1.2. Therefore that separated rate region cannot carry this source pair at its entropy rate, while step 1.1 gives the uncoded zero-error correlated source-channel code.

Depends on

Used by

Nothing in the library uses this result yet.

Dependency tree · two levels

20 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.

Sources