Alphabeta Math
Pipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

✓ 36 results · all verified · 2 also independently AI-judged
Every result on this page is machine-checked by a proof checker and read in full and owner-audited; the judge is an additional, independent cross-model AI review of the proofs. The 34 not AI-judged were verified by owner audit (typically over a confirmed judge false positive), not failures.

Relay and Interference Channel Bounds

1 · Prerequisites

2 · Summary

This page separates three kinds of claims. For finite relay channels it proves a causal cut-set outer bound and a decode-forward inner bound; for the full-output-feedback model the two match. For finite multicast and two-way relay channels it proves noisy-network-coding specializations using explicit likelihood-ratio encoding, simultaneous message decoding, and compression-rate elimination. For interference channels it distinguishes the universal strong-interference hypotheses from Gaussian strong, weak, and mixed regimes. The Gaussian within-one-bit theorem is stated in the complex channel convention of Etkin–Tse–Wang.

Finite-alphabet mutual information and rates use nats. The binary examples explicitly convert those quantities to bits. Gaussian formulas and examples use bits per use. In the Gaussian interference convention, Y1=h11X1+h21X2+Z1 and Y2=h12X1+h22X2+Z2; consequently INR1 is the interference power at receiver 1 and INR2 at receiver 2. The real scalar version has unit-variance N(0,1) noise and a factor 1/2 in logarithmic rates; the complex version has unit-variance circular Gaussian noise and no such factor.

The first diagram labels the relay links by their input/output symbols. The second diagram uses the Etkin–Tse–Wang gain indexing for the Gaussian interference channel. These diagrams specify the models; the proofs use the transition laws and channel equations directly.

S \arrow[r, "X\mapsto Y_r"] \arrow[dr, "X\mapsto Y"'] & R \arrow[d, "X_r\mapsto Y"] \\
& D
T_1 \arrow[r, "h_{11}"] \arrow[dr, "h_{12}"'] & R_1 \\
T_2 \arrow[ur, "h_{21}"] \arrow[r, "h_{22}"'] & R_2

The prerequisite page multiuser-channel-networks supplies the finite DM-MAC coding interface used in the finite strong-interference achievability proof. The local Gaussian coding constructions explicitly enforce deterministic power constraints. Noisy network coding includes a Euclidean likelihood-ratio proof and noise-level Gaussian specialization, while the interference comparison treats every weak and mixed regime, including INR below one and clipped coordinate axes. Its noise-level split is nominal: auxiliary removal and rate moving are permitted as proved in the coding bridge. These are draft mathematical constructions; workflow acceptance is recorded separately.

The Gaussian converses use local standard-Borel chain-rule/data-processing and memoryless-vector tensorization lemmas, so codeword coordinates are allowed to be dependent. The scalar Gaussian power bound proves the density-to-mutual-information identity under the stated finite-moment assumptions before applying real or complex maximum entropy.

3 · Logical flowchart

4 · Definitions, theorems and proofs

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Likelihood-ratio network coding for finite or Euclidean multicast networks

Statement

All logarithms, mutual informations and rates in this lemma are in nats. Consider a memoryless network with finite node set [N], source set S, destination set D, and independent uniform source messages, each required by every destination. Alphabets are either all finite, as in Finite discrete memoryless networks and causal codes, or finite-dimensional Euclidean spaces with constant coordinates allowed. Encoders are measurable functions of a node's own message and its past outputs; a destination knows its own message. Choose a finite variable Q and measurable kernels with joint law PQ∏kPXk∣Q W(dy[N]∣x[N])∏kPY^k∣Xk,Yk,Q. Assume AC in the Euclidean case. For each positive-probability q, require a measurable version of the local log likelihood ιk,q=log⁡dPY^k∣Xk,Yk,qdPY^k∣Xk,q(Y^k) to exist and be square-integrable under the target law. For a destination d, nonempty A⊆[N]∖{d}, and U⊆Ac∖{d}, put C0=(A∪U)c, let Pd,q be the target marginal law of (X[N],Y^[N],Yd) given q, and define Qd,A,U,q=PXAc,Y^C0,Yd∣q∏k∈APXk∣q∏k∈A∪UPY^k∣Xk,q. Require Pd,q≪Qd,A,U,q with a measurable square-integrable log likelihood under Pd,q. Require all mutual informations in the following cut expression to be finite: Fd(A)=I(XA;Yd,Y^Ac∣XAc,Q)−I(YA;Y^A∣X[N],Yd,Y^Ac,Q). These likelihood and finiteness hypotheses hold automatically for finite alphabets; zero-mass target atoms are omitted. At any chosen constrained node let ck≥0 be a measurable input cost. Require either E[ck(Xk)2]<∞ and E[ck(Xk)]<Γk, or a deterministic input whose cost is at most Γk. The latter case includes an identically zero input under a zero budget. Unconstrained nodes and constant coordinates are permitted.

Every nonnegative rate tuple satisfying ∑k∈A∩Srk<Fd(A) for every d∈D and nonempty A with d∉A and A∩S≠∅ is achievable by deterministic measurable causal codes. Each constrained node can satisfy ∑t=1mck(Xk,t)≤mΓk on every realized transmitted input sequence of code length m, and hence also its expected average-cost constraint. The closure of the union of these regions over admissible laws is achievable. Constant reconstructions are permitted. The separate all-zero tuple is achievable whenever one can choose fixed inputs obeying any imposed costs, regardless of negative cut expressions.

Facts & Assumptions

Given: The network, product law, square-integrable likelihoods, finite cut informations, and optional slack costs in the statement.

[A1]

The Axiom of Choice: AC is assumed only for the Euclidean conditional-law and conditional-KL interfaces.

[F1]

Finite discrete memoryless networks and causal codes: the finite case uses causal encoders, independent messages, a memoryless channel and average error over all required estimates; the statement specifies the same measurable coding conventions for Euclidean alphabets.

[F2]

Finite conditional mutual information, Finite conditional mutual information identities and equality, and Finite entropy and mutual-information chain rules: finite conditional mutual information is conditional KL, is nonnegative, and obeys the entropy and mutual-information chain rules.

[F3]

Conditional mutual-information chain rule and data processing for standard-Borel variables: in the Euclidean case, conditional-KL chain rules and nonnegativity apply to the specified measurable conditional laws; no infinite quantities are subtracted here.

[F4]

IID finite-variance weak law: sample means of IID square-integrable real variables converge in probability to their expectations, with variance divided by the number of samples.

Proof

1.1F4givenconstructalgebra

Write Ck=I(Yk;Y^k∣Xk,Q). Fix a>0 and 0<ϵ<1/2. Choose a deterministic word qn whose symbol proportions tend to PQ, omitting zero-probability symbols. For node k let rkn(du∣x,y)=∏tPY^k∣Xk,Yk,qt(dut∣xt,yt) and μkn(du∣x)=∏tPY^k∣Xk,qt(dut∣xt). Define Hk(x,y)={u:log⁡(drkn/dμkn)(u)≤n(Ck+a)} and Zk(x,y)=rkn(Hk∣x,y). Under the target product law, the information density is a sum of the stated square-integrable local log likelihoods. Apply [F4] separately to the finitely many positive-probability q subblocks; their lengths tend to infinity and their proportions tend to PQ. Thus its normalized sum tends in probability to Ck, so E(1−Zk)→0. The pointwise inequality 1{1−Zk>ϵ}≤(1−Zk)/ϵ shows that pairs with Zk<1−ϵ have probability tending to zero.

2.1step 1.1givenconstructalgebra

For a good pair Zk≥1−ϵ, put Tk=rkn1Hk/Zk and Mk=en(Ck+a)/(1−ϵ). Generate Lk=⌈enρk⌉ independent reconstruction entries with law μkn, where ρk>Ck+a. Test entries in order, accepting u with probability (dTk/dμkn)(u)/Mk using an independent uniform for each entry. This is at most one, its mean is pk=1/Mk, and pk is independent of the good pair. The no-acceptance probability is (1−pk)Lk≤e−Lk/Mk→0. Use a fixed default index on a bad pair or no acceptance. Conditional on acceptance at a specified label ℓ, the accepted entry has law Tk; an earlier rejected entry has law μkn(du∣x)(1−(dTk/dμkn)(u)/Mk)/(1−pk), bounded by 2μkn for large n; later entries retain law μkn. Multiplication of the independent entry and uniform densities proves these statements and conditional independence of the entries given the pair and ℓ.

3.1step 1.1step 2.1constructalgebra

Since Tk≤rkn/(1−ϵ) and ∥Tk−rkn∥TV=1−Zk on good pairs, the averaged total variation error of the selected reconstruction kernel tends to zero by step 1.1. Summing these errors over the finitely many nodes compares their product kernels to the target product test channel; the bound follows by replacing one kernel at a time and integrating bounded indicator functions. Consequently every full-tuple target event of probability tending to one also holds with probability tending to one for the selected reconstructions, apart from the already vanishing selection failures. Draw one independent uniform for each node, block, message, previous-index branch, and reconstruction entry. A transmitted branch exposes each such uniform at most once. Uninspected branches retain their independent codewords and uniforms; the finite array will be fixed at the end.

4.1F4givenconstructalgebrastep 3.1

Set Jd(A,U)=∑qPQ(q)D(Pd,q∥Qd,A,U,q). The block acceptance test at destination d is the intersection, over every allowed (A,U), of log⁡d∏tPd,qtd∏tQd,A,U,qt(vn)≥n(Jd(A,U)−a). By the square-integrability hypothesis and [F4], all these finitely many tests accept the true target block with probability tending to one. On the displayed event the reference product measure is at most e−n(Jd(A,U)−a) times the target product measure; integration therefore bounds its reference probability by e−n(Jd(A,U)−a). This argument applies to discrete sums and Euclidean integrals alike.

5.1A1F2F3step 4.1algebra

Let Ed(A)=Jd(A,∅). Conditional KL chain rules, using independence of the inputs given Q, give Ed(A)=I(XA;Y^Ac,Yd∣XAc,Q)+∑k∈AI(Y^k;X[N],Y^Ac,Yd,Y^{j∈A:j<k}∣Xk,Q). For a direct verification in finite alphabets, expand the reference likelihood: the input contribution is ∑k∈AH(Xk∣Q)−H(XA∣XAc,Y^Ac,Yd,Q), and the reconstruction contribution is ∑k∈AH(Y^k∣Xk,Q)−H(Y^A∣X[N],Y^Ac,Yd,Q); order the latter entropy by k. The conditional-KL expansion gives the identical formula in the Euclidean case without assuming finite differential entropy. A further chain expansion shows that Jd(A,U)−Ed(A) is the conditional KL of PY^U∣XAc,Y^(A∪U)c,Yd,Q from ∏k∈UPY^k∣Xk,Q, averaged over the displayed conditioning tuple. It is nonnegative; in finite entropy notation it equals ∑k∈UH(Y^k∣Xk,Q)−H(Y^U∣XAc,Y^(A∪U)c,Yd,Q). Thus Jd(A,U)≥Ed(A) for every wrong-current-index pattern.

6.1A1F2F3step 5.1givenalgebra

Subtract Ck from the kth reconstruction summand in step 5.1. The test-channel factorization says that given X[N],YA,Q, the reconstructions in A are conditionally independent and depend only on their own (Xk,Yk,Q). In finite entropy notation the sum of differences is therefore H(Y^A∣X[N],YA,Y^Ac,Yd,Q)−H(Y^A∣X[N],Y^Ac,Yd,Q); conditional-KL chain expansion gives the same identity for the assumed finite Euclidean informations. Consequently Ed(A)−∑k∈ACk=I(XA;Y^Ac,Yd∣XAc,Q)−I(YA;Y^A∣X[N],Y^Ac,Yd,Q)=Fd(A). This cancellation uses the product test channels and does not require independent channel outputs.

7.1F4step 1.1step 3.1step 4.1givenconstructalgebrastep 6.1

For each constrained node with a strict mean-cost inequality choose Eck(Xk)<Γk′<Γk, and condition each independent product input word on ∑tck(xk,t)≤nΓk′. Its conditioning probability bk,n tends to one by [F4], since the cost has finite second moment; the finite-Q subblock argument of step 1.1 applies. Each such word obeys the cost bound deterministically. Its law has density at most 1/bk,n relative to the target product input law and total variation distance 1−bk,n. At an unconstrained node use the unconditioned word and put bk,n=1; at a deterministic already-feasible constrained node use its fixed word and also put bk,n=1, so no strict slack is needed there. For a fresh block the transmitted input tuple is within ∑k(1−bk,n) of its target product law, uniformly in all previous labels. Passing through a kernel preserves this upper bound, because an event's conditional probability is in [0,1]. Thus the vanishing selection-failure and true-test estimates remain valid for these input words.

8.1F1step 2.1step 3.1step 4.1step 7.1construct

Choose a fixed block count B. At node k in each block j, independently generate Xk,j(m,l) for 1≤m≤⌊enBrk⌋ and 1≤l≤Lk, using singleton messages when rk=0 or k∉S, and the word law from step 7.1. For each word generate Lk reconstruction words from μkn(⋅∣Xk,j(m,l)) and the uniforms of step 3.1. All nodes, branches and blocks are independent. Initialize lk,0=1. In block j send Xk,j(mk,lk,j−1), and after the block choose lk,j by step 2.1. This is causal. A destination fixes its own message and its own actual index sequence, and selects the unique other-source message tuple for which some remaining index sequence passes every block test from step 4.1. Ties or no tuple are errors; compression indices need not be uniquely decoded. Every operation is a finite search through measurable tests. The message is repeated across all B blocks, so length nB gives rate tending to rk.

9.1step 1.1step 2.1step 3.1step 4.1step 7.1step 8.1constructalgebra

Expose fresh blocks sequentially. Conditional on messages and previous true labels, the next block arrays are independent of the past, so steps 1.1–3.1, 4.1 and 7.1 apply to its actual transmitted branch. A finite union over NB local selections and B∣D∣ true-message tests gives vanishing true-message failure probability. To track false messages, by symmetry set the true messages to 1. Fix a nonempty wrong-source set T, a false message tuple, a true label path ℓ, and a candidate label path l. Put Aj={k:mk≠1 or lk,j−1≠ℓk,j−1} and Uj={k∉Aj:lk,j≠ℓk,j}. Then T⊆Aj, d∉Aj, and Uj⊆Ajc∖{d}. At a node in Aj the false branch is uninspected; at a node in Uj its candidate reconstruction is an unselected entry of the true branch, subject to the factor 2 bound in step 2.1; all other candidate entries are true selected entries, subject to the factor (1−ϵ)−1.

10.1step 2.1step 3.1step 4.1step 7.1step 9.1algebra

The exact unnormalized measure for one true block and specified successful labels is (∏k(1−pk)ℓk−1pk)1G(x,y)(∏kμXk,n(dxk))W⊗n(dy∣x)∏kTk(duk∣xk,yk), where G means every local pair is good and μXk,n is the word law. There is no division by Pr⁡(G). Integrate nuisance true coordinates and use step 9.1. At most two input words per node are exposed, each bounded by 1/bk,n≤2 for large n. The candidate block subprobability is therefore bounded by the geometric label weight times K∏tQd,Aj,Uj,qt, with K=23N(1−ϵ)−N independent of all labels and n. Retaining the indicator 1G≤1 can only reduce this bound. For a fixed true path, different block arrays are independent; all its branch labels are fixed. The sum of its geometric weights over allowed true paths is at most one. Thus the block packing bounds multiply, with no conditioning on a possibly rare global good event.

11.1step 4.1step 5.1step 9.1step 10.1algebra

Drop the first block's false-message test. For each remaining block step 4.1 and Jd(Aj,Uj)≥Ed(Aj) give the factor Ke−n(Ed(Aj)−a), independently of Uj. For a fixed previous-index pattern A, at most ∏k∈ALk previous-index vectors realize it; at most 2N−1 sets A contain T and exclude d. There are at most ∏k≠dLk final-index choices and enBr(T) false message tuples with set T, where r(T)=∑k∈Trk and ρ(A)=∑k∈Aρk. Summing all these paths and the true weights from step 10.1 gives a constant depending only on N,B,ϵ times ∑∅≠T⊆S∖{d}exp⁡(nBr(T)+n∑k≠dρk−n(B−1)min⁡T⊆A, d∉A{Ed(A)−ρ(A)−a}). Rounding the Lk contributes only another constant for fixed B,N. This is the union bound for every false message/previous-index/current-index pattern.

12.1step 6.1step 9.1step 11.1givenchoosealgebra

If constrained cuts exist, their finitely many strict rate gaps have a positive minimum g. Choose a small and then ρk>Ck+a with ρk−Ck small enough that ∑k∈A(ρk−Ck)+a<g/2 on every cut. Step 6.1 gives Ed(A)−ρ(A)=Fd(A)−∑k∈A(ρk−Ck). For every A⊇T, nonnegativity gives r(T)≤r(A∩S)<Fd(A). Choose B sufficiently large that r(T)<B−1Bmin⁡T⊆A, d∉A{Ed(A)−ρ(A)−a}−1B∑k≠dρk for all finitely many T,d. This is possible because the remaining strict gaps are at least g/2. Fix those choices and let n→∞. Every exponential term in step 11.1 tends to zero, as do the true-message failures. If no constrained cuts exist, all required messages are either absent or already known locally and there is nothing to decode. A finite union over destinations proves multicast reliability.

13.1F1step 3.1step 7.1step 8.1step 12.1constructalgebra∎

In the finite branch, every fixed codebook and seed array induces one of finitely many deterministic encoder/decoder functions on the finite message and observation domains. Aggregate the ensemble distribution over this finite set of functions, enumerate it, and take the first code whose error is at most the ensemble average. Thus neither the auxiliary uniforms nor selection of the final finite code assumes AC. In the Euclidean branch average error over codebooks, messages and the finite uniform arrays and select a deterministic realization whose error tends to zero; a realization of error at most twice the positive average exists by integration, while if the average is zero almost every realization has zero error. The fixed-seed encoders and decoders remain measurable and causal. Each chosen input word obeys its shell bound, so concatenating B words gives the claimed pointwise and expected costs; no random ensemble power assertion is used to select the deterministic code. Constant reconstructions contribute zero information and satisfy the same construction. The all-zero tuple uses singleton messages and any allowed fixed inputs, with zero error. Finally choose strict-region tuples tending to any point of the closure and, for the jth tuple, a sufficiently long code of error below 1/j and rate within 1/j of that tuple. These codes realize the closure by the definition of achievability.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Entropy estimates for complex Gaussian interference converses

Statement

Assume AC, use base-two entropy, and let Zn,Wn be IID unit circular Gaussian vectors independent of Xn, where n−1∑jVar⁡(Xj)≤P. For s≥t≥0, h(sXn+Zn)−h(tXn+Wn)≤nlog⁡21+sP1+tP. For the complex channel in Real and complex two-user Gaussian interference channels, let the two input vectors be independent, obey the average power constraints, and have arbitrary dependence within each vector. Write a=SNR1, b=SNR2, c=INR1, d=INR2, S1n=h12X1n+Z2n, and S2n=h21X2n+Z1n. Then h(Y1n∣S1n)≤nlog⁡2 ⁣(πe[1+c+a1+d]),h(Y2n∣S2n)≤nlog⁡2 ⁣(πe[1+d+b1+c]), h(Y1n)≤nlog⁡2(πe[1+a+c]),h(Y2n)≤nlog⁡2(πe[1+b+d]), h(Y2n∣S2n,X1n)≤nlog⁡2 ⁣(πe[1+b1+c]), and the index-reflected conditional bound also holds.

Facts & Assumptions

Given: The finite-second-moment inputs, independent Gaussian noises, and average power bounds in the statement; entropy is measured in bits.

[A1]

The Axiom of Choice: AC is inherited through the Gaussian and information suppliers.

[F1]

Real and complex two-user Gaussian interference channels: the channel, SNR/INR convention, and average input power constraints.

[F2]

Circular complex Gaussian maximizes differential entropy at fixed second moment: after dividing its natural-log bound by ln⁡2, a complex variable of variance v with finite entropy and positive-definite real covariance has base-two entropy at most log⁡2(πev).

[F3]

Bounded densities with finite second moments have finite differential entropy: bounded densities of finite second moment have finite differential entropy.

[F4]

Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional mutual-information chain rules, nonnegativity, and data processing.

[F5]

Measure-theoretic mutual information: mutual information is the natural-log KL divergence of the joint law from the product of its marginals, measured in nats.

Proof

1.1A1F2F3F4F5givenalgebra

If (T,S) are jointly Gaussian-smoothed finite-second-moment scalar variables with nonsingular joint Gaussian noise, then h(T∣S)=h(T−kS∣S)≤h(T−kS)≤log⁡2(πeVar⁡(T−kS)) for every complex k. The first identity is conditional translation and the first inequality is conditional mutual-information nonnegativity; the second is [F2]. A finite-dimensional convolution with a nonsingular Gaussian has a bounded density, finite second moment, and positive-definite real covariance; [F3], applied after identifying complex vectors with real vectors, therefore makes every relevant joint, marginal, and residual differential entropy finite and verifies the hypotheses of [F2]. In particular the pairs (Y1n,S1n) and (Y2n,S2n) have nonsingular independent receiver-noise coordinates, and the degraded pair below has nonsingular joint Gaussian noise when s>t. Their conditional entropies are differences of these finite joint and marginal entropies. For conditioning additionally on X1n, which need not have a density, first subtract its known translated contribution; independence removes that conditioning and leaves the nonsingular smoothed pair (h22X2n+Z2n,S2n). For a channel with conditional density w(t∣x) and positive output density fT(t), the joint-to-product density ratio is w(t∣x)/fT(t). Thus [F5] gives I(X;T)=∫ln⁡(w(t∣x)/fT(t)) dPX,T. When T=BX+Z with independent nonsingular Gaussian Z, the two log integrals are finite by [F3] and the quadratic Gaussian log density, and this integral equals (ln⁡2)[h(T)−h(Z)]. The same calculation with conditional densities justifies the conditional entropy identities used below, with every base-two entropy difference equal to the corresponding mutual information divided by ln⁡2, since their joint and marginal entropies are finite as established above. At zero signal power the same Gaussian density argument applies without alteration. Coordinate entropy chain rules give h(Tn∣Sn)≤∑jh(Tj∣Sj).

2.1F4F5step 1.1givenconstructalgebracases

Suppose s>t and set Un=sXn+Zn, Vn=t/s Un+1−t/s Wn. The marginal law of Vn is the lower-SNR channel and Xn−Un−Vn is Markov. The chain rule and step 1.1 give h(Un)−h(Vn)=[I(Xn;Un)−I(Xn;Vn)]/ln⁡2=I(Xn;Un∣Vn)/ln⁡2=h(Un∣Vn)−nlog⁡2(πe[1−t/s]): the conditional noise is Zn given t/sZn+1−t/sWn. For a coordinate variance pj, minimizing the quadratic residual variance of Uj given Vj gives (1−t/s)(1+spj)/(1+tpj). Step 1.1 therefore bounds the entropy difference by ∑jlog⁡2((1+spj)/(1+tpj)). This logarithmic ratio has derivative (s−t)/((1+sp)(1+tp)ln⁡2), which is nonnegative and decreasing. Jensen and the average variance bound yield the first claimed inequality. If s=t the two marginal entropies agree; if t=0<s the same construction and computation apply. If s=t=0 both outputs are pure Gaussian noise.

2.2F1F2step 1.1givenalgebra

Let pi,j=Var⁡(Xi,j). The optimal scalar linear estimate of Y1,j from S1,j has residual variance 1+∣h21∣2p2,j+∣h11∣2p1,j/(1+∣h12∣2p1,j): independence of the two user vectors and the noises eliminates all other covariances. Step 1.1 bounds the conditional entropy by the logarithm of this variance times πe. The map x↦x/(1+kx) is increasing and concave on [0,∞) for k≥0, with second derivative −2k/(1+kx)3; hence the residual variance is increasing and concave in the two powers, and its logarithm is also concave and increasing. Jensen and n−1∑jpi,j≤Pi give the first conditional-output bound. Reflection gives the second. This calculation has no division by a channel gain and remains valid when any gain vanishes.

3.1F1F2step 1.1step 2.2givenalgebra∎

The output variances are 1+∣h11∣2p1,j+∣h21∣2p2,j and 1+∣h12∣2p1,j+∣h22∣2p2,j. Applying the coordinate chain rule, [F2], and logarithmic Jensen gives the two unconditioned-output bounds. Given X1n, subtract its contribution from Y2n; independence leaves the linear-estimation problem for h22X2n+Z2n from h21X2n+Z1n. Its coordinate residual variance is 1+∣h22∣2p2,j/(1+∣h21∣2p2,j). The same concavity calculation proves the final conditional bound. Reflection proves its counterpart.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Gaussian superposition Han–Kobayashi region with nonunique decoding and rate moving

Statement

For the complex Gaussian channel in Real and complex two-user Gaussian interference channels, fix Gaussian common/private powers Pic+Pip=Pi, with each component nonnegative. Write a=SNR1, b=SNR2, c=INR1, d=INR2, t1=∣h11∣2P1p, t2=∣h22∣2P2p, q1=∣h12∣2P1p, q2=∣h21∣2P2p, N1=1+q2, N2=1+q1. All following logarithms are base two. Put A1=log⁡2(1+t1/N1),D1=log⁡2(1+a/N1),E1=log⁡2((1+c+t1)/N1),G1=log⁡2((1+c+a)/N1), A2=log⁡2(1+t2/N2),D2=log⁡2(1+b/N2),E2=log⁡2((1+d+t2)/N2),G2=log⁡2((1+d+b)/N2). Every nonnegative pair satisfying r1≤D1,r2≤D2, r1+r2≤A1+G2,r1+r2≤A2+G1,r1+r2≤E1+E2, 2r1+r2≤A1+G1+E2,r1+2r2≤A2+G2+E1 is achievable by Gaussian superposition coding with the fixed split as a nominal distribution and with auxiliary removal and rate moving allowed. More precisely, if also r1≤A1+E2 and r2≤A2+E1, the original split suffices, with each receiver decoding its own message uniquely and the unintended common index nonuniquely. If the first extra inequality fails, one may discard user 2's private layer, encode all its information in its nominal common layer, encode all user 1 information in one full-power Gaussian codeword, let receiver 1 decode both codewords, and let receiver 2 treat user 1 as noise. The reflected alternative applies if the other extra inequality fails. The two extra inequalities cannot fail together. All codes satisfy the expected average power constraints. Closure includes singleton streams and boundary pairs.

Facts & Assumptions

Given: A complex channel, a nominal split, and a nonnegative rate pair satisfying the seven displayed facets.

[A1]

The Axiom of Choice: AC is inherited through the Gaussian-law and information suppliers.

[F1]

Real and complex two-user Gaussian interference channels: the channel and its expected average power constraints.

[F2]

IID finite-variance weak law: IID finite-variance information-density averages converge in probability to their means.

[F3]

Power bound for real and complex scalar Gaussian channels: Gaussian scalar mutual informations have their variance-ratio values.

[F4]

Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional chain rules, data processing, and nonnegativity.

Proof

1.1A1F1F2F3F4givenconstructalgebra

For private rates pi≥0 and common rates ui≥0 with pi+ui=ri, generate independent Gaussian common codewords Ui(mic) of power Pic and, for every common index, an independent Gaussian satellite codebook Vi(mic,mip) of power Pip. Transmit Ui+Vi. Receiver 1 uniquely decodes (m1c,m1p) if some index m2c passes its conditional Gaussian information-density tests; it does not output m2c. Its four false-own-message classes have rate exponents p1, r1, p1+u2, and r1+u2: respectively wrong private only, wrong own common and its satellite, wrong private and unintended common, and wrong own common and unintended common. Conditional on the correctly indexed layers, a false class has the product law against which its likelihood ratio has mean one. Markov's inequality at a threshold strictly between its rate exponent and its Gaussian mutual information, followed by the union bound, makes its error probability vanish if p1<A1, r1<D1, p1+u2<E1, r1+u2<G1. A wrong unintended index alone is not an error because it leaves the decoded own message unchanged. The true information densities are IID quadratic Gaussian functions with finite variance, so [F2] proves correct-message acceptance; [F3] gives exactly the four displayed Gaussian quantities. Receiver 2 gives p2<A2, r2<D2, p2+u1<E2, r2+u1<G2. Zero-rate or zero-power layers have singleton message sets and no false-message class.

2.1F1F2step 1.1givenchoosealgebra

Deterministic power selection is included as follows. Initially reduce every positive component power by a factor 1−ε, with 0<ε<1. For user i let Bi,j be its input energy at coordinate j, averaged over the finitely many independent message indices of that user's codebook, including the cross term in ∣Ui+Vi∣2. Across coordinates the Bi,j are IID; Jensen gives EBi,j2≤E∣Ui+Vi∣4≤3((1−ε)Pi)2≤3Pi2, independently of message-set size. The fourth moment is 3σ4 for a real Gaussian of variance σ2 and 2σ4 for a circular complex Gaussian of second moment σ2. Thus Var⁡(n−1∑jBi,j)≤3Pi2/n and its mean is (1−ε)Pi. Chebyshev makes the probability of either power exceeding Pi tend to zero. The ensemble average sum of receiver errors tends to zero by step 1.1; Markov makes the probability of an error larger than the square root of that average tend to zero. Hence some deterministic codebook simultaneously meets both exact average power constraints and has vanishing errors. If a user's total power is zero, its codeword is zero and its rate is zero. Fix ε first, take the coding limit, and then let ε↓0; continuity and closure give the claimed nonslack region. This argument also applies to every simpler Gaussian codebook used below.

3.1F3F4step 1.1step 2.1givenalgebra

The eight inequalities in step 1.1, with closure removing strictness, project exactly to the seven stated facets plus r1≤A1+E2 and r2≤A2+E1. Here is an explicit elimination. Set S=r1+r2, l1=max⁡(0,S−G2), l2=max⁡(0,S−G1), v1=min⁡(A1,r1), v2=min⁡(A2,r2). The private rates must lie in [li,vi] and satisfy r1−E2≤p1−p2≤E1−r2. Such rates exist exactly when li≤vi and the intervals [l1−v2,v1−l2] and [r1−E2,E1−r2] intersect. Expanding the max/min comparisons gives S≤A1+G2, S≤A2+G1, r1≤A1+E2, r2≤A2+E1, S≤E1+E2, 2r1+r2≤A1+G1+E2, r1+2r2≤A2+G2+E1, together with ri≤Di. The other comparisons are redundant: ri≤Gi follows from Di≤Gi, and S≤G2+E1 or S≤G1+E2 follows from S≤E1+E2 and Ei≤Gi; the remaining inequalities are nonnegativity of the Gaussian mutual informations. Conversely these same comparisons ensure the intervals intersect, providing the desired pi.

4.1F1F2F3F4step 1.1step 2.1step 3.1givenconstructalgebra

Suppose r1>A1+E2. The seven facets give r2<G2−E2 from S≤A1+G2, r2<E1−A1 from S≤E1+E2, S<G1 from 2r1+r2≤A1+G1+E2, and r1≤D1. Use a single Gaussian user 1 codebook of full power P1 and only the nominal common user 2 power P2c, carrying all of user 2's information; set its private layer to zero. At receiver 1 the user-1 bound is at least D1, and the user-2 bound log⁡2(1+∣h21∣2P2c) is at least E1−A1, the nominal I(U2;Y1∣U1); the sum bound is at least G1 because c≥q2 gives 1+a+c−q2≥(1+a+c)/(1+q2). Receiver 2's treating-user-1-as-noise bound is at least G2−E2, the nominal I(U2;Y2), since removing user 2's private satellite reduces the noise. These four inequalities are precisely the Gaussian two-codeword MAC tests at receiver 1 and the single-codeword test at receiver 2; the likelihood-ratio union proof in step 1.1 with two streams proves achievability directly. The sum of the powers used is no larger than the prescribed powers, and step 2.1 selects deterministic power-feasible codebooks. This describes the changed labels and powers explicitly: all user 1 information is private at the unintended receiver, so its actual private INR can exceed the nominal q1; user 2 uses only its nominal common power.

5.1F1F3step 2.1step 3.1step 4.1givencases∎

If instead r2>A2+E1, reflect the construction in step 4.1. Both extra individual inequalities cannot fail together, since that would give S>A1+A2+E1+E2≥E1+E2, contradicting a stated sum facet. When neither fails use step 3.1. Equality cases follow by closure of these achievable regions and the power-slack limit in step 2.1. If a layer is singleton it contributes no competing index; if both rates are zero use the all-zero code. This proves the entire seven-facet region, with the explicit nominal-policy and auxiliary-removal convention in the statement.

DefinitionDefinition: Literature-sourcedProof: Not applicableprecheck pendingOpen item page →

Finite discrete memoryless networks and causal codes

Definition

A finite discrete memoryless network (DMN) has a node set [N]={1,…,N} for an integer N≥1, finite nonempty input alphabets Xk and output alphabets Yk, and one transition probability vector W(y1,…,yN∣x1,…,xN) for each input tuple. At each use, conditional on the current input tuple, the output tuple is drawn from this vector independently of earlier uses.

Node k may have an independent uniform message Mk in a finite nonempty set Mk and a destination set Dk⊆[N]. A length-n causal code consists of encoders Xk,i=fk,i(Mk,Yki−1) and, for each destination d∈Dk, a decoder M^kd=gkd(Ydn,Md); here Yki−1=(Yk,1,…,Yk,i−1), with the empty tuple at i=1. The average error is the probability that any required estimate differs from its message. A rate tuple is achievable if a sequence of such codes has error tending to zero and message-set rates tending to at least that tuple; the capacity region is the closure of achievable tuples.

DefinitionDefinition: Literature-sourcedProof: Not applicableprecheck pendingOpen item page →

Real scalar Gaussian multicast relay network and power constraints

Definition

A real scalar Gaussian relay network has node set [N] for an integer N≥1, source set S⊆[N], destination set D⊆[N], one real input Xi and output Yi at each node, and channel equations Yj=∑i=1NgjiXi+Zj,j∈[N], where the gains gji∈R are fixed and the noises Zj are independent N(0,1) random variables, independent across channel uses and of all source messages. At each use the current noise vector is independent of all past observations and the current inputs; future inputs may depend on past noises through feedback. Each node has a nonnegative power budget Pi≥0 and average power constraint 1n∑t=1nE[Xi,t2]≤Pi. Each source i∈S has an independent uniform message Mi in a finite nonempty set Mi. For every non-source node i∉S, set Mi={∗} and Mi=∗, so its encoder has no message information. A length-n causal code uses measurable encoders Xi,t=fi,t(Mi,Yit−1) and destination decoders based on (Ydn,Md), where Md is its own source message when d∈S and a singleton otherwise; multicast means every destination must decode every other source message, while its own message is already known. The average error probability is the probability that any required destination estimate is wrong. Write GB,A for the matrix with rows indexed by B and columns by A whose entries are gji.

Rates in this page's Gaussian formulas are measured in bits per use, Ri=n−1log⁡2∣Mi∣.

DefinitionDefinition: Literature-sourcedProof: Not applicableprecheck pendingOpen item page →

Real and complex two-user Gaussian interference channels

Definition

The two-user Gaussian interference channel has independent messages, separate encoders, and outputs Y1=h11X1+h21X2+Z1,Y2=h12X1+h22X2+Z2. For the real model, Xi,hji,Zj are real and Zj∼N(0,1). For the complex model, the inputs and gains are complex and Zj∼CN(0,1) with density π−1e−∣z∣2. The receiver-noise variables are independent across receivers and channel uses and independent of the messages, so the channel is memoryless. Each power budget satisfies Pi≥0. A length-n code has independent uniform messages Mi on [mi] for integers mi≥1, deterministic separate encoders Xin=fi(Mi), and decoders M^i=gi(Yin); no feedback is present. The expected average-power constraints are n−1∑t=1nE[Xi,t2]≤Pi in the real model and n−1∑t=1nE∣Xi,t∣2≤Pi in the complex model, with expectations under the uniform message law. The average joint error is Pr⁡{(M^1,M^2)≠(M1,M2)}. For either model define SNR1=∣h11∣2P1,SNR2=∣h22∣2P2,INR1=∣h21∣2P2,INR2=∣h12∣2P1. Rates are bits per use, Ri=n−1log⁡2mi. For a scalar unit-noise AWGN link Y=aX+Z with power constraint P, the capacity is κlog⁡2(1+∣a∣2P), attained by a centered real Gaussian input or a circular complex Gaussian input; κ=1/2 in the real model and κ=1 in the complex model.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Gaussian maximizes differential entropy at fixed positive-definite covariance

Statement

Assume the Axiom of Choice. If a random vector X∈Rd has a Lebesgue density, finite mean m, positive-definite covariance K, and finite differential entropy h(X)=−∫fln⁡f, then h(X)≤12ln⁡((2πe)ddet⁡K). Equality holds exactly when X has the Gaussian law Nd(m,K).

Facts & Assumptions

Given: AC and a density f of a random vector with finite mean m, positive-definite covariance K, and finite differential entropy.

[A1]

The Axiom of Choice: AC is the choice axiom assumed by the Gaussian-law and KL suppliers used below.

[F1]

A positive-definite multivariate normal law has its Gaussian density: if K is positive definite, the law Nd(m,K) has an everywhere-positive Lebesgue density proportional to exp⁡[−(x−m)TK−1(x−m)/2].

[F2]

Kullback–Leibler divergence is nonnegative: D(P∥Q)≥0, with equality only when P=Q, under AC.

Proof

1.1A1F1givenalgebra

Let g be the everywhere-positive Gaussian density in [F1] with mean m and covariance K. Since f is a Lebesgue density and g>0 everywhere, the law Pf is absolutely continuous with respect to Pg. The log ratio is integrable: ∫fln⁡f is finite by hypothesis, while ln⁡g is a constant plus a quadratic form and X has finite second moments. Hence D(Pf∥Pg)=∫fln⁡(f/g)=−h(X)+d2ln⁡(2π)+12ln⁡det⁡K+12E[(X−m)TK−1(X−m)]. The last expectation is tr⁡(K−1K)=d, by expanding the finite quadratic form and using the covariance entries.

2.1F1F2step 1.1algebra∎

By [F2], the left side in step 1.1 is nonnegative, which rearranges to the displayed entropy bound. Equality holds exactly when D(Pf∥Pg)=0, which by [F2] is equivalent to equality of the laws; thus X∼Nd(m,K). Conversely, substituting the density g into the entropy integral gives equality because its centered quadratic expectation is d.

DefinitionDefinition: Literature-sourcedProof: Not applicableprecheck pendingOpen item page →

Finite discrete memoryless relay channel and causal code

Definition

A finite discrete memoryless relay channel is the three-node instance of Finite discrete memoryless networks and causal codes with source input X∈X, relay input Xr∈Xr, relay observation Yr∈Yr, destination observation Y∈Y, and transition law W(yr,y∣x,xr). For a positive integer message-set size M, the one-way message is uniform on [M] and the destination estimates it from Yn.

In the relay-only causal model, Xi=fi(M) and Xr,i=gi(Yri−1). In the full output-feedback model, both encoders know the past pair (Yi−1,Yri−1), so Xi=fi(M,Yi−1,Yri−1) and Xr,i=gi(Yi−1,Yri−1). In either model the channel outputs at time i are drawn from W(⋅,⋅∣Xi,Xr,i); no encoder sees a current-time output before choosing its current input. The rate is n−1ln⁡M, and achievability uses average error under the uniform message law.

DefinitionDefinition: Literature-sourcedProof: Not applicableprecheck pendingOpen item page →

Finite two-user interference channel and strong-interference regime

Definition

A finite two-user interference channel is the two-sender, two-receiver memoryless channel with finite nonempty input alphabets X1,X2, finite nonempty output alphabets Y1,Y2, and transition law W(y1,y2∣x1,x2). Independent uniform messages M1,M2 on finite nonempty sets are encoded separately as X1n=f1(M1) and X2n=f2(M2); receiver i estimates Mi from Yin. The strong-interference regime means that, for every product law PX1PX2, I(X1;Y1∣X2)≤I(X1;Y2∣X2),I(X2;Y2∣X1)≤I(X2;Y1∣X1). The inequalities are evaluated under the stated product law and the channel. They are universal hypotheses over input laws, not just inequalities at a chosen optimizing distribution.

DefinitionDefinition: Literature-sourcedProof: Not applicableprecheck pendingOpen item page →

Finite two-way relay channel and causal code

Definition

A finite two-way relay channel is the three-node DMN of Finite discrete memoryless networks and causal codes with terminal inputs X1,X2, relay input Xr, terminal outputs Y1,Y2, relay observation Yr, and transition law W(y1,y2,yr∣x1,x2,xr). Terminals 1 and 2 have independent uniform messages M1 and M2 and wish to exchange them. A causal code uses X1,i=f1,i(M1,Y1i−1), X2,i=f2,i(M2,Y2i−1), and Xr,i=fr,i(Yri−1); terminal 1 estimates M2 from (M1,Y1n) and terminal 2 estimates M1 from (M2,Y2n). The probability of error is the probability either estimate is wrong. This is a full-duplex model: all three nodes choose an input at every use, and each input depends only on that node's message and past observations.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingjudge pass (gpt-6-luna)Open item page →

Bounded densities with finite second moments have finite differential entropy

Statement

Let f be a Lebesgue probability density on Rd with ∥f∥∞<∞ and ∫∣x∣2f(x) dx<∞. Then ∫f(x)∣ln⁡f(x)∣ dx<∞, so the differential entropy in Differential entropy for real densities is a finite real number.

Facts & Assumptions

Given: A Lebesgue probability density f with finite essential supremum and finite second moment.

[F1]

Differential entropy for real densities: differential entropy is defined by h(f)=−∫fln⁡f in the absolutely integrable case.

Proof

1.1givenalgebra

Let q(x)=(2π)−d/2e−∣x∣2/2 and M=max⁡{1,∥f∥∞}. On {f>1}, fln⁡f≤fln⁡M, so the positive part is integrable. For t≥0, tln⁡(1/t)≤1/e; with t=f/q, this gives fln⁡(q/f)≤q/e. Thus on {f≤1}, −fln⁡f=fln⁡(q/f)−fln⁡q≤q/e+f∣ln⁡q∣. The right side is integrable because q is a probability density and ∣ln⁡q∣ is bounded by a constant plus ∣x∣2/2. Hence the negative part of fln⁡f is integrable.

2.1F1step 1.1algebra∎

Both parts of fln⁡f are integrable by step 1.1. Therefore ∫f∣ln⁡f∣<∞, and [F1] defines a finite differential entropy.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingjudge pass (gpt-6-luna)Open item page →

Circular complex Gaussian maximizes differential entropy at fixed second moment

Statement

Assume AC. Let Z∈C have a Lebesgue density, finite mean μ, finite differential entropy, and positive-definite real covariance matrix K for (Re⁡Z,Im⁡Z). Put σ2=E∣Z−μ∣2=tr⁡K. Then h(Z)≤ln⁡(πeσ2). Equality holds exactly for the circular complex Gaussian law CN(μ,σ2) with density (πσ2)−1exp⁡(−∣z−μ∣2/σ2).

Facts & Assumptions

Given: AC and the density, mean, entropy, and positive-definite real covariance hypotheses in the Statement.

[A1]

The Axiom of Choice: AC is required by the Gaussian-law and entropy supplier.

[F1]

Gaussian maximizes differential entropy at fixed positive-definite covariance: a real vector with positive-definite covariance K and finite differential entropy satisfies h≤12ln⁡((2πe)ddet⁡K), with equality exactly for the matching real Gaussian law.

Proof

1.1A1F1givenalgebra

Identify Z with the real vector (Re⁡Z,Im⁡Z). This identification preserves Lebesgue measure and the differential-entropy integral, so [F1] with d=2 gives h(Z)≤12ln⁡((2πe)2det⁡K).

2.1F1step 1.1algebra∎

Let λ1,λ2>0 be the eigenvalues of K. Then det⁡K=λ1λ2≤((λ1+λ2)/2)2=(σ2/2)2, because (λ1−λ2)2≥0. Substitution into step 1.1 gives h(Z)≤ln⁡(πeσ2). Equality requires equality in [F1] and λ1=λ2, so Z is Gaussian with real covariance (σ2/2)I2, exactly CN(μ,σ2). Conversely, substituting that circular Gaussian density gives entropy ln⁡(πeσ2).

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Joint strong typicality for a finite IID source

Statement

Let P be a probability vector on a finite alphabet A. For every δ>0, the support-restricted strongly typical set Tδ(n)(P) of Finite strongly typical sets with support restriction satisfies P⊗n(Tδ(n)(P))⟶1(n→∞).

Facts & Assumptions

Given: A finite alphabet A, a probability vector P, and δ>0.

[F1]

Finite strongly typical sets with support restriction: membership requires that each positive-mass letter's empirical frequency differ from its probability by at most the relative tolerance δP(a), and excludes zero-mass letters.

Proof

1.1F1givenalgebra

Fix a∈A with P(a)>0, and set Bi=1{Xi=a}. The variables Bi are IID Bernoulli with mean P(a) and variance P(a)(1−P(a))≤1/4. Thus P^Xn(a)=n−1∑iBi has mean P(a) and variance at most 1/(4n). If Z=P^Xn(a)−P(a), then pointwise 1{∣Z∣>δP(a)}≤Z2/(δ2P(a)2). Taking expectations bounds the deviation probability by 1/(4nδ2P(a)2).

2.1F1step 1.1algebra∎

If P(a)=0, then Pr⁡[Xi=a]=0 for each i, so the probability that the word contains a is zero by a finite union bound. There are finitely many positive-mass letters; summing the bounds from step 1.1 over them and adding the zero support event shows that the probability of failure of any condition in [F1] tends to zero.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Noise-level noisy-network-coding inner bound for real Gaussian multicast networks

Statement

All mutual informations and rates in this item are measured in bits; differential entropies in the proof are in nats and are divided by ln⁡2.

In the real Gaussian multicast network of Real scalar Gaussian multicast relay network and power constraints, take independent Gaussian inputs Xi∼N(0,Pi) and independent Gaussian test-channel noises. For a chosen node set Q⊆[N], set Y^i=Yi+Z^i with Z^i∼N(0,1) for i∈Q and let Y^i be constant otherwise. Every nonnegative rate tuple satisfying ∑k∈A∩SRk<I(XA;Yd,Y^Ac∩Q∣XAc)−I(YA∩Q;Y^A∩Q∣X[N],Yd,Y^Ac∩Q) for every destination d∈D and every cut A⊆[N] with d∉A and A∩S≠∅ is achievable under the stated average-power constraints. The closure of the union of these strict regions over the stated choices, together with the all-zero tuple, is achievable.

In the special case Pi=P>0 for every node and Q=[N], a noise-level evaluation gives the sufficient cut inequalities ∑k∈A∩SRk<12log⁡2det⁡ ⁣(I+P2G(A)G(A)T)−∣A∣2 for every A⊆[N] with Ac∩D≠∅ and A∩S≠∅, where G(A)=GAc,A. Their closure is achievable. The all-zero rate tuple is always achievable by singleton source-message sets, independently of whether these cut right-hand sides are nonnegative.

Facts & Assumptions

Given: The real Gaussian network, arbitrary nonnegative node powers Pi, independent Gaussian inputs and unit-variance quantization noises on the chosen set Q; for the determinant specialization all powers equal P>0 and Q=[N].

[A1]

The Axiom of Choice: AC is assumed through the Euclidean conditional-law and conditional-KL suppliers.

[F1]

Real scalar Gaussian multicast relay network and power constraints: Yj=∑igjiXi+Zj with independent unit Gaussian noises across nodes and times, measurable causal encoders, destination knowledge of its own message, and per-node expected average-square constraint Pi.

[F2]

Likelihood-ratio network coding for finite or Euclidean multicast networks: square-integrable local and packing log likelihoods, finite cut informations and finite-second-moment slack input costs imply the NNC cut inner bound in nats, with deterministic measurable encoders, pointwise input-word cost bounds, constant reconstructions, and closure.

[F3]

Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional-KL chain rules and nonnegativity apply to these finite Gaussian informations; adding observations cannot decrease mutual information.

Proof

1.1A1F1F2givenconstructalgebra

Initially choose 0<Pi′<Pi when Pi>0, and set Xi=0 when Pi=0. On positive-power nodes take independent Xi∼N(0,Pi′). Use the stated reconstruction kernels. Remove constant coordinates when writing densities. The remaining joint coordinates (X,Y,Y^Q) are an invertible linear image of the independent nonconstant inputs, channel noises and quantization noises: recover inputs first, channel noises from Y−GX, and quantization noises from Y^Q−YQ. They therefore have a strictly positive nonsingular Gaussian density. Its needed marginal and conditional densities are likewise Gaussian with positive conditional covariance, so all local and reference likelihood ratios in [F2] exist measurably. Every log ratio is a constant plus a quadratic polynomial in Gaussian variables.

2.1A1F2step 1.1algebra

These log ratios are square-integrable: a quadratic polynomial squared is a finite sum of monomials of degree at most four, and Gaussian fourth moments are finite. Explicitly for a scalar N(0,v) density, integrating by parts twice gives EZ4=3v2; Gaussian coordinates have those scalar marginal laws, and E(Zi2Zj2)≤(EZi4 EZj4)1/2. The input cost ci(x)=x2 also has finite second moment 3(Pi′)2 and mean Pi′<Pi. All the Gaussian cut mutual informations are finite, as differences of finite Gaussian conditional log-density expectations. Thus every Euclidean hypothesis of [F2] holds at the positive-power nodes with slack square costs; zero-power inputs are fixed zero coordinates satisfying their constraints pointwise and need no shell constraint.

3.1A1F1F2step 2.1constructalgebra

Apply [F2] with constant time-sharing variable, converting ri=Riln⁡2. It gives precisely the first displayed strict cut inequalities at variances Pi′, since constant reconstructions may be deleted from both mutual informations. Its codes are deterministic and measurable, and every positive-power input word has empirical square cost at most a threshold strictly below Pi. Hence the expected average-power constraints in [F1] hold for the chosen deterministic code, independently of messages and selected compression indices. Zero-power nodes always send zero.

4.1A1F1F2step 1.1step 3.1algebra

Increase Pi′ to Pi simultaneously at positive-power nodes. Each mutual information in these finitely many cuts is a continuous function of the variances: its Gaussian entropy formula is a log determinant of a positive-definite conditional noise covariance plus a positive-semidefinite signal covariance. One may derive the formula directly from the Gaussian density: for positive-definite K, integration of its log density gives h(N(0,K))=12ln⁡((2πe)mdet⁡K) because the expected quadratic form is m. Conditional noise covariance is positive definite even at the limiting input variances. Therefore any tuple satisfying all strict inequalities at Pi satisfies them at Pi′ sufficiently close to Pi. Use the codes from step 3.1, already satisfying the original power constraints. This proves the full chosen-Q achievability assertion, including arbitrary zero-power nodes.

5.1F1step 4.1givenalgebra

For the target Gaussian law, conditioned on all inputs the noises at nodes in A are independent of (Yd,Y^Ac∩Q), since d∉A and channel and quantization noises are independent across nodes. Each active source-side test channel adds independent unit quantization noise to unit channel noise. Using the density entropy formula from step 4.1 gives I(YA∩Q;Y^A∩Q∣X[N],Yd,Y^Ac∩Q)=∣A∩Q∣2log⁡22=∣A∩Q∣2. Constants contribute zero. This calculation holds for every destination outside A and all choices of powers.

6.1F1F3step 4.1step 5.1givenalgebra

When Q=[N] and all powers equal P, condition on XAc. The quantized vector Y^Ac is a known translation of G(A)XA plus an independent Gaussian vector of covariance 2I. Its entropy minus the entropy of that noise, divided by ln⁡2, gives I(XA;Y^Ac∣XAc)=12log⁡2det⁡(I+P2G(A)G(A)T). By [F3], adding Yd can only increase this positive mutual-information term. Subtracting the penalty ∣A∣/2 from step 5.1 proves the sufficient determinant inequality for every destination outside every admissible cut. Step 4.1 makes all tuples satisfying this finite family of strict sufficient inequalities achievable.

7.1F1F2step 4.1step 6.1construct∎

The closure of the strict regions follows from [F2], or by selecting successively longer reliable codes for rate tuples tending to the claimed boundary points. For the all-zero tuple give every source a singleton message set, transmit zero at all nodes, and return the unique messages at every destination; error and power are both zero. This argument applies even if a sufficient cut expression is negative.

DefinitionDefinition: Literature-sourcedProof: Not applicableprecheck pendingOpen item page →

Finite directed information and causal conditioning

Definition

For finite random sequences Xn=(X1,…,Xn) and Yn=(Y1,…,Yn), define the directed information from Xn to Yn by I(Xn→Yn):=∑i=1nI(Xi;Yi∣Yi−1), where Xi=(X1,…,Xi) and Y0 is the empty tuple. For a third finite sequence Zn, define the causally conditioned version I(Xn→Yn∥Zn):=∑i=1nI(Xi;Yi∣Yi−1,Zi). All conditional mutual information terms use the finite nats convention of Finite conditional mutual information. The conditioning includes Zi because it is the current side-information symbol available at the receiving end of the directed-information term; Yi−1 and Zi−1 are the past.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Conditional random-codebook covering for finite alphabets

Statement

Let (V,X,U) have a joint law PV(v)PX∣V(x∣v)PU∣X,V(u∣x,v) on finite alphabets. Fix η>0. There are tolerances 0<δin<δout such that, for every sufficiently large n, every (vn,xn) in the support-restricted strongly typical set Tδin(n)(PVX), and every R>I(X;U∣V)+η, a codebook of ⌈enR⌉ conditionally independent words drawn from PU∣V⊗n(⋅∣vn) contains a word making (vn,xn,un)∈Tδout(n)(PVXU) with probability tending to one uniformly over those fixed pairs.

Facts & Assumptions

Given: A finite law PVXU=PVPX∣VPU∣X,V and η>0.

[F1]

Finite strongly typical sets with support restriction: a block is strongly typical when each positive-mass joint letter has empirical frequency within a relative tolerance of its probability and zero-mass letters are absent.

[F2]

Finite conditional mutual information: I(X;U∣V) is the finite average, over v, of D(PXU∣v∥PX∣vPU∣v) in nats.

Proof

1.1F1givenalgebra

Fix (vn,xn)∈Tδin(n)(PVX). For this concentration calculation, draw an auxiliary word under Qn:=PU∣X,V⊗n(⋅∣xn,vn), rather than under the codebook law Cn:=PU∣V⊗n(⋅∣vn). For each positive-mass triple (v,x,u), its empirical frequency under Qn has mean P^vnxn(v,x)PU∣X,V(u∣x,v), which differs from P(v,x,u) by at most δinP(v,x,u). Its variance is at most 1/(4n) because its indicator summands are independent across positions. Chebyshev's inequality with deviation threshold (δout−δin)P(v,x,u) and a finite union bound show that all positive-mass triple frequencies meet the δout conditions with probability tending to one uniformly over the fixed input pairs. Zero-mass input pairs are absent and zero conditional-probability outputs are never generated.

2.1F1F2step 1.1algebra

For a triple word in Tδout(n)(PVXU), the exact likelihood ratio is ln⁡PU∣X,V⊗n(un∣xn,vn)PU∣V⊗n(un∣vn)=n∑v,x,uP^vnxnun(v,x,u)ln⁡P(u∣x,v)P(u∣v). Every logarithm on the positive target support is finite. At the target law this finite sum is IP(X;U∣V) by [F2]; it is linear in the empirical probabilities. Choose δout small enough that it is at most IP(X;U∣V)+η/3 on every target-typical triple. On the target-typical set T, Qn/Cn≤en(IP(X;U∣V)+η/3) and Qn≪Cn. Therefore Cn(T)≥e−n(IP(X;U∣V)+η/3)Qn(T); step 1.1 gives a one-word match probability at least (1−o(1))e−n(IP(X;U∣V)+η/3), uniformly over the fixed input pairs.

3.1givenstep 2.1algebra∎

The codewords are conditionally independent given vn. If pn(vn,xn) is their one-word match probability and Mn=⌈enR⌉, then the probability that no word matches is (1−pn)Mn≤e−Mnpn. Since R>IP(X;U∣V)+η, step 2.1 gives Mnpn→∞ uniformly, so the no-match probability tends to zero. This proves the covering claim.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Conditional joint-typicality packing bound for finite alphabets

Statement

Let (V,U,Z) have any joint law PVUZ on finite alphabets. Fix η>0. For every sufficiently small strong-typicality tolerance, every sufficiently large n, and every fixed (vn,zn) typical for the marginal PVZ, an independent candidate word drawn from the product law PU∣V⊗n(⋅∣vn) satisfies Pr⁡{(vn,Un,zn) is jointly typical for PVUZ}≤e−n(IP(U;Z∣V)−η). The conclusion includes the case that V is constant, giving the exponent IP(U;Z).

Facts & Assumptions

Given: A finite joint law PVUZ, η>0, and fixed typical (vn,zn).

[F1]

Finite strongly typical sets with support restriction: typicality restricts empirical distributions to a finite-alphabet neighborhood of the target law and excludes unsupported atoms.

[F2]

Finite conditional mutual information: I(U;Z∣V) is the finite conditional-KL average in nats.

Proof

1.1F1F2givenalgebra

For any jointly typical supported candidate un, ln⁡PU∣V⊗n(un∣vn)PU∣V,Z⊗n(un∣vn,zn)=n∑v,u,zP^vnunzn(v,u,z)ln⁡P(u∣v)P(u∣v,z). The logarithms are finite on the positive target support. At PVUZ the finite sum equals −IP(U;Z∣V) by [F2], and it is linear in the empirical probabilities. Choose the typicality tolerance small enough that every jointly typical triple has this sum at most −IP(U;Z∣V)+η.

2.1F1step 1.1algebra∎

Sum the likelihood-ratio expression of step 1.1 over the jointly typical candidates. The target conditional law is a probability vector, so its mass on that set is at most one; the exponential likelihood ratio is at most e−n(IP(U;Z∣V)−η). This gives the claimed bound. Joint typicality excludes unsupported triples; on each supported target triple both conditional probabilities in the ratio are positive.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Power bound for real and complex scalar Gaussian channels

Statement

Assume AC. Let X be real or complex with finite second moment, let Z be independent unit-variance Gaussian noise, and let Y=aX+Z. In the real case take Z∼N(0,1) and a∈R; in the complex case take Z∼CN(0,1) with density π−1e−∣z∣2 and a∈C. Put v=E∣X−EX∣2 and κ=1/2 in the real case, κ=1 in the complex case. Then I(X;Y)≤κln⁡(1+∣a∣2v)≤κln⁡(1+∣a∣2E∣X∣2) in nats; division by ln⁡2 gives the corresponding bit formula. Equality in the first inequality holds when X is Gaussian in the real case or circular complex Gaussian in the complex case, including the zero-variance case.

Facts & Assumptions

Given: AC, an input law with finite second moment, independent unit-variance Gaussian noise of the stated type, and the scalar channel Y=aX+Z.

[A1]

The Axiom of Choice: AC is inherited from the real and complex Gaussian entropy bounds and the measure-theoretic information definition.

[F1]

Measure-theoretic mutual information: I(X;Y) is the KL divergence from the joint law to the product of its marginals.

[F2]

Differential entropy for real densities: when Y has a density with absolutely integrable fYln⁡fY, h(Y)=−∫fYln⁡fY.

[F3]

Gaussian maximizes differential entropy at fixed positive-definite covariance: for real Y, h(Y)≤12ln⁡(2πeVar⁡Y).

[F4]

Circular complex Gaussian maximizes differential entropy at fixed second moment: for complex Y, h(Y)≤ln⁡(πeE∣Y−EY∣2).

[F5]

Bounded densities with finite second moments have finite differential entropy: a bounded density with finite second moment has absolutely integrable fln⁡f.

Proof

1.1F2F5givenalgebra

The output density is the convolution fY(y)=∫gZ(y−ax)PX(dx), so 0<fY≤∥gZ∥∞<∞, and Y has finite second moment. By [F5], ∫fY∣ln⁡fY∣<∞, so [F2] defines a finite differential entropy h(Y).

2.1A1F1F2step 1.1algebra

The positive Gaussian noise density makes fY(y)>0. Relative to PX(dx)fY(y)dy, the joint law of (X,Y) has density gZ(y−ax)/fY(y). By [F1], I(X;Y)=∫PX(dx)∫gZ(y−ax)ln⁡gZ(y−ax)fY(y)dy=h(Y)−h(Z). The two logarithmic integrals are finite by step 1.1 and the Gaussian density formula, so this identity involves no subtraction of infinite quantities.

3.1F3F4step 2.1givenalgebra∎

Independence gives Var⁡(Y)=1+∣a∣2v. Apply [F3] and the real Gaussian noise entropy in the real case, or [F4] and h(Z)=ln⁡(πe) in the complex case. Step 2.1 then yields I(X;Y)≤κln⁡(1+∣a∣2v) nats. Since v≤E∣X∣2, division by ln⁡2 gives the corresponding bit bound. For the stated Gaussian inputs, the output is Gaussian of the same real or circular complex type and attains the matching maximum-entropy equality.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Gaussian Han-Kobayashi inner region for a fixed private-power split

Statement

For either Gaussian model in Real and complex two-user Gaussian interference channels, choose private powers 0≤P1p,P2p≤P1,P2 and common powers Pic=Pi−Pip. Split each message into independent common and private parts, and transmit Xi=Ui+Vi with independent centered Gaussian codewords of powers Pic and Pip (circular in the complex model). At receiver 1, decode (U1,V1,U2) and treat V2 as Gaussian noise of variance N1=1+∣h21∣2P2p. At receiver 2, decode (U1,U2,V2) and treat V1 as noise of variance N2=1+∣h12∣2P1p. A nonnegative rate split Ri=Ric+Rip is achievable if, at each receiver j, every nonempty subset T of its three decoded streams with positive total rate satisfies ∑s∈TRs<κlog⁡2 ⁣(1+∑s∈T∣aj,s∣2PsNj), where a1,1c=a1,1p=h11, a1,2c=h21, a2,1c=h12, and a2,2c=a2,2p=h22; κ=1/2 for real and 1 for complex channels. A zero-rate stream has a singleton message set and creates no false-message class; the all-zero split is always achievable. The closure of the union over feasible rate splits is an inner region.

Facts & Assumptions

Given: The Gaussian channel in [F1], a fixed pair of private powers, and a nonnegative rate split satisfying the strict inequalities for every nonempty decoded-stream subset with positive total rate.

[A1]

The Axiom of Choice: AC is inherited through the nondegenerate Gaussian-law construction.

[F1]

Real and complex two-user Gaussian interference channels: the two receivers observe the stated linear combinations with independent unit-variance Gaussian noises and satisfy the stated power constraints.

[F2]

IID finite-variance weak law: every IID finite-variance information-density summand obeys the weak law.

[F3]

Power bound for real and complex scalar Gaussian channels: the scalar additive Gaussian channel mutual information equals its Gaussian variance formula for the centered Gaussian input specified here.

Proof

1.1A1F1given

Generate independent message-indexed Gaussian codebooks for U1,V1,U2,V2, with each coordinate law matching its assigned power. The two components at transmitter i sum to a Gaussian input of power Pi; when one component has zero power, set its rate to zero and omit it. The private component of user 2 contributes independent Gaussian noise at receiver 1, and the private component of user 1 contributes independent Gaussian noise at receiver 2, with the variances N1,N2 stated above.

2.1F1F2F3step 1.1algebra

At receiver j, let Dj be its three decoded streams. For every nonempty T⊆Dj, define the information density ıj,T(uT;y∣uTc)=ln⁡wj(y∣uDj)∫wj(y∣uT′,uTc)∏s∈TPUs(dus′), where wj is the Gaussian output density with the other user's private stream included in its noise variance Nj. Decode the positive-rate streams by threshold tests for every subset with positive total rate. A zero-rate stream has a singleton message set, so it creates no competing codeword. Choose thresholds between ln⁡2 times each subset rate and its mutual information in nats. For each tested true subset, the information density is a sum of IID quadratic functions of Gaussian variables with finite variance, so [F2] makes the tests pass with probability tending to one. Condition on the complementary decoded streams and rescale the output by Nj−1/2; [F3] and its Gaussian equality case give the stated subset mutual information in nats.

3.1F1givenstep 2.1algebra

For either receiver and any nonempty subset T of incorrectly decoded streams, T has positive total rate; its false codewords are independent of the output and the correctly decoded streams. The likelihood ratio for that subset has mean one under this false-candidate law, so Markov's inequality bounds the chance of passing a threshold nτT by e−nτT. There are at most enln⁡2∑s∈TRs+o(n) false tuples. The union bound over the tested subsets tends to zero because each threshold exceeds the corresponding rate sum in nats.

4.1F1F2F3step 1.1step 2.1step 3.1givenchoosealgebra∎

The ensemble error argument alone does not yet impose deterministic codebook powers. For fixed 0<ε<1, instead generate each positive component at power (1−ε)Ps. The finitely many strict positive-rate subset inequalities remain valid for sufficiently small ε, by continuity; zero-power components have zero rate and are omitted. For user i, let Bi,j be the coordinate-j input energy ∣Ui+Vi∣2, averaged over all of its common/private message indices, including the cross term. These variables are IID across coordinates, have mean (1−ε)Pi, and satisfy EBi,j2≤E∣Ui+Vi∣4≤3Pi2 by Jensen and the real Gaussian fourth moment; in the circular complex case the sharper constant is 2Pi2. Thus the codebook's expected average input power has variance at most 3Pi2/n. Chebyshev shows that the probability of either user's power exceeding its unscaled constraint tends to zero, while Markov applied to the ensemble sum of receiver errors shows that the probability of an error exceeding the square root of that ensemble mean tends to zero. Consequently some deterministic codebook simultaneously meets both power constraints and has vanishing receiver errors. If Pi=0, its codeword is identically zero and no concentration is needed. Taking achievable closures and then ε↓0 recovers the stated component powers and all boundary split rates by continuity. Singleton streams create no competing codewords; if every rate is zero, use the all-zero code and obtain zero error. This proves the full real and complex fixed-split region without changing the statement.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Random coding achieves the finite-dimensional Gaussian multiple-access region

Statement

At either receiver of the Gaussian channel in Real and complex two-user Gaussian interference channels, independent Gaussian codebooks with powers P1,P2 achieve every nonnegative rate pair for which each nonempty subset T⊆{1,2} with ∑i∈TRi>0 satisfies ∑i∈TRi<κlog⁡2 ⁣(1+∑i∈T∣ai∣2Pi), where that receiver observes Y=a1X1+a2X2+Z with unit-variance real or complex Gaussian noise and κ=1/2 or 1, respectively. The codebook symbols are centered N(0,Pi) in the real model and circular CN(0,Pi) in the complex model. A subset of zero total rate has no false-message candidates and requires no strict inequality; in particular the zero pair is achieved by singleton message sets. The closure of this achievable set is the usual closed Gaussian multiple-access region.

Facts & Assumptions

Given: The Gaussian channel in [F1], independent Gaussian input laws, and a nonnegative rate pair satisfying the strict inequality for every nonempty subset with positive total rate.

[F1]

Real and complex two-user Gaussian interference channels: the noise is independent standard real Gaussian or unit circular complex Gaussian, with the displayed power convention.

[A1]

The Axiom of Choice: AC is assumed by the Gaussian-law and scalar-channel information suppliers.

[F2]

IID finite-variance weak law: IID square-integrable real random variables obey the weak law, with deviation probability bounded by variance divided by sample size and squared tolerance.

[F3]

Power bound for real and complex scalar Gaussian channels: the mutual information of a scalar additive Gaussian channel is bounded by its variance formula, with equality for the centered Gaussian input specified here.

Proof

1.1A1F1F2givenchoosealgebra

Use the stated full powers Pi in the codebook laws and information densities. Generate Mi=⌈2nRi⌉ codewords independently for each sender, with IID coordinates from its specified centered real or circular complex Gaussian input law. For a nonempty subset S⊆{1,2}, define its one-use information density by ıS(x1,x2;y):=ln⁡w(y∣x1,x2)pY∣XSc(y∣xSc), where w is the Gaussian channel output density and the denominator averages w over the Gaussian input laws of the senders in S. Use the sum of these densities over coordinates as the threshold statistic. For each S with R(S):=∑i∈SRi>0, choose τS so that R(S)ln⁡2<τS<IS, where IS=EıS is in nats. A subset with R(S)=0 has no false-message candidates and needs no threshold. For each tested subset the true statistic is a sum of IID quadratic polynomials in Gaussian variables with finite variance; [F2] makes its threshold test pass with probability tending to one.

2.1F1givenstep 1.1algebra

If a nonempty subset S of positive total rate is wrong, its independently generated candidate codewords are independent of the output conditional on the correct codewords in Sc. By the definition in step 1.1, the exponential of the threshold statistic is the likelihood ratio of the true conditional output density to the density averaged over the candidate input law; its expectation under the false-candidate law is one. The nonnegative likelihood ratio and Markov's inequality therefore bound acceptance by e−nτS. Subsets of zero total rate cannot be wrong because all their message sets are singletons.

3.1step 1.1step 2.1algebra

For each tested subset S, the number of false candidates is at most enR(S)ln⁡2+o(n), so the union bound gives ensemble-average error en→0. For Pi>0, write Ki=nMi and Di=∑t,m(∣Xi,t(m)∣2−Pi); the power constraint is Di≤0. Gaussian moments and independence give EDi=0, vi:=EDi2>0, and EDi4≤15vi2: in the real case the ratio is 3+12/Ki, and in the complex case it is 3+6/Ki. Hölder gives vi≤(E∣Di∣)2/3(EDi4)1/3, hence E∣Di∣≥vi/15. Since E(Di)−=E∣Di∣/2, Cauchy–Schwarz gives Pr⁡{Di<0}≥1/60. If Pi=0, its codebook is identically zero. The two independently generated codebooks therefore meet both power constraints with probability at least 1/3600. Markov bounds the probability of error exceeding en by en; for large n this is less than 1/3600, so there exists a deterministic power-feasible codebook with error at most en→0 (if en=0, error is zero almost surely). For any fixed finite list of receivers satisfying their subset inequalities, apply steps 1.1–2.1 at each receiver to this same input ensemble and replace en by the sum of their average errors; the identical selection then makes every receiver's error vanish.

4.1A1F1F3step 3.1algebra∎

For each nonempty subset S, condition on the other codewords. The remaining signal is a centered real or circular complex Gaussian with variance ∑i∈S∣ai∣2Pi. Its mutual information with the unit-noise output is exactly IS=κln⁡(1+∑i∈S∣ai∣2Pi) nats by [F3] and its Gaussian equality case. Dividing by ln⁡2 gives the rates in bits. Step 3.1 selects deterministic codes from exactly the full-variance ensemble stated above, establishing the strict region under the allowed powers. If both rates are zero, singleton message sets achieve zero error. Taking closure gives the stated closed MAC region, including faces where a zero-rate subset has zero mutual information.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Decode-forward inner bound for a finite relay channel

Statement

For a finite relay channel with relay-only causality, fix a finite law PXrPX∣Xr. Every positive rate 0<R<min⁡{I(X;Yr∣Xr), I(X,Xr;Y)} is achievable, and rate R=0 is always achievable with a one-message code. Taking the closure of the union over such laws gives the decode-forward inner bound. Mutual informations use the relay channel law and nats per use.

Facts & Assumptions

Given: A finite relay channel, a law PXrPX∣Xr, and either a positive rate strictly below both displayed mutual informations or the zero-rate case.

[F1]

Finite discrete memoryless relay channel and causal code: the relay observes Yr and its input at time i may depend on Yri−1.

[F2]

Joint strong typicality for a finite IID source: IID blocks are strongly typical with probability tending to one.

[F3]

Conditional joint-typicality packing bound for finite alphabets: a wrong independent codeword passes the relevant conditional joint-typicality test with exponent given by the corresponding mutual information.

Proof

1.1givenF1choose

Choose ϵ>0 so that R+ϵ is below both mutual informations. For every block b∈{1,…,B+1}, independently generate a relay codebook xr,bn(w) with w∈[⌈enR⌉], each word IID from PXr. Given each relay word, generate source words xbn(m,w) independently according to ∏iPX∣Xr(xi∣xr,b,i). Set w0=wB+1=1 as fixed dummy indices and use w1,…,wB for the B messages. In block b, the source sends xbn(wb,wb−1) and the relay sends xr,bn(wb−1). This is causal under [F1].

2.1F1F2F3step 1.1algebra

At the end of block b, the relay tests candidate wb using (xr,bn(wb−1),xbn(wb,wb−1),yrn(b)) and accepts the unique jointly typical candidate. The true triple has the IID law PXrPX∣XrWYr∣X,Xr, so [F2] makes its test pass with probability tending to one. For a wrong candidate, its source word is conditionally independent of the relay observation given the known relay word; [F3] bounds a false test by e−n(I(X;Yr∣Xr)−ϵ). There are at most enR false indices, so the union bound tends to zero because R+ϵ<I(X;Yr∣Xr).

2.2F1F2F3step 1.1algebra

The destination decodes backward over blocks b=B+1,B,…,2. It knows wb from the next block (or as the fixed dummy wB+1), and tests each candidate wb−1 against the block-b source and relay codewords and yn(b). The true tuple is IID with law PXrPX∣XrWY and passes by [F2]. For a wrong candidate, the pair of candidate codewords is independent of the output generated by the true pair; [F3] bounds a false test by e−n(I(X,Xr;Y)−ϵ). The union bound over at most enR wrong indices tends to zero because R+ϵ<I(X,Xr;Y).

3.1step 2.1step 2.2algebra

For positive R there are B message blocks and B+1 channel blocks, so the rate tends to BR/(B+1) as n→∞. For fixed B, the ensemble-average error tends to zero by steps 2.1, 2.2; then letting B→∞ approaches R. The strict slack permits the typicality tolerances to shrink with n, and closure gives the positive-rate part.

4.1givenalgebra∎

At R=0, use a singleton message set and let the destination always return its sole element; the error probability is zero for every blocklength. Thus the zero-rate case is included even if one of the mutual informations vanishes.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Conditional mutual information is concave in the channel input law

Statement

Let Q,X,Z,Y be finite random variables and suppose the channel law PY∣X,Z,Q depends on Q only through (X,Z); equivalently, Q−(X,Z)−Y is a Markov chain. Then I(X;Y∣Z)≥I(X;Y∣Z,Q). Thus, for a fixed finite channel and fixed side information Z, averaging input laws over a time-sharing variable cannot increase the average conditional mutual information.

Facts & Assumptions

Given: The finite variables and Markov condition in the statement.

[F1]

Finite conditional mutual information: conditional mutual information is defined by the finite conditional-KL sum.

[F2]

Finite entropy and mutual-information chain rules: finite entropy and mutual information obey the chain rules used to expand the joint conditional mutual information.

[F3]

Finite conditional mutual information identities and equality: conditional mutual information is nonnegative.

Proof

1.1F1F2givenalgebra

By the chain rule in [F2], I(X,Q;Y∣Z)=I(X;Y∣Z)+I(Q;Y∣X,Z)=I(X;Y∣Z), since the Markov assumption makes the last term zero.

2.1F2F3step 1.1givenalgebra∎

Expanding in the other order gives I(X,Q;Y∣Z)=I(Q;Y∣Z)+I(X;Y∣Z,Q). The first term on the right is nonnegative by [F3], proving the inequality.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Mutual information splits into directed information and feedback

Statement

For finite sequences Xn,Yn, with directed information as in Finite directed information and causal conditioning, I(Xn;Yn)=I(Xn→Yn)+I(Yn−1→Xn), where I(Yn−1→Xn):=∑i=1nI(Yi−1;Xi∣Xi−1) and the i=1 term is zero.

Facts & Assumptions

Given: A joint law of finite sequences Xn,Yn.

[F1]

Finite directed information and causal conditioning: I(Xn→Yn)=∑iI(Xi;Yi∣Yi−1).

[F2]

Finite entropy and mutual-information chain rules: finite entropy and mutual information obey the chain rules used to expand the sequence variables.

Proof

1.1F1F2algebra

Expand I(Xn;Yn) by the chain rule in the order Y1,…,Yn to obtain ∑i=1nI(Xn;Yi∣Yi−1). For each i, split Xn=(Xi,Xi+1n) and apply the chain rule again: I(Xn;Yi∣Yi−1)=I(Xi;Yi∣Yi−1)+I(Xi+1n;Yi∣Xi,Yi−1). Summing the first terms gives I(Xn→Yn) by [F1].

2.1F1F2step 1.1algebra∎

Write I(Xn;Yn)=H(Xn)−H(Xn∣Yn) and each term of I(Xn→Yn) as H(Yi∣Yi−1)−H(Yi∣Yi−1,Xi). The interleaved chain rule gives H(Xn∣Yn)+H(Yn)=H(Xn,Yn)=∑i[H(Xi∣Xi−1,Yi−1)+H(Yi∣Yi−1,Xi)]. Subtracting the directed-information terms therefore yields I(Xn;Yn)−I(Xn→Yn)=H(Xn)−∑i=1nH(Xi∣Xi−1,Yi−1). The finite chain rule expands H(Xn)=∑iH(Xi∣Xi−1), so the right-hand side is ∑iI(Xi;Yi−1∣Xi−1)=∑iI(Yi−1;Xi∣Xi−1) by symmetry of finite mutual information. This is the stated feedback term, including its zero i=1 summand.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Strong-interference information inequalities tensorize over product code inputs

Statement

Assume the strong-interference inequalities of Finite two-user interference channel and strong-interference regime. For independent random vectors X1n,X2n, pass each coordinate through independent uses of the channel. Then I(X1n;Y1n∣X2n)≤I(X1n;Y2n∣X2n),I(X2n;Y2n∣X1n)≤I(X2n;Y1n∣X1n).

Facts & Assumptions

Given: The finite interference channel in [F1], product-over-time channel uses, and independent input vectors X1n⊥X2n.

[F1]

Finite two-user interference channel and strong-interference regime: for each fixed input of one user and every law of the other, the corresponding single-letter output channel has the indicated mutual-information ordering.

[F2]

Finite conditional mutual information identities and equality: conditional mutual information is nonnegative.

[F3]

Finite entropy and mutual-information chain rules: finite mutual information obeys the chain rule used in the telescoping sum.

Proof

1.1F1F2F3givenalgebra

First fix x2n. Under this conditioning, Y1n and Y2n are product channels from X1n, with the ith channel determined by x2,i. Set An=Y2n, Bn=Y1n, and Ji=I(X1n;Ai,Bi+1n∣X2n=x2n) for i=0,…,n. The chain rule [F3] gives Ji−Ji−1=I(X1n;Ai∣Ai−1,Bi+1n,x2n)−I(X1n;Bi∣Ai−1,Bi+1n,x2n). Because the channel is memoryless across coordinates, each term reduces to the mutual information between X1,i and that coordinate's output conditional on the common context (Ai−1,Bi+1n,x2n). For each value of this context, [F1] applies to the induced law of X1,i and fixed x2,i, so Ji−Ji−1≥0. Summing over i yields I(X1n;Y2n∣X2n=x2n)≥I(X1n;Y1n∣X2n=x2n). Average over X2n.

2.1F1F2F3givenstep 1.1algebra∎

Exchange the user indices and exchange Y1,Y2. The second strong-interference inequality in [F1] gives the same telescoping argument with receiver 1 as the more informative output for user 2. Averaging over X1n gives I(X2n;Y1n∣X1n)≥I(X2n;Y2n∣X1n).

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Noisy network coding inner bound for finite multicast networks

Statement

Consider a finite DMN as in Finite discrete memoryless networks and causal codes. Let S be a source-node set, let D be a destination-node set, and let each source k∈S send an independent message of rate Rk to every destination. For a finite time-sharing variable Q, choose PQ∏k=1NPXk∣Q∏k=1NPY^k∣Yk,Xk,Q. For every destination d∈D and every nonempty cut set A⊆[N] with A∩S≠∅ and d∉A, the noisy-network-coding inner bound is ∑k∈A∩SRk<I(XA;Yd,Y^Ac∣XAc,Q)−I(YA;Y^A∣X[N],Yd,Y^Ac,Q). The closure of the union of these rate tuples, together with the all-zero rate tuple, is achievable; the separate zero tuple is attained by singleton message sets even if some cut expression is negative. A constant reconstruction Y^k is permitted at any node.

Facts & Assumptions

Given: The finite DMN, independent source messages, finite Q, product inputs conditional on Q, and finite local reconstruction kernels in the statement.

[F1]

Finite discrete memoryless networks and causal codes: nodes use causal encoders; destinations know their own messages; achievability uses average error over all required estimates.

[F2]

Likelihood-ratio network coding for finite or Euclidean multicast networks: for finite alphabets the square-integrable local and packing likelihood hypotheses give precisely the displayed cut inner region, with finite coded time sharing, constant reconstructions, closure, and a separate singleton-message zero tuple; its finite assertion uses no choice axiom.

[F3]

Finite conditional mutual information: finite conditional mutual information is the finite conditional-KL average, with the same logarithm convention for rates and informations.

Proof

1.1F2F3givenalgebra

For each positive-probability value of Q, use the target law in the statement. Its alphabets are finite. A target-positive joint atom has positive local marginal-reconstruction probability and positive reference probability for every reference law in [F2], because all its displayed marginal factors are positive. Thus every required likelihood ratio is finite on target support; the finitely many log values are bounded and hence square-integrable. All cut informations are finite. No cost constraint is imposed. These observations verify every hypothesis of the finite branch of [F2], including arbitrary zero-probability letters, which can simply be omitted.

2.1F1F2step 1.1given

Apply [F2] with this law and source/destination sets. Its independent messages, causal encoders and destination side information have exactly the conventions of [F1]. Its cut expression is I(XA;Yd,Y^Ac∣XAc,Q)−I(YA;Y^A∣X[N],Yd,Y^Ac,Q) for every required A,d, so every tuple satisfying the displayed strict inequalities is achievable. A constant reconstruction is allowed in [F2] and contributes zero local and conditional information.

3.1F1F2step 2.1construct∎

The closure-of-union conclusion follows from [F2], or by choosing a sequence of strict-region laws and rate tuples tending to the claimed point and selecting successively longer codes with error tending to zero and rates tending to that point. Independently, singleton message sets at every source and a destination that returns those unique messages have error exactly zero; this realizes the separate zero tuple even when a cut expression is negative.

CorollaryStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Compress-forward and noisy-network-coding bounds for a finite relay channel

Statement

For a finite relay channel, choose PXPXrPY^r∣Yr,Xr. Every positive noisy-network-coding rate R<min⁡{I(X;Y,Y^r∣Xr), I(X,Xr;Y)−I(Yr;Y^r∣X,Xr,Y)} is achievable by the finite multicast NNC theorem in [F1]; rate R=0 is always achievable by a one-message code. In particular, if I(Yr;Y^r∣Xr,Y)≤I(Xr;Y), then every positive compress-forward rate R<I(X;Y,Y^r∣Xr) is included, along with the zero rate.

Facts & Assumptions

Given: The finite relay model in [F2], the product input and test-channel law above, and the NNC inner-bound statement [F1].

[F1]

Noisy network coding inner bound for finite multicast networks: for the one-source, one-destination three-node network, its cut A={s} gives the first mutual-information term, and cut A={s,r} gives the second term.

[F2]

Finite discrete memoryless relay channel and causal code: the one-way relay network has source, relay, destination and causal relay input.

[F3]

Finite conditional mutual information, Finite conditional mutual information identities and equality, and Finite entropy and mutual-information chain rules: the finite conditional-KL definition, nonnegativity identity, and entropy/mutual-information chain rules apply.

Proof

1.1F1F2given

Substitute A={s} and A={s,r} into [F1]. The first cut has no source-side reconstruction penalty because the source reconstruction can be constant; the second cut has only the relay penalty I(Yr;Y^r∣X,Xr,Y). These substitutions give the displayed NNC minimum.

1.2F3givenalgebra

The test-channel Markov relation Y^r−Yr−(X,Y) conditional on Xr gives I(Yr;Y^r∣Xr,Y)=I(X;Y^r∣Xr,Y)+I(Yr;Y^r∣X,Xr,Y). Indeed, expand I(X,Yr;Y^r∣Xr,Y) in both orders; the term I(X;Y^r∣Yr,Xr,Y) is zero by the test-channel factorization.

2.1F1F3step 1.2algebra

Subtract the first NNC term from the second and use [F3]: I(X,Xr;Y)−I(Yr;Y^r∣X,Xr,Y)−I(X;Y,Y^r∣Xr)=I(Xr;Y)−I(Yr;Y^r∣Xr,Y). Thus the stated compress-forward condition makes the second term at least the first. Thus [F1] proves the asserted positive-rate achievability.

3.1F2given∎

At R=0, choose a singleton message set at the source and let the destination return its sole message. This achieves zero error without needing either strict mutual-information inequality.

CorollaryStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Noisy-network-coding inner region for the finite two-way relay channel

Statement

For the finite two-way relay channel in Finite two-way relay channel and causal code, choose independent inputs PX1PX2PXr and a relay test channel PY^r∣Yr,Xr. The following rates are achievable by the finite multicast NNC theorem [F1]: R1<min⁡{I(X1;Y2,Y^r∣X2,Xr), I(X1,Xr;Y2∣X2)−I(Yr;Y^r∣X1,X2,Xr,Y2)}, R2<min⁡{I(X2;Y1,Y^r∣X1,Xr), I(X2,Xr;Y1∣X1)−I(Yr;Y^r∣X1,X2,Xr,Y1)}. The closure of the union over such laws, together with the zero-rate pair, is an inner region, not asserted to be capacity. The zero pair is attained by singleton message sets at both terminals.

Facts & Assumptions

Given: The finite two-way relay model, independent terminal messages, and the input and relay test-channel laws above.

[F1]

Noisy network coding inner bound for finite multicast networks: for each destination, every cut separating that destination from its required message sources gives the corresponding NNC rate inequality.

[F2]

Finite two-way relay channel and causal code: terminal 1 wants terminal 2's message and terminal 2 wants terminal 1's message; all inputs depend only on local messages and past local outputs.

[F3]

Finite conditional mutual information, Finite conditional mutual information identities and equality, and Finite entropy and mutual-information chain rules: the finite conditional-KL definition, nonnegativity identity, and entropy/mutual-information chain rules apply.

Proof

1.1F1F2given

For destination 2 and message source 1, the cut containing only node 1 yields I(X1;Y2,Y^r∣X2,Xr); the cut containing nodes 1 and r yields I(X1,Xr;Y2∣X2)−I(Yr;Y^r∣X1,X2,Xr,Y2). The other node's observation reconstruction may be constant. These are the two bounds on R1.

2.1F1F2step 1.1

For destination 1 and message source 2, the two cuts are respectively node 2 alone and nodes 2 with the relay. Substitution into [F1] yields the displayed two bounds on R2. Both destinations can use their own message as side information, as in [F2].

3.1F1F3step 1.1step 2.1algebra

Taking the intersection of the two destination constraints and then closure over rates yields the stated inner region; the finite mutual-information quantities use the chain-rule and conditional-law conventions of [F3]. The simultaneous multicast code supplied by [F1] serves both destinations, with each terminal using its own message as side information.

4.1F2given∎

If R1=R2=0, both terminals use singleton message sets and return their unique required messages, so the error probability is zero. This includes the zero-rate pair even if a displayed right-hand side is negative.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Conditional mutual-information chain rule and data processing for standard-Borel variables

Statement

Assume AC. Let U,V,Y,S take values in standard-Borel spaces. Then I((U,V);Y∣S)=I(U;Y∣S)+I(V;Y∣U,S) and also I((U,V);Y∣S)=I(V;Y∣S)+I(U;Y∣V,S), where these are equalities of extended nonnegative quantities. In particular, if the conditional law of Y given (U,V,S) depends only on (V,S), then I(U;Y∣S)≤I(V;Y∣S).

Facts & Assumptions

Given: AC and standard-Borel variables U,V,Y,S with a joint law.

[A1]

The Axiom of Choice: AC is required by the standard-Borel conditional-law and KL-chain-rule suppliers.

[F1]

Standard Borel spaces and Finite products of standard Borel spaces are standard Borel: the finite product variables and their conditional laws remain standard Borel.

[F2]

Mutual-information chain rule without subtracting infinities: for standard-Borel variables, I((Z,X);Y)=I(Z;Y)+I(X;Y∣Z) as an equality in [0,+∞].

[F3]

Conditional mutual information by a same-marginal product law: conditional mutual information is the KL divergence from the same-marginal conditionally independent product law; it vanishes when that law is the actual joint law.

[F4]

KL chain rule for standard-Borel disintegrations: with a common conditioning marginal, joint KL is the integral of the conditional KLs.

[F5]

Kullback–Leibler divergence is nonnegative: every KL divergence in the statement is nonnegative.

[F6]

KL is invariant under a measurable bijection: permuting coordinates preserves KL, hence conditional mutual information is symmetric in its two unconditioned variables.

Proof

1.1A1F1F2F3F4givenalgebra

For PS-almost every s, apply [F2] to the conditional law of (U,V,Y) given S=s. It gives I((U,V);Y∣S=s)=I(U;Y∣S=s)+I(V;Y∣U,S=s). Integrate over PS; by the conditional-KL definition [F3] and disintegration chain rule [F4], the three integrals are the corresponding conditional mutual informations given S. This proves the first identity without subtracting extended values.

2.1A1F2F3F4F6givenstep 1.1algebra

Exchange the roles of U and V in step 1.1 to obtain the second identity. The symmetry of conditional mutual information between the grouped variables follows from [F6].

3.1F3F5step 1.1step 2.1givenalgebra∎

Suppose the conditional law of Y given (U,V,S) depends only on (V,S). Then U and Y are conditionally independent given (V,S), so [F3] gives I(U;Y∣V,S)=0. The two chain-rule identities in steps 1.1 and 2.1 now give I(U;Y∣S)+I(V;Y∣U,S)=I(V;Y∣S). Since I(V;Y∣U,S)≥0 by [F5], the claimed inequality follows.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Mutual information tensorizes over a memoryless vector channel

Statement

Assume AC. Let X1,…,Xn and Y1,…,Yn take values in standard-Borel spaces. Let their joint law have an arbitrary input marginal PXn and the memoryless conditional channel law PYn∣Xn(dyn∣xn)=∏i=1nWi(dyi∣xi), where each Wi is a probability kernel. No independence across the input coordinates is assumed. Then, as an inequality in [0,+∞], I(Xn;Yn)≤∑i=1nI(Xi;Yi).

Facts & Assumptions

Given: AC, standard-Borel coordinate spaces, an arbitrary joint input law, and the displayed product conditional channel law.

[A1]

The Axiom of Choice: AC is the choice axiom required by the standard-Borel conditional-law and mutual-information chain-rule suppliers.

[F1]

Standard Borel spaces and Finite products of standard Borel spaces are standard Borel: each coordinate space and each finite product used below is standard Borel.

[F2]

Mutual-information chain rule without subtracting infinities: for standard-Borel random elements, I((Z,X);Y)=I(Z;Y)+I(X;Y∣Z) as an equality of extended nonnegative quantities.

[F3]

Conditional mutual information by a same-marginal product law: conditional mutual information is the KL divergence from the same-marginal conditionally independent product law; it is zero when the conditional joint law equals that product law.

[F4]

Kullback–Leibler divergence is nonnegative: mutual information and conditional mutual information, being KL divergences, are nonnegative.

[F5]

KL is invariant under a measurable bijection: a measurable coordinate permutation preserves KL divergence, so mutual information and conditional mutual information are symmetric in their two unconditioned variables.

[F6]

KL chain rule for standard-Borel disintegrations: when two laws have the same conditioning marginal, their joint KL is the integral of the conditional KLs.

Proof

1.1A1F1F2F5givenalgebra

By [F2], successively adjoining Yi to Yi−1 gives I(Xn;Yn)=I(Yn;Xn)=∑i=1nI(Yi;Xn∣Yi−1)=∑i=1nI(Xn;Yi∣Yi−1). The first equality and the last equality use the coordinate swap in [F5]; the initial term for the empty tuple Y0 is zero. Every term is an extended nonnegative quantity, so no subtraction of infinities is involved.

1.2A1F1F2F3F6givenalgebra

Fix i and put U=Xi, V=X[n]∖{i}, and W=Yi−1. For PW-almost every w, the conditional channel law makes Yi independent of V given U. Apply [F2] to the conditional law of (U,V,Yi) given W=w and use [F3]: I((U,V);Yi∣W=w)=I(U;Yi∣W=w)+I(V;Yi∣U,W=w)=I(U;Yi∣W=w). Integrating this identity over PW gives I(Xn;Yi∣Yi−1)=I(Xi;Yi∣Yi−1) by [F6] and the conditional-KL definition [F3].

1.3A1F2F3F4F5givenalgebra

The product channel law gives I(Yi−1;Yi∣Xi)=0 by [F3]. Expanding I((Xi,Yi−1);Yi) with [F2] first in the order Xi,Yi−1 gives I((Xi,Yi−1);Yi)=I(Xi;Yi). Expanding in the reverse order and using the coordinate-swap invariance [F5] gives I(Xi;Yi)=I(Yi−1;Yi)+I(Xi;Yi∣Yi−1). Because the omitted term I(Yi−1;Yi∣Xi) is zero and I(Yi−1;Yi)≥0 by [F4], this proves I(Xi;Yi∣Yi−1)≤I(Xi;Yi) in the extended nonnegative order.

2.1step 1.1step 1.2step 1.3algebra∎

Sum the coordinate inequalities from step 1.3 and use the chain-rule expansion in step 1.1 together with step 1.2. This gives I(Xn;Yn)≤∑i=1nI(Xi;Yi) for arbitrary dependent input coordinates.

LemmaStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Genie-aided outer bounds for the two-user Gaussian interference channel

Statement

For the complex Gaussian channel in Real and complex two-user Gaussian interference channels, the following are outer bounds in the listed regimes; all logarithms are base two. Write SNR and INR as defined there.

Weak regime: If INR1<SNR2 and INR2<SNR1, every achievable pair satisfies R1≤log⁡2(1+SNR1),R2≤log⁡2(1+SNR2), R1+R2≤log⁡2(1+SNR1)+log⁡2 ⁣(1+SNR21+INR2), R1+R2≤log⁡2(1+SNR2)+log⁡2 ⁣(1+SNR11+INR1), R1+R2≤log⁡2 ⁣(1+INR1+SNR11+INR2)+log⁡2 ⁣(1+INR2+SNR21+INR1), 2R1+R2≤log⁡2(1+SNR1+INR1)+log⁡2 ⁣(1+INR2+SNR21+INR1)+log⁡2 ⁣(1+SNR11+INR2), R1+2R2≤log⁡2(1+SNR2+INR2)+log⁡2 ⁣(1+INR1+SNR11+INR2)+log⁡2 ⁣(1+SNR21+INR1).

Mixed regime: If INR1≥SNR2 and INR2<SNR1, every achievable pair satisfies the two individual bounds above and R1+R2≤log⁡2(1+SNR1)+log⁡2 ⁣(1+SNR21+INR2),R1+R2≤log⁡2(1+SNR1+INR1), R1+2R2≤log⁡2(1+SNR2+INR2)+log⁡2 ⁣(1+INR1+SNR11+INR2)+log⁡2 ⁣(1+SNR21+INR1). The other mixed regime is obtained by interchanging user indices 1 and 2.

Facts & Assumptions

Given: A complex Gaussian interference code with independent messages and the SNR/INR convention below; logarithms and entropies in the proof are base two.

[A1]

The Axiom of Choice: AC is inherited through the Gaussian-law and information suppliers.

[F1]

Real and complex two-user Gaussian interference channels: the channel has independent unit circular Gaussian receiver noises and the stated average powers.

[F2]

Fano bound for finite messages and density observations: a vanishing-error decoder gives a message-entropy bound by mutual information plus o(n).

[F3]

Mutual information tensorizes over a memoryless vector channel: vector mutual information on a memoryless channel is bounded by the sum of its coordinate values.

[F4]

Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional chain rules and data processing identify deterministic-message and codeword information and allow revealing side information.

[F5]

Power bound for real and complex scalar Gaussian channels: the scalar Gaussian information power bound and its equality case.

[F6]

Entropy estimates for complex Gaussian interference converses: the entropy-difference bound and every unconditioned and genie-conditioned output entropy estimate used below, with only average power assumptions.

Proof

1.1A1F1F2F3F4F5givenalgebra

Write a=SNR1, b=SNR2, c=INR1, d=INR2. Give M2 to receiver 1 and subtract its deterministic codeword. Fano, conditional data processing in both directions, and tensorization give nR1≤∑jI(X1,j;h11X1,j+Z1,j)+o(n). The scalar Gaussian power bound followed by Jensen and the average input constraint gives R1≤log⁡2(1+a). Reflection gives R2≤log⁡2(1+b). The same argument applies when a direct gain vanishes and then forces the corresponding rate to zero. Throughout the proof independent messages give independent user input vectors, regardless of coordinate dependence inside a vector; the additive Fano remainders disappear on division by n and passage to the coding limit.

2.1F1F2F4F6step 1.1givenconstructalgebra

Reveal X2n to receiver 1. The chain rule and independent inputs give the following exact expansion of the two augmented mutual informations: I(X1n;Y1n∣X2n)+I(X2n;Y2n)=h(Y2n)−h(Z1n)+h(h11X1n+Z1n)−h(h12X1n+Z2n). If P1=0, the input vector is zero and this entropy difference and the claimed logarithmic ratio are both zero. Otherwise, if a≥d, the entropy-difference estimate [F6] applies with s=∣h11∣2, t=∣h12∣2, P=P1; phases are removed by unit-modulus rotations. This is precisely the coupling condition ∣h11∣≥∣h12∣: the lower-SNR observation can be formed by scaling the higher-SNR observation and adding circular Gaussian noise of variance 1−t/s. The proof of [F6] covers zero gains without division by a cross gain. Its unconditioned-output bound therefore yields R1+R2≤log⁡2(1+b+d)+log⁡2((1+a)/(1+d))=log⁡2(1+a)+log⁡2(1+b/(1+d)). Only a≥d is needed. Reflecting the argument gives the second weak sum bound under b≥c, using the reflected noise coupling.

2.2F1F2F4F6step 1.1givenconstructalgebra

Define S1n=h12X1n+Z2n and S2n=h21X2n+Z1n using independent receiver noises. Give S1n to receiver 1 and S2n to receiver 2. Expanding both augmented informations gives I(X1n;Y1n,S1n)+I(X2n;Y2n,S2n)=h(Y1n∣S1n)+h(Y2n∣S2n)−h(Z1n)−h(Z2n): the positive h(S1n) and h(S2n) cancel the interference-plus-noise entropies of the two conditional channels. Applying the two conditional-output estimates in [F6] and h(Zin)=nlog⁡2(πe) proves the third displayed weak sum bound. This calculation is valid in every regime and requires no degradation inequality.

3.1F1F2F4F6step 1.1step 2.1step 2.2givenalgebra

Add two copies of receiver 1's Fano bound and one of receiver 2's. Augment receiver 2 by S2n and one receiver 1 copy by X2n. The resulting information sum equals h(Y1n)+h(Y2n∣S2n)−2h(Z1n)+h(h11X1n+Z1n)−h(h12X1n+Z2n). Indeed the three information terms contribute, respectively, h(Y1n)−h(S2n), h(S2n)+h(Y2n∣S2n)−h(h12X1n+Z2n)−h(Z1n), and h(h11X1n+Z1n)−h(Z1n). The unconditioned, conditional, and entropy-difference estimates of [F6] give 2R1+R2≤log⁡2(1+a+c)+log⁡2(1+d+b/(1+c))+log⁡2((1+a)/(1+d)). The only degradation hypothesis is a≥d, exactly as in step 2.1. Reflection proves the displayed R1+2R2 bound under b≥c. Thus the stated weak regime supplies every required coupling.

3.2F1F2F4F6step 1.1step 2.1givenconstructalgebracases

In the mixed regime c≥b and a>d, the individual bounds and first sum bound still follow from steps 1.1 and 2.1. For the MAC sum bound, receiver 1 first decodes M1. On the event of correct decoding it subtracts h11X1n and obtains h21X2n+Z1n. If P2=0, step 1.1 gives R2=0 and the required MAC sum bound already follows from the individual bound. Otherwise, if h21≠0, scale by h22/h21 and add independent circular Gaussian noise of variance 1−∣h22/h21∣2, which is nonnegative because c≥b and P2>0. Add the known vector h12X1n and apply receiver 2's decoder. Coupling this simulation to the one using the true M1 bounds its joint-message error by the sum of the two original errors; a deterministic MAP decoder has no larger average error. Joint-message Fano and the unconditioned-output estimate [F6] give R1+R2≤log⁡2(1+a+c). If h21=0, then b=c=0 and step 1.1 forces R2=0, so the same sum bound follows immediately. This establishes the exact mixed sum claim, including degenerate gains.

4.1F1F2F4F6step 1.1step 2.2step 3.2givenalgebra∎

For the mixed weighted bound add the three Fano information terms I(X1n;Y1n,S1n), I(X2n;Y2n), and I(X2n;Y2n,S2n∣X1n). The first expands as h(S1n)−h(Z2n)+h(Y1n∣S1n)−h(S2n), the second as h(Y2n)−h(S1n), and the third as h(S2n)−h(Z1n)+h(Y2n∣S2n,X1n)−h(Z2n). Their sum is h(Y1n∣S1n)+h(Y2n)+h(Y2n∣S2n,X1n)−h(Z1n)−2h(Z2n). Apply the three corresponding bounds in [F6] to obtain exactly R1+2R2≤log⁡2(1+b+d)+log⁡2(1+c+a/(1+d))+log⁡2(1+b/(1+c)). This particular weighted estimate is universal and uses no degradation condition. Reflection gives the other mixed regime. Combining the preceding steps proves every displayed inequality with precisely the hypotheses asserted in the statement.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Cut-set outer bound for causal and full-feedback relay channels

Statement

For either causal model in Finite discrete memoryless relay channel and causal code, every achievable rate is in the closed convex hull of rate values satisfying, for some finite time-sharing variable Q and law PQPXXr∣Q, R≤I(X,Xr;Y∣Q),R≤I(X;Y,Yr∣Xr,Q), with the relay transition law used to evaluate the mutual informations. In particular, this is an outer bound; it need not be achievable for relay-only causality.

Facts & Assumptions

Given: A length-n causal relay code with uniform message M, error probability Pe, and the memoryless relay law of Finite discrete memoryless relay channel and causal code.

[F1]

Finite discrete memoryless relay channel and causal code: at each time the output pair is drawn from W(yr,y∣x,xr); current inputs are functions of the message and past outputs only.

[F2]

Finite-alphabet Fano inequality: H(M∣Yn)≤ln⁡2+Peln⁡∣M∣ for every finite nonempty message set; for ∣M∣=1 the conditional entropy is zero.

[F3]

Finite conditional mutual information identities and equality: conditional mutual information is nonnegative.

[F4]

Finite entropy and mutual-information chain rules: finite entropy and mutual information obey the chain rules used to expand the time-indexed terms.

[F5]

Conditional mutual information is concave in the channel input law: for a fixed channel W(y∣x,z), averaging over an input time-sharing variable Q gives I(X;Y∣Z)≥I(X;Y∣Z,Q).

Proof

1.1givenF2F4

Fano's inequality gives (1−Pe)ln⁡∣M∣≤I(M;Yn)+ln⁡2. Apply the chain rule to write I(M;Yn)=∑iI(M;Yi∣Yi−1).

2.1F1F3F4F5step 1.1algebra

Since conditional mutual information is nonnegative, each summand is at most I(M,Yri−1;Yi∣Yi−1). Given (M,Yi−1,Yri−1), the current inputs are fixed by causality in either model, and [F1] makes the current output depend on those variables only through (Xi,Xr,i). Thus the summand equals I(Xi,Xr,i;Yi∣Yi−1). For the fixed channel WY, the past Yi−1 is a time-sharing variable independent of the current output once the current inputs are fixed. Applying [F5] gives I(Xi,Xr,i;Yi∣Yi−1)≤I(Xi,Xr,i;Yi).

2.2F1F3F4F5step 1.1algebra

For the second cut, I(M;Yn)≤I(M;Yn,Yrn)=∑iI(M;Yi,Yr,i∣Yi−1,Yri−1). The relay input Xr,i is determined by the past. Given the past and M, the source input is determined; memorylessness therefore reduces each term to I(Xi;Yi,Yr,i∣Yi−1,Yri−1,Xr,i). Conditional on a fixed Xr,i=xr, the past is a time-sharing variable for the fixed channel W(Y,Yr)∣X,xr. Applying [F5] and averaging over Xr,i bounds the term by I(Xi;Yi,Yr,i∣Xr,i).

3.1step 2.1step 2.2givenalgebra∎

Let Q be uniform on [n] and conditionally draw (X,Xr,Yr,Y) according to the time-Q joint law induced by the code and channel. Steps 2.1, 2.2 imply both cut inequalities with conditioning on Q. Dividing the Fano bound by n, then taking a sequence of codes with Pe→0, gives the stated outer bound after closure and convexification.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Cut-dependent Gaussian multicast gap to the cut-set bound

Statement

For the real Gaussian multicast network in Real scalar Gaussian multicast relay network and power constraints with common node power P, compare the noisy-network-coding inner cut in [F1] with the cut-set outer region. For each admissible cut A, the outer cut is at most 12log⁡2det⁡ ⁣(I+P2G(A)G(A)T)+12min⁡{∣A∣,∣Ac∣}log⁡2(2∣A∣). Consequently the outer and inner cut bounds differ by at most Δ(A)=∣A∣2+12min⁡{∣A∣,∣Ac∣}log⁡2(2∣A∣) bits per use on that cut. This is a cutwise comparison; it does not assert a single cut-independent gap constant.

Facts & Assumptions

Given: A length-n causal Gaussian multicast code in [F2] with error Pe, block rates Rk(n)=n−1log⁡2∣Mk∣, all node powers at most P, and a cut A with A∩S≠∅ and Ac∩D≠∅.

[A1]

The Axiom of Choice: AC is inherited through the Gaussian maximum-entropy and Gaussian-law suppliers.

[F1]

Noise-level noisy-network-coding inner bound for real Gaussian multicast networks: the exact NNC expression for destination d∈Ac is Nd(A)=I(XA;Yd,Y^Ac∣XAc)−I(YA;Y^A∣X[N],Yd,Y^Ac). With Q=[N], Pi=P, and unit-variance quantization noise, its first term is at least I(XA;Y^Ac∣XAc)=12log⁡2det⁡(I+(P/2)G(A)G(A)T), while the penalty is ∣A∣/2. Hence Nd(A)≥L(A):=12log⁡2det⁡(I+(P/2)G(A)G(A)T)−∣A∣/2. The NNC theorem also separately achieves the all-zero tuple.

[F2]

Real scalar Gaussian multicast relay network and power constraints: causal encoders use each node's own message and past output; outputs across the cut have form YAc=G(A)XA+G′(A)XAc+ZAc with identity noise covariance.

[F3]

Gaussian maximizes differential entropy at fixed positive-definite covariance: a vector with positive-definite covariance K has differential entropy at most 12ln⁡((2πe)ddet⁡K).

[F4]

Fano bound for finite messages and density observations: a finite message tuple M estimated from a density observation and finite side information with error at most Pe satisfies H(M∣Y,S)≤ln⁡2+Peln⁡∣M∣; for a singleton message its conditional entropy is zero.

[F5]

Real spectral theorem: a self-adjoint endomorphism of a finite-dimensional real inner product space has an orthonormal eigenbasis: real symmetric matrices have real eigenvalues and an orthonormal eigenbasis; a positive-definite matrix has positive eigenvalues and a positive-definite square root.

[F6]

Conditional mutual-information chain rule and data processing for standard-Borel variables: the conditional mutual-information chain rule expands the length-n observation, and conditional data processing bounds each current observation by its current inputs.

[F7]

Bounded densities with finite second moments have finite differential entropy: a bounded density with finite second moment has a finite, absolutely defined differential entropy.

Proof

1.1A1F2F4F6givenalgebra

Fix a destination d∈Ac. Give the messages of nodes in Ac to that destination, and also give it all outputs YAcn. The revealed messages are independent of the source messages in A, and the original decoder is still available. Since rates are bits and Fano's bound is in nats, [F4] gives the exact finite-code bound (1−Pe)nln⁡2∑k∈A∩SRk(n)≤I(MA∩S;YAcn∣MAc)+ln⁡2. By the conditional chain rule [F6], expand the mutual information across time. For time i, condition on Hi=(MAc,YAci−1). Each input in Ac is then fixed by causality in [F2]. The current outputs depend on messages in A only through the current inputs XA,i, so conditional data processing [F6] gives I(MA∩S;YAc,i∣Hi)≤I(XA,i;YAc,i∣Hi). The right side is the mutual information of G(A)XA,i+ZAc,i under the conditional input law given Hi.

2.1F2F3F7step 1.1algebra

For almost every h, the conditional input second moment given Hi=h is finite, since its average is bounded by the node power constraints. The conditional output is a translate of a Gaussian convolution, so its density is bounded by the standard Gaussian noise peak; [F7] makes its differential entropy finite. Let Ki,h be the conditional covariance of XA,i given Hi=h. The channel noise is independent with covariance I, so [F3] bounds each conditional mutual information in step 1.1, measured in nats, by 12ln⁡det⁡(I∣Ac∣+G(A)Ki,hG(A)T). Set Kˉ=n−1∑iE[Ki,Hi]. Since covariance trace is at most the corresponding second moment and each node's average power is at most P, Kˉ⪰0 and tr⁡Kˉ≤∣A∣P.

3.1F2F5step 1.1step 2.1algebra

For positive-definite matrices B,B0, let C=B0−1/2BB0−1/2. Its eigenvalues λj are positive by [F5], and ln⁡λj≤λj−1 because u−1−ln⁡u has derivative 1−1/u, decreases on (0,1], increases on [1,∞), and vanishes at 1. Thus ln⁡det⁡B≤ln⁡det⁡B0+tr⁡(B0−1(B−B0)). Apply this with B=I+GKi,hGT and B0=I+GKˉGT, then average over i,h; the trace term averages to zero. Hence the average natural log determinant in step 2.1 is at most ln⁡det⁡(I+GKˉGT). The spectral theorem gives Kˉ⪯tr⁡(Kˉ)I, since every nonnegative eigenvalue is at most their sum; hence GKˉGT⪯∣A∣PGGT. If 0≺C⪯D, then C−1/2DC−1/2=I+E for some E⪰0, so its eigenvalues are at least one and det⁡C≤det⁡D. Applying this order property and dividing the Fano bound in step 1.1 by nln⁡2 yields (1−Pe)∑k∈A∩SRk(n)≤12ln⁡2ln⁡det⁡(I∣Ac∣+∣A∣PGGT)+1n. Along a sequence of reliable codes Pe→0, this finite bound first bounds the cut rate sums, and then passage to their achievable lower limits gives ∑k∈A∩SRk≤12ln⁡2ln⁡det⁡(I∣Ac∣+∣A∣PGGT). No a priori bounded-rate hypothesis is needed.

4.1F5step 3.1algebra

Put a=∣A∣ and b=∣Ac∣; both are positive. For any positive-semidefinite H of size m, Im+aPH⪯2a(Im+(P/2)H), so determinant monotonicity gives 12ln⁡2ln⁡det⁡(Im+aPH)≤12log⁡2det⁡(Im+(P/2)H)+m2log⁡2(2a). The block determinant of (IbaPG−aPGTIa), computed by taking either identity block as the Schur complement pivot, gives det⁡(Ib+aPGGT)=det⁡(Ia+aPGTG). Apply the previous inequality once in dimension b and once in dimension a, then use this identity to take the smaller additive term. The cut-set outer bound is at most 12log⁡2det⁡ ⁣(I+P2GGT)+12min⁡(a,b)log⁡2(2a).

5.1F1step 4.1algebracases∎

Write D(A)=12log⁡2det⁡(I+(P/2)G(A)G(A)T), so the sufficient lower bound in [F1] is L(A)=D(A)−a/2. Step 4.1 gives the cut-set outer value O(A)≤D(A)+12min⁡(a,b)log⁡2(2a)=L(A)+Δ(A). If L(A)>0, the exact NNC expression satisfies Nd(A)≥L(A), so O(A)−Nd(A)≤Δ(A). If L(A)≤0, use the separately achievable zero-rate tuple from [F1]; then O(A)≤L(A)+Δ(A)≤Δ(A), so the outer cut is within Δ(A) of that achievable rate. This proves the cutwise comparison without treating the determinant expression as the exact NNC rate and covers negative sufficient-cut values.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Exact strong-interference region for the two-user Gaussian interference channel

Statement

For the real or complex Gaussian interference channel of Real and complex two-user Gaussian interference channels, assume the strong regime ∣h12∣≥∣h11∣,∣h21∣≥∣h22∣. Then the capacity region is the set of nonnegative rate pairs satisfying R1≤κlog⁡2(1+SNR1),R2≤κlog⁡2(1+SNR2), R1+R2≤κmin⁡{log⁡2(1+SNR1+INR1),log⁡2(1+SNR2+INR2)}, where κ=1/2 for real and 1 for complex channels.

Facts & Assumptions

Given: A length-n interference code with independent messages, the channel and power constraints of [F1], and the two gain inequalities in the statement.

[A1]

The Axiom of Choice: AC is inherited through the Gaussian random-coding and scalar-channel information suppliers.

[F1]

Real and complex two-user Gaussian interference channels: noises are independent unit-variance real or circular complex Gaussian; the input power constraints and SNR/INR conventions are as displayed there.

[F2]

Random coding achieves the finite-dimensional Gaussian multiple-access region: independent Gaussian codebooks achieve both receivers' multiple-access regions.

[F3]

Fano bound for finite messages and density observations: a finite message estimated from a density observation with error Pe has conditional entropy at most ln⁡2+Peln⁡∣M∣.

[F4]

Mutual information tensorizes over a memoryless vector channel: for a memoryless channel and any dependent input vector, vector mutual information is at most the sum of its coordinate mutual informations.

[F5]

Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional mutual information obeys the chain rule and the data-processing inequality for standard-Borel variables, including finite message side information.

[F6]

Power bound for real and complex scalar Gaussian channels: for either scalar Gaussian model, I(X;aX+Z)≤κln⁡(1+∣a∣2E∣X−EX∣2) nats, with equality for the corresponding Gaussian inputs.

Proof

1.1A1F1F3F4F5F6givenalgebra

For the individual bound on R1, give M2 to receiver 1. Fano gives nR1ln⁡2≤I(M1;Y1n∣M2)+o(n) in nats. For each fixed M2, X2n is fixed; translating Y1n by the known vector −h21X2n is invertible, so [F5] in both directions preserves this conditional mutual information. The shifted channel from X1n is memoryless. The codeword map is deterministic and the channel law depends on M1 only through X1n, so [F5] in both Markov directions gives I(M1;Y1n∣M2)=I(X1n;h11X1n+Z1n∣M2). Apply [F4] for each M2 and average to bound this by ∑iI(X1,i;h11X1,i+Z1,i). By [F6], each term is at most κln⁡(1+∣h11∣2p1,i) nats, where p1,i=E∣X1,i∣2. Jensen's inequality and the power constraint give R1≤κlog⁡2(1+SNR1). Exchanging users gives the stated R2 bound.

1.2F1givenconstructalgebra

First suppose both cross gains are nonzero. Receiver 1 first forms its estimate M^1. On the event M^1=M1, it reconstructs X1n and subtracts h11X1n, obtaining h21X2n+Z1n. Since ∣h21∣≥∣h22∣, it scales this residual by h22/h21 and adds independent Gaussian noise of variance 1−∣h22/h21∣2; for complex channels use circular Gaussian noise. Adding back h12X1n gives a simulated Y~2n. For the error analysis, construct the same vector using the true M1: it then has exactly the law of receiver 2's Y2n, and on M^1=M1 it equals the receiver's simulation. Hence the joint error is at most Pe,1+Pe,2. Since the message pair is finite, the randomized decoder has a deterministic MAP decoder with no larger average error. Exchanging users and using ∣h12∣≥∣h11∣ gives the symmetric joint decoder at receiver 2.

2.1F1F3F4F5F6step 1.2algebra

In the nonzero-cross-gain case of step 1.2, apply the density-observation Fano bound [F3] to the joint decoder at receiver 1. Let M=(M1,M2) and X=(X1n,X2n). The deterministic codeword map and channel law give both Markov directions between M and X with observation Y1n, so [F5] yields I(M;Y1n)=I(X;Y1n). The two input vectors are independent because their messages are independent. By [F4], n(R1+R2)ln⁡2≤I(X1n,X2n;Y1n)+o(n)≤∑iI(X1,i,X2,i;Y1,i)+o(n). The output variance at time i is at most 1+∣h11∣2E∣X1,i∣2+∣h21∣2E∣X2,i∣2, because the independent inputs have zero cross covariance after centering. These single-coordinate mutual informations are finite by the power bound and [F6].

3.1F1F5F6step 1.1step 1.2step 2.1algebracases

For each coordinate put Si=h11X1,i+h21X2,i. The channel output depends on the input pair only through Si, so [F5] in both directions gives I(X1,i,X2,i;Y1,i)=I(Si;Si+Z1,i). Independence gives Var⁡(Si)≤∣h11∣2p1,i+∣h21∣2p2,i; [F6] therefore bounds this term by κln⁡(1+∣h11∣2p1,i+∣h21∣2p2,i) nats. Jensen's inequality and the average power constraints yield R1+R2≤κlog⁡2(1+SNR1+INR1). The joint decoder at receiver 2 analogously gives R1+R2≤κlog⁡2(1+SNR2+INR2). If h21=0, then h22=0, so R2=0 by step 1.1; the first sum bound is the R1 individual bound and the second is no tighter because INR2≥SNR1. If h12=0, then h11=0, so R1=0 and the second sum bound is the R2 individual bound while the first is no tighter because INR1≥SNR2. Thus both sum bounds hold also when a cross gain vanishes.

4.1F1F2step 1.1algebra∎

Use the same independent Gaussian codebook ensemble at the two receivers. The finite-receiver construction in the proof of [F2] sums the two ensemble-average errors and jointly selects codebooks meeting both deterministic power constraints, so one codebook pair achieves the intersection of the two Gaussian MAC regions. The strong gain inequalities make each unintended-receiver individual constraint at least as large as the corresponding intended-receiver constraint; the two sum constraints are exactly those displayed. Therefore every rate pair strictly inside the claimed region is achievable, and closure removes strictness.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Capacity of a finite relay channel with output feedback to source and relay

Statement

For the finite relay channel with full output feedback to source and relay in Finite discrete memoryless relay channel and causal code, the capacity is C=max⁡PX,Xrmin⁡{I(X,Xr;Y), I(X;Y,Yr∣Xr)}.

Facts & Assumptions

Given: A finite relay channel with full feedback to both encoders.

[F1]

Finite discrete memoryless relay channel and causal code: the source uses Xi=fi(M,Yi−1,Yri−1), while the relay uses Xr,i=gi(Yi−1,Yri−1) with no message argument; current outputs follow the memoryless law.

[F2]

Cut-set outer bound for causal and full-feedback relay channels: any causal relay code satisfies both cut-set bounds with a finite time-sharing variable.

[F3]

Decode-forward inner bound for a finite relay channel: block-Markov decode-forward achieves the minimum of the source-to-relay-observation and source-plus-relay-to-destination mutual informations.

[F4]

Finite distributions, entropy, divergence, and stochastic matrices: the finite entropy summand −pln⁡p, extended by zero at p=0, is continuous on the probability simplex.

[F5]

Conditional mutual information is concave in the channel input law: for a fixed channel, conditional mutual information is concave in the input law, including conditional input laws given Xr.

Proof

1.1F1F2F5algebra

Apply [F2]. Its outer bound has a finite time-sharing variable Q and bounds I(X,Xr;Y∣Q) and I(X;Y,Yr∣Xr,Q). Apply [F5] first with input (X,Xr) and no side information, then with input X and side information Xr. Averaging over Q cannot increase either conditional mutual information, so both are bounded by the corresponding quantities under the averaged joint input law PX,Xr. This gives the displayed maximum as an outer bound.

1.2F1F3given

For achievability, view (Yr,Y) as the relay's observation and Y as the destination output. This is a finite relay channel whose relay encoder can causally use the observation pair because it has full feedback in [F1]. Apply the block-Markov construction of [F3] with the relay observation Y~r=(Yr,Y); its decoding term becomes I(X;Y,Yr∣Xr), while the destination decoding term is I(X,Xr;Y). Every joint input law factors as PXrPX∣Xr, so the construction achieves every rate below the displayed minimum.

2.1step 1.1step 1.2F4algebra∎

The outer bound in step 1.1 and achievable rates in step 1.2 coincide for every joint input law. The joint-input probability simplex is compact. Each mutual information is continuous there because it is a finite sum of terms −pln⁡p, with pln⁡p extended continuously by 0 at p=0; the minimum of the two continuous functions is continuous. It therefore attains a maximum, and taking that maximum and closure proves the capacity formula.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

Capacity region of a finite two-user interference channel under strong interference

Statement

For the channel and universal strong-interference assumptions of Finite two-user interference channel and strong-interference regime, the capacity region is the closure of the union over finite Q and laws PQPX1∣QPX2∣Q of rate pairs satisfying R1≤I(X1;Y1∣X2,Q),R2≤I(X2;Y2∣X1,Q), R1+R2≤min⁡{I(X1,X2;Y1∣Q),I(X1,X2;Y2∣Q)}.

Facts & Assumptions

Given: A finite interference channel satisfying the universal inequalities in [F1].

[F1]

Finite two-user interference channel and strong-interference regime: the two mutual-information orderings hold for every product input law.

[F2]

Strong-interference information inequalities tensorize over product code inputs: these orderings tensorize for independent codeword vectors.

[F3]

Finite-alphabet Fano inequality: decoding with error Pe gives conditional message entropy at most ln⁡2+Peln⁡∣M∣.

[F4]

Independent-private-message DM-MAC capacity region: for each finite product input law with public time sharing, the no-feedback DM-MAC capacity region has the two individual mutual-information bounds and the joint sum bound; its achievability proof uses independent random codebooks with the stated product law.

[F5]

Finite entropy and mutual-information chain rules: finite entropy chain rules and conditioning identities give the coordinatewise entropy bound in the converse.

Proof

1.1F1F3givenalgebra

For any length-n code, independence of the messages makes the induced vectors X1n,X2n independent. Fano at receiver 1 and the fact that revealing M2 cannot reduce mutual information give nR1≤I(X1n;Y1n∣X2n)+o(n). The analogous receiver-2 bound is nR2≤I(X2n;Y2n∣X1n)+o(n).

1.2F1F4given

Fix finite Q and product conditional input laws. Apply [F4] to the marginal MAC at receiver 1 and to the marginal MAC at receiver 2. Both uses of [F4] generate the same ensemble of independent sender codebooks, because the input laws and time-sharing sequence are the same; only the two decoders differ. Under the strong-interference inequalities [F1], receiver 2's individual bound for sender 1 is at least receiver 1's intended individual bound, and receiver 1's individual bound for sender 2 is at least receiver 2's intended bound. The intersection of the two MAC regions is therefore exactly the three inequalities in the statement.

2.1F1F2F5step 1.1algebra

For the first individual bound, the finite entropy chain rule [F5] and memorylessness give I(X1n;Y1n∣X2n)=H(Y1n∣X2n)−H(Y1n∣X1n,X2n)≤∑iI(X1,i;Y1,i∣X2,i), where the first entropy is at most ∑iH(Y1,i∣X2,i) by the chain rule and conditioning, and the second entropy is exactly ∑iH(Y1,i∣X1,i,X2,i) by the memoryless channel. The same calculation applies to user 2.

2.2F1F2F3step 1.1algebra

By the block-lift inequality [F2], I(X2n;Y1n∣X1n)≥I(X2n;Y2n∣X1n). Since M2 is independent of M1, Fano at receiver 2 implies H(M2∣Y1n,M1)=H(M2∣M1)−I(M2;Y1n∣M1)≤H(M2∣M1)−I(M2;Y2n∣M1)=o(n). Fano at receiver 1 gives H(M1∣Y1n)=o(n). Thus n(R1+R2)≤I(M1,M2;Y1n)+o(n)≤I(X1n,X2n;Y1n)+o(n)≤∑iI(X1,i,X2,i;Y1,i)+o(n). Exchanging receivers gives the corresponding sum bound at Y2.

3.1step 2.1step 2.2algebra

Let Q be uniform on [n] and let (X1,X2) have the time-Q input law; since the message vectors are independent, PX1,X2∣Q=PX1∣QPX2∣Q. Combining steps 2.1, 2.2 gives the stated inequalities for this Q. Taking limits and closure proves the converse.

4.1F4step 1.2algebra∎

The [F4] random-coding proof gives ensemble-average error tending to zero at each receiver under the strict MAC inequalities. The expected sum of the two receiver errors is at most the sum of those two vanishing bounds, so a deterministic codebook pair exists for which both errors tend to zero. Closure removes strictness and the finite variable Q supplies time sharing.

TheoremStatement: Literature-sourcedProof: AI-adaptedprecheck pendingOpen item page →

The two-user Gaussian interference capacity region to within one bit

Statement

For the complex Gaussian interference channel of Real and complex two-user Gaussian interference channels, the Etkin–Tse–Wang Han–Kobayashi scheme is within one bit per user of capacity, in the coordinatewise sense that for every capacity pair (R1,R2) there is an achievable pair (R1′,R2′) with Ri′≥max⁡{0,Ri−1}. The scheme uses Gaussian common/private splits with the following nominal power policy, permitting auxiliary removal and rate moving as in Gaussian superposition Han–Kobayashi region with nonunique decoding and rate moving: in the weak regime each private signal's nominal received power at the unintended receiver is min⁡{1,INR}; in the mixed regime the user causing strong interference uses only a common message and the other nominal private signal is at noise level or uses its entire power if its INR is below one. Auxiliary removal may replace a nominal split by the explicitly described one-common/one-unsplit-user construction. In the strong regime both messages may be decoded at both receivers using the exact region of [F1].

Facts & Assumptions

Given: A complex Gaussian channel with nonnegative finite powers and the SNR/INR convention in [F2]; all logarithms in the proof are base two.

[A1]

The Axiom of Choice: AC is inherited through Gaussian input and information suppliers.

[F1]

Exact strong-interference region for the two-user Gaussian interference channel: in the strong regime, the Gaussian MAC-intersection region is exact.

[F2]

Real and complex two-user Gaussian interference channels: INR1 is user 2's interference power at receiver 1 and INR2 is user 1's interference power at receiver 2.

[F3]

Gaussian Han-Kobayashi inner region for a fixed private-power split: fixed Gaussian private/common powers achieve every feasible three-stream subset-decoding rate split, including singleton streams and closure.

[F4]

Genie-aided outer bounds for the two-user Gaussian interference channel: capacity obeys the displayed weak and mixed individual, sum, and weighted outer bounds.

[F5]

Gaussian superposition Han–Kobayashi region with nonunique decoding and rate moving: the seven Gaussian HK facets, with an explicit nine-facet elimination and auxiliary-removal construction, are achievable under the nominal split policy; its proof selects deterministic codebooks satisfying the average power constraints.

[F6]

Power bound for real and complex scalar Gaussian channels: the scalar Gaussian converse bounds a remaining user's rate by its single-user power formula when the other input vanishes.

Proof

1.1A1F1F2givencases

First suppose both prescribed powers are positive; zero powers are handled separately below. Write a=SNR1, b=SNR2, c=INR1, d=INR2 and L(x)=log⁡2x. The weak regime is c<b, d<a, the mixed regimes have exactly one reversed comparison, and the strong regime is c≥b, d≥a. Positive powers make these comparisons equivalent to the gain comparisons in [F1]. In the strong regime [F1] supplies the exact region, so there is no loss. We treat one mixed regime and obtain the other by exchanging all user indices.

2.1F2F4F5step 1.1givenchoosealgebra

In the weak regime set kc=max⁡(1,c), kd=max⁡(1,d), q1=min⁡(1,d), q2=min⁡(1,c), t1=a/kd, t2=b/kc, N1=1+q2, and N2=1+q1. These correspond to the nominal private powers P1p=P1/kd and P2p=P2/kc, including zero cross gains without division by an INR. Let Ai,Di,Ei,Gi be [F5]'s quantities for this split. Then 1≤Ni≤2, t1≥a/(1+d), t2≥b/(1+c), (N1+t1)(1+d)≥1+a, and (N2+t2)(1+c)≥1+b: for example (1+d)/kd≥1 and N1≥1. These elementary inequalities will compare all facets uniformly, including INR below one. Denote by O1,O2,O3 the three weak outer sum right-hand sides in their displayed order and by W1,W2 the outer 2R1+R2 and R1+2R2 right-hand sides.

2.2F2F4F5step 1.1givenchoosealgebra

In the mixed regime c≥b, d<a, take q2=0, t2=0, N1=1, q1=min⁡(1,d), N2=1+q1, t1=a/max⁡(1,d). Thus user 2 is nominally all common, and the private user 1 signal has unintended received power min⁡(1,d). The seven-facet quantities become A1=L(1+t1), D1=L(1+a), E1=L(1+c+t1), G1=L(1+c+a), A2=0, D2=L(1+b/N2), E2=L((1+d)/N2), and G2=L((1+d+b)/N2). Let O=L(1+a)+L(1+b/(1+d)) and V=L(1+b+d)+L(1+c+a/(1+d))+L(1+b/(1+c)), the mixed outer first sum and weighted right sides. The remaining sum bound is G1. Since (1+d)/max⁡(1,d)≥1, we have (1+t1)(1+d)≥1+a and (1+c+t1)(1+d)≥1+c+a.

2.3F2F3F4step 1.1givenconstructalgebracases

It remains to justify clipping a coordinate at zero; a negative-coordinate polygon argument would not do this. If both capacity coordinates are at most one, use the zero code. Suppose R1≤1<R2 and write B=L(1+b). The capacity individual bound gives R2≤B, so it suffices to achieve (0,max⁡(0,B−1)) on the axis. Shut user 1 off. In a weak nominal split, if c<1 user 2 is entirely private and achieves B. If c≥1, its desired private power is b/c and its unintended private power is one. Its common layer can be decoded at the unintended receiver while treating its private layer as noise at any rate up to C=L((1+c)/2). At its intended receiver the private rate bound is A=L(1+b/c), the common bound is H=L(1+b−b/c), and the total bound is B. The product identities (1+b/c)(1+b−b/c)≥1+b and (1+b/c)(1+c)≥1+b give A+H≥B and A+C≥B−1. For a total rate T≤min⁡(B,A+C), allocate private rate min⁡(A,T) and common rate max⁡(0,T−A); this common rate is at most both C and H. Every intended MAC subset inequality and the unintended common decoding inequality therefore holds, with closure for equality, so [F3] achieves at least max⁡(0,B−1) with this same nominal split. At c=1 the common power and C are zero and the calculation still holds.

3.1F4F5step 2.1givenalgebra

The complete weak facet comparison table is inner right sidecapacity upper boundupper bound minus inner right sideD1L(1+a)≤LN1≤1D2L(1+b)≤LN2≤1A1+G2O1≤L(N1N2)≤2A2+G1O2≤L(N1N2)≤2E1+E2O3≤L(N1N2)≤2A1+G1+E2W1≤L(N12N2)≤3A2+G2+E1W2≤L(N22N1)≤3. Here the first two comparisons follow from D1=L((N1+a)/N1) and its reflection. For A1+G2, cancel the common factor 1+d+b in the numerator and use (N1+t1)(1+d)≥1+a; the denominator is N1N2. The reflected inequality proves the next row. For E1+E2, each of its numerator factors 1+c+t1 and 1+d+t2 dominates the corresponding outer factor by step 2.1. For the W1 row cancel 1+a+c and compare the remaining inner factors (N1+t1)(1+d+t2) with the outer factors ((1+a)/(1+d))(1+d+b/(1+c)), factor by factor using step 2.1; the denominator is N12N2. Reflection gives the final row. This verifies every entry of the table by multiplication of nonnegative factors.

3.2F4F5step 2.2givenalgebracases

The full mixed comparison table is inner right sidecapacity upper boundupper bound minus inner right sideD1L(1+a)0D2L(1+b)≤LN2≤1A1+G2O≤LN2≤1A2+G1G10E1+E2G1≤LN2≤1A1+G1+E2L(1+a)+G1≤LN2≤1A2+G2+E1V≤LN2+L(1+b/(1+c))≤2. The third row follows by canceling 1+d+b and using (1+t1)(1+d)≥1+a. The fifth uses (1+c+t1)(1+d)≥1+c+a. The sixth uses the former inequality after canceling G1; its capacity upper bound is the sum of the individual R1 bound and the MAC sum bound, hence is a valid bound on 2R1+R2. In the last row G2 has the same output numerator as the first term of V, and 1+c+t1≥1+c+a/(1+d); the sole additional outer factor is 1+b/(1+c)≤2 because b≤c. These calculations prove all rows, and each gap is no larger than its facet's sum of coefficients. They include d<1, d=1, d=0, b=0, and c=b directly. Therefore for mixed capacity pairs with both coordinates at least one, (R1−1,R2−1) obeys all seven achievable facets. Reflecting indices proves the other mixed regime.

4.1F3F4F5step 2.1step 3.1givenalgebracases

If a weak-regime capacity pair has R1,R2≥1, put ri=Ri−1. Subtracting one in each coordinate reduces the linear functionals with coefficient pairs (1,0), (0,1), (1,1), (2,1), and (1,2) by respectively 1,1,2,3,3. The table therefore places (r1,r2) in all seven facets of [F5], which is achievable with the nominal split and its authorized auxiliary-removal alternatives. There are no missing INR subcases: if c<1 then q2=c and user 2's common power is zero; if d<1 the reflected fact holds. The formulas remain exact, and facets made redundant by singleton streams do not need to be imposed anew. At c=1 or d=1 the formulas from the two sides coincide. If c,d<1, both common layers vanish and the seven-facet region reduces to the rectangle r1≤L(1+a/(1+c)), r2≤L(1+b/(1+d)); each individual gap is at most one. Thus the same calculation covers both sub-noise INRs, either one, and their zero and unit boundaries.

5.1F1F2F3F4F5step 4.1step 3.2step 2.3givencases

For a mixed axis, the nominally all-common strongly interfering user has unintended link at least as strong as its intended link; with the other user shut off its entire intended single-user rate is decodable at both receivers. The other user's axis is covered by the calculation in step 2.3, including the entirely-private case when its INR is below one. Reflecting indices handles R2≤1<R1. Singleton layers and boundary rates follow from [F3]'s closure; the superposition and fallback regions use the explicit slack-power selection in [F5]. Thus for every weak, mixed, or strong capacity pair with positive prescribed powers there is an achievable pair whose coordinates are at least max⁡(0,Ri−1). All changes of layer labels and powers in the non-axis seven-facet construction are exactly the permitted auxiliary removal of [F5], so the full coordinatewise claim and nominal power policy in the statement both hold.

6.1F2F3F4F6step 1.1step 2.3step 5.1givencases∎

Finally let a prescribed power vanish. If P1=0, the average nonnegative energy constraint forces user 1's codeword to vanish almost surely, so R1=0 and a=d=0; the scalar individual converse gives R2≤L(1+b). If also P2=0, both rates are zero. Otherwise, when c≥b the nominal all-common user 2 code achieves its exact single-user rate at both receivers, since ∣h21∣2P2≥∣h22∣2P2; there is no condition on user 1's gains to check because it sends no information. When c<b the nominal private user 2 split achieves at least max⁡(0,L(1+b)−1) by the direct axis construction of step 2.3. The case P2=0<P1 is reflected. All deterministic zero-power layers are omitted, and no argument divides by a gain or a zero power. This proves the asserted full-channel claim for nonnegative finite powers as well as the positive-power cases.

5 · Examples, counterexamples and false statements

None yet.

Sources