How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Relay and Interference Channel Bounds
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Areas of Elementary Plane Figures
- Binary Operations, Monoids, Groups and Subgroups
- Central Limit Theorems
- Characteristic Functions Inversion and Continuity
- Compactness
- Compactness in Metric Spaces
- Complete Metrizability, Čech-Completeness, and Baire Category
- Completeness, Completion, and Uniform Continuity
- Complex Lp Spaces and Test-Function Conventions
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Computational foundations: factorization, KL, and optimization
- Conditional Distributions and Regular Conditional Probability
- Conditional Expectation
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Convexity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Countability Axioms and Cardinal Functions
- Cyclic Groups and Direct Products
- Darboux, L'Hôpital, and Taylor's Theorem
- Density Separability and Convolution in Lᵖ
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Direct Matrix Factorisations: LU, Cholesky and QR
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Domination and Likelihood Ratios
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- F-Divergences, Rényi Information, and Hypothesis Testing
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Finite Probability Spaces and Random Variables
- Finite-Alphabet Entropy and Divergence
- Foundations of the Real Numbers for Analysis
- Fourier Transform Convolution and Approximate Identities
- Fubini and Change of Variables
- Fundamental Trigonometric Identities
- Gaussian Elimination, Elementary Matrices and Reduced Row Echelon Form
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Hausdorff via the Diagonal
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Improper and Parameter-Dependent Multiple Integrals
- Improper Integrals
- Independence Borel Cantelli and Zero One Laws
- Infinite Product Measures and Kolmogorov Extension
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Lebesgue Measure on Euclidean Space
- Lebesgue-Stieltjes Measures and Distribution Functions
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Loss, Risk and Decision Theory
- Lossy Source Coding with Side Information
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Measurable Functions and Simple Approximation
- Measure-Theoretic Information and Conditioning
- Measures and Their Basic Properties
- Metric Spaces
- Minimax Lower Bounds
- Mixed effects and longitudinal models
- Mixed Partials, Taylor Formulae, and Extrema
- Modes of Convergence Egorov and Lusin
- Modes of Convergence for Random Variables
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Multiuser Channel Networks
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Outer Measure and the Caratheodory Extension Theorem
- Partitions of Unity and Paracompactness
- Pointwise Extended-Real Function Products
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Probability Spaces Random Variables and Expectation
- Product Measures and the Fubini Tonelli Theorems
- Properties of the Integral and the Working FTC
- Quantum Communication and Fingerprinting
- Radon Measures and the Riesz Markov Kakutani Theorem
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Separation Axioms: the Hierarchy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Signed and Complex Measures Hahn and Jordan
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Splitting Fields
- Standard-Borel Real Codings and Determining Classes
- Statistical Experiments, Models and Identifiability
- Subspaces, Products, and Quotients
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Cantor Set, Baire Category, and Measure Zero in ℝ
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Exponential Function
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Galois Correspondence
- The Integral Logarithm and the Equivalence of Its Characterisations
- The Inverse and Implicit Function Theorems
- The Lebesgue and Riemann Integrals Compared
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Lᵖ Spaces Holder Minkowski and Riesz Fischer
- The Maximal Function and Lebesgue Differentiation
- The Radon Nikodym Theorem and Lebesgue Decomposition
- The Riemann Integral in Rᵐ and Jordan Content
- The Riemann Integral: Definition and Integrability
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The Topology of Euclidean Space
- The Total Derivative in ℝᵐ → ℝⁿ
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Urysohn's Lemma and the Tietze Extension Theorem
- Vector Spaces, Linear Subspaces, Span and Direct Sums
- Weak Convergence Tightness and Representation
- Weak Laws and Series of Independent Random Variables
2 · Summary
This page separates three kinds of claims. For finite relay channels it proves a causal cut-set outer bound and a decode-forward inner bound; for the full-output-feedback model the two match. For finite multicast and two-way relay channels it proves noisy-network-coding specializations using explicit likelihood-ratio encoding, simultaneous message decoding, and compression-rate elimination. For interference channels it distinguishes the universal strong-interference hypotheses from Gaussian strong, weak, and mixed regimes. The Gaussian within-one-bit theorem is stated in the complex channel convention of Etkin–Tse–Wang.
Finite-alphabet mutual information and rates use nats. The binary examples explicitly convert those quantities to bits. Gaussian formulas and examples use bits per use. In the Gaussian interference convention, and ; consequently is the interference power at receiver 1 and at receiver 2. The real scalar version has unit-variance noise and a factor in logarithmic rates; the complex version has unit-variance circular Gaussian noise and no such factor.
The first diagram labels the relay links by their input/output symbols. The second diagram uses the Etkin–Tse–Wang gain indexing for the Gaussian interference channel. These diagrams specify the models; the proofs use the transition laws and channel equations directly.
S \arrow[r, "X\mapsto Y_r"] \arrow[dr, "X\mapsto Y"'] & R \arrow[d, "X_r\mapsto Y"] \\
& D
T_1 \arrow[r, "h_{11}"] \arrow[dr, "h_{12}"'] & R_1 \\
T_2 \arrow[ur, "h_{21}"] \arrow[r, "h_{22}"'] & R_2
The prerequisite page multiuser-channel-networks supplies the finite DM-MAC coding interface used in the finite strong-interference achievability proof. The local Gaussian coding constructions explicitly enforce deterministic power constraints. Noisy network coding includes a Euclidean likelihood-ratio proof and noise-level Gaussian specialization, while the interference comparison treats every weak and mixed regime, including INR below one and clipped coordinate axes. Its noise-level split is nominal: auxiliary removal and rate moving are permitted as proved in the coding bridge. These are draft mathematical constructions; workflow acceptance is recorded separately.
The Gaussian converses use local standard-Borel chain-rule/data-processing and memoryless-vector tensorization lemmas, so codeword coordinates are allowed to be dependent. The scalar Gaussian power bound proves the density-to-mutual-information identity under the stated finite-moment assumptions before applying real or complex maximum entropy.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Likelihood-ratio network coding for finite or Euclidean multicast networks
Statement
All logarithms, mutual informations and rates in this lemma are in nats. Consider a memoryless network with finite node set , source set , destination set , and independent uniform source messages, each required by every destination. Alphabets are either all finite, as in Finite discrete memoryless networks and causal codes, or finite-dimensional Euclidean spaces with constant coordinates allowed. Encoders are measurable functions of a node's own message and its past outputs; a destination knows its own message. Choose a finite variable and measurable kernels with joint law Assume AC in the Euclidean case. For each positive-probability , require a measurable version of the local log likelihood to exist and be square-integrable under the target law. For a destination , nonempty , and , put , let be the target marginal law of given , and define Require with a measurable square-integrable log likelihood under . Require all mutual informations in the following cut expression to be finite: These likelihood and finiteness hypotheses hold automatically for finite alphabets; zero-mass target atoms are omitted. At any chosen constrained node let be a measurable input cost. Require either and , or a deterministic input whose cost is at most . The latter case includes an identically zero input under a zero budget. Unconstrained nodes and constant coordinates are permitted.
Every nonnegative rate tuple satisfying for every and nonempty with and is achievable by deterministic measurable causal codes. Each constrained node can satisfy on every realized transmitted input sequence of code length , and hence also its expected average-cost constraint. The closure of the union of these regions over admissible laws is achievable. Constant reconstructions are permitted. The separate all-zero tuple is achievable whenever one can choose fixed inputs obeying any imposed costs, regardless of negative cut expressions.
Facts & Assumptions
Given: The network, product law, square-integrable likelihoods, finite cut informations, and optional slack costs in the statement.
The Axiom of Choice: AC is assumed only for the Euclidean conditional-law and conditional-KL interfaces.
Finite discrete memoryless networks and causal codes: the finite case uses causal encoders, independent messages, a memoryless channel and average error over all required estimates; the statement specifies the same measurable coding conventions for Euclidean alphabets.
Finite conditional mutual information, Finite conditional mutual information identities and equality, and Finite entropy and mutual-information chain rules: finite conditional mutual information is conditional KL, is nonnegative, and obeys the entropy and mutual-information chain rules.
Conditional mutual-information chain rule and data processing for standard-Borel variables: in the Euclidean case, conditional-KL chain rules and nonnegativity apply to the specified measurable conditional laws; no infinite quantities are subtracted here.
IID finite-variance weak law: sample means of IID square-integrable real variables converge in probability to their expectations, with variance divided by the number of samples.
Proof
Write . Fix and . Choose a deterministic word whose symbol proportions tend to , omitting zero-probability symbols. For node let and . Define and . Under the target product law, the information density is a sum of the stated square-integrable local log likelihoods. Apply [F4] separately to the finitely many positive-probability subblocks; their lengths tend to infinity and their proportions tend to . Thus its normalized sum tends in probability to , so . The pointwise inequality shows that pairs with have probability tending to zero.
For a good pair , put and . Generate independent reconstruction entries with law , where . Test entries in order, accepting with probability using an independent uniform for each entry. This is at most one, its mean is , and is independent of the good pair. The no-acceptance probability is . Use a fixed default index on a bad pair or no acceptance. Conditional on acceptance at a specified label , the accepted entry has law ; an earlier rejected entry has law , bounded by for large ; later entries retain law . Multiplication of the independent entry and uniform densities proves these statements and conditional independence of the entries given the pair and .
Since and on good pairs, the averaged total variation error of the selected reconstruction kernel tends to zero by step 1.1. Summing these errors over the finitely many nodes compares their product kernels to the target product test channel; the bound follows by replacing one kernel at a time and integrating bounded indicator functions. Consequently every full-tuple target event of probability tending to one also holds with probability tending to one for the selected reconstructions, apart from the already vanishing selection failures. Draw one independent uniform for each node, block, message, previous-index branch, and reconstruction entry. A transmitted branch exposes each such uniform at most once. Uninspected branches retain their independent codewords and uniforms; the finite array will be fixed at the end.
Set . The block acceptance test at destination is the intersection, over every allowed , of By the square-integrability hypothesis and [F4], all these finitely many tests accept the true target block with probability tending to one. On the displayed event the reference product measure is at most times the target product measure; integration therefore bounds its reference probability by . This argument applies to discrete sums and Euclidean integrals alike.
Let . Conditional KL chain rules, using independence of the inputs given , give For a direct verification in finite alphabets, expand the reference likelihood: the input contribution is , and the reconstruction contribution is ; order the latter entropy by . The conditional-KL expansion gives the identical formula in the Euclidean case without assuming finite differential entropy. A further chain expansion shows that is the conditional KL of from , averaged over the displayed conditioning tuple. It is nonnegative; in finite entropy notation it equals . Thus for every wrong-current-index pattern.
Subtract from the th reconstruction summand in step 5.1. The test-channel factorization says that given , the reconstructions in are conditionally independent and depend only on their own . In finite entropy notation the sum of differences is therefore ; conditional-KL chain expansion gives the same identity for the assumed finite Euclidean informations. Consequently This cancellation uses the product test channels and does not require independent channel outputs.
For each constrained node with a strict mean-cost inequality choose , and condition each independent product input word on . Its conditioning probability tends to one by [F4], since the cost has finite second moment; the finite- subblock argument of step 1.1 applies. Each such word obeys the cost bound deterministically. Its law has density at most relative to the target product input law and total variation distance . At an unconstrained node use the unconditioned word and put ; at a deterministic already-feasible constrained node use its fixed word and also put , so no strict slack is needed there. For a fresh block the transmitted input tuple is within of its target product law, uniformly in all previous labels. Passing through a kernel preserves this upper bound, because an event's conditional probability is in . Thus the vanishing selection-failure and true-test estimates remain valid for these input words.
Choose a fixed block count . At node in each block , independently generate for and , using singleton messages when or , and the word law from step 7.1. For each word generate reconstruction words from and the uniforms of step 3.1. All nodes, branches and blocks are independent. Initialize . In block send , and after the block choose by step 2.1. This is causal. A destination fixes its own message and its own actual index sequence, and selects the unique other-source message tuple for which some remaining index sequence passes every block test from step 4.1. Ties or no tuple are errors; compression indices need not be uniquely decoded. Every operation is a finite search through measurable tests. The message is repeated across all blocks, so length gives rate tending to .
Expose fresh blocks sequentially. Conditional on messages and previous true labels, the next block arrays are independent of the past, so steps 1.1–3.1, 4.1 and 7.1 apply to its actual transmitted branch. A finite union over local selections and true-message tests gives vanishing true-message failure probability. To track false messages, by symmetry set the true messages to 1. Fix a nonempty wrong-source set , a false message tuple, a true label path , and a candidate label path . Put and . Then , , and . At a node in the false branch is uninspected; at a node in its candidate reconstruction is an unselected entry of the true branch, subject to the factor 2 bound in step 2.1; all other candidate entries are true selected entries, subject to the factor .
The exact unnormalized measure for one true block and specified successful labels is where means every local pair is good and is the word law. There is no division by . Integrate nuisance true coordinates and use step 9.1. At most two input words per node are exposed, each bounded by for large . The candidate block subprobability is therefore bounded by the geometric label weight times , with independent of all labels and . Retaining the indicator can only reduce this bound. For a fixed true path, different block arrays are independent; all its branch labels are fixed. The sum of its geometric weights over allowed true paths is at most one. Thus the block packing bounds multiply, with no conditioning on a possibly rare global good event.
Drop the first block's false-message test. For each remaining block step 4.1 and give the factor , independently of . For a fixed previous-index pattern , at most previous-index vectors realize it; at most sets contain and exclude . There are at most final-index choices and false message tuples with set , where and . Summing all these paths and the true weights from step 10.1 gives a constant depending only on times Rounding the contributes only another constant for fixed . This is the union bound for every false message/previous-index/current-index pattern.
If constrained cuts exist, their finitely many strict rate gaps have a positive minimum . Choose small and then with small enough that on every cut. Step 6.1 gives . For every , nonnegativity gives . Choose sufficiently large that for all finitely many . This is possible because the remaining strict gaps are at least . Fix those choices and let . Every exponential term in step 11.1 tends to zero, as do the true-message failures. If no constrained cuts exist, all required messages are either absent or already known locally and there is nothing to decode. A finite union over destinations proves multicast reliability.
In the finite branch, every fixed codebook and seed array induces one of finitely many deterministic encoder/decoder functions on the finite message and observation domains. Aggregate the ensemble distribution over this finite set of functions, enumerate it, and take the first code whose error is at most the ensemble average. Thus neither the auxiliary uniforms nor selection of the final finite code assumes AC. In the Euclidean branch average error over codebooks, messages and the finite uniform arrays and select a deterministic realization whose error tends to zero; a realization of error at most twice the positive average exists by integration, while if the average is zero almost every realization has zero error. The fixed-seed encoders and decoders remain measurable and causal. Each chosen input word obeys its shell bound, so concatenating words gives the claimed pointwise and expected costs; no random ensemble power assertion is used to select the deterministic code. Constant reconstructions contribute zero information and satisfy the same construction. The all-zero tuple uses singleton messages and any allowed fixed inputs, with zero error. Finally choose strict-region tuples tending to any point of the closure and, for the th tuple, a sufficiently long code of error below and rate within of that tuple. These codes realize the closure by the definition of achievability.
Entropy estimates for complex Gaussian interference converses
Statement
Assume AC, use base-two entropy, and let be IID unit circular Gaussian vectors independent of , where . For , For the complex channel in Real and complex two-user Gaussian interference channels, let the two input vectors be independent, obey the average power constraints, and have arbitrary dependence within each vector. Write , , , , , and . Then and the index-reflected conditional bound also holds.
Facts & Assumptions
Given: The finite-second-moment inputs, independent Gaussian noises, and average power bounds in the statement; entropy is measured in bits.
The Axiom of Choice: AC is inherited through the Gaussian and information suppliers.
Real and complex two-user Gaussian interference channels: the channel, SNR/INR convention, and average input power constraints.
Circular complex Gaussian maximizes differential entropy at fixed second moment: after dividing its natural-log bound by , a complex variable of variance with finite entropy and positive-definite real covariance has base-two entropy at most .
Bounded densities with finite second moments have finite differential entropy: bounded densities of finite second moment have finite differential entropy.
Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional mutual-information chain rules, nonnegativity, and data processing.
Measure-theoretic mutual information: mutual information is the natural-log KL divergence of the joint law from the product of its marginals, measured in nats.
Proof
If are jointly Gaussian-smoothed finite-second-moment scalar variables with nonsingular joint Gaussian noise, then for every complex . The first identity is conditional translation and the first inequality is conditional mutual-information nonnegativity; the second is [F2]. A finite-dimensional convolution with a nonsingular Gaussian has a bounded density, finite second moment, and positive-definite real covariance; [F3], applied after identifying complex vectors with real vectors, therefore makes every relevant joint, marginal, and residual differential entropy finite and verifies the hypotheses of [F2]. In particular the pairs and have nonsingular independent receiver-noise coordinates, and the degraded pair below has nonsingular joint Gaussian noise when . Their conditional entropies are differences of these finite joint and marginal entropies. For conditioning additionally on , which need not have a density, first subtract its known translated contribution; independence removes that conditioning and leaves the nonsingular smoothed pair . For a channel with conditional density and positive output density , the joint-to-product density ratio is . Thus [F5] gives . When with independent nonsingular Gaussian , the two log integrals are finite by [F3] and the quadratic Gaussian log density, and this integral equals . The same calculation with conditional densities justifies the conditional entropy identities used below, with every base-two entropy difference equal to the corresponding mutual information divided by , since their joint and marginal entropies are finite as established above. At zero signal power the same Gaussian density argument applies without alteration. Coordinate entropy chain rules give .
Suppose and set , . The marginal law of is the lower-SNR channel and is Markov. The chain rule and step 1.1 give : the conditional noise is given . For a coordinate variance , minimizing the quadratic residual variance of given gives . Step 1.1 therefore bounds the entropy difference by . This logarithmic ratio has derivative , which is nonnegative and decreasing. Jensen and the average variance bound yield the first claimed inequality. If the two marginal entropies agree; if the same construction and computation apply. If both outputs are pure Gaussian noise.
Let . The optimal scalar linear estimate of from has residual variance : independence of the two user vectors and the noises eliminates all other covariances. Step 1.1 bounds the conditional entropy by the logarithm of this variance times . The map is increasing and concave on for , with second derivative ; hence the residual variance is increasing and concave in the two powers, and its logarithm is also concave and increasing. Jensen and give the first conditional-output bound. Reflection gives the second. This calculation has no division by a channel gain and remains valid when any gain vanishes.
The output variances are and . Applying the coordinate chain rule, [F2], and logarithmic Jensen gives the two unconditioned-output bounds. Given , subtract its contribution from ; independence leaves the linear-estimation problem for from . Its coordinate residual variance is . The same concavity calculation proves the final conditional bound. Reflection proves its counterpart.
Gaussian superposition Han–Kobayashi region with nonunique decoding and rate moving
Statement
For the complex Gaussian channel in Real and complex two-user Gaussian interference channels, fix Gaussian common/private powers , with each component nonnegative. Write , , , , , , , , , . All following logarithms are base two. Put Every nonnegative pair satisfying is achievable by Gaussian superposition coding with the fixed split as a nominal distribution and with auxiliary removal and rate moving allowed. More precisely, if also and , the original split suffices, with each receiver decoding its own message uniquely and the unintended common index nonuniquely. If the first extra inequality fails, one may discard user 2's private layer, encode all its information in its nominal common layer, encode all user 1 information in one full-power Gaussian codeword, let receiver 1 decode both codewords, and let receiver 2 treat user 1 as noise. The reflected alternative applies if the other extra inequality fails. The two extra inequalities cannot fail together. All codes satisfy the expected average power constraints. Closure includes singleton streams and boundary pairs.
Facts & Assumptions
Given: A complex channel, a nominal split, and a nonnegative rate pair satisfying the seven displayed facets.
The Axiom of Choice: AC is inherited through the Gaussian-law and information suppliers.
Real and complex two-user Gaussian interference channels: the channel and its expected average power constraints.
IID finite-variance weak law: IID finite-variance information-density averages converge in probability to their means.
Power bound for real and complex scalar Gaussian channels: Gaussian scalar mutual informations have their variance-ratio values.
Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional chain rules, data processing, and nonnegativity.
Proof
For private rates and common rates with , generate independent Gaussian common codewords of power and, for every common index, an independent Gaussian satellite codebook of power . Transmit . Receiver 1 uniquely decodes if some index passes its conditional Gaussian information-density tests; it does not output . Its four false-own-message classes have rate exponents , , , and : respectively wrong private only, wrong own common and its satellite, wrong private and unintended common, and wrong own common and unintended common. Conditional on the correctly indexed layers, a false class has the product law against which its likelihood ratio has mean one. Markov's inequality at a threshold strictly between its rate exponent and its Gaussian mutual information, followed by the union bound, makes its error probability vanish if , , , . A wrong unintended index alone is not an error because it leaves the decoded own message unchanged. The true information densities are IID quadratic Gaussian functions with finite variance, so [F2] proves correct-message acceptance; [F3] gives exactly the four displayed Gaussian quantities. Receiver 2 gives , , , . Zero-rate or zero-power layers have singleton message sets and no false-message class.
Deterministic power selection is included as follows. Initially reduce every positive component power by a factor , with . For user let be its input energy at coordinate , averaged over the finitely many independent message indices of that user's codebook, including the cross term in . Across coordinates the are IID; Jensen gives , independently of message-set size. The fourth moment is for a real Gaussian of variance and for a circular complex Gaussian of second moment . Thus and its mean is . Chebyshev makes the probability of either power exceeding tend to zero. The ensemble average sum of receiver errors tends to zero by step 1.1; Markov makes the probability of an error larger than the square root of that average tend to zero. Hence some deterministic codebook simultaneously meets both exact average power constraints and has vanishing errors. If a user's total power is zero, its codeword is zero and its rate is zero. Fix first, take the coding limit, and then let ; continuity and closure give the claimed nonslack region. This argument also applies to every simpler Gaussian codebook used below.
The eight inequalities in step 1.1, with closure removing strictness, project exactly to the seven stated facets plus and . Here is an explicit elimination. Set , , , , . The private rates must lie in and satisfy . Such rates exist exactly when and the intervals and intersect. Expanding the max/min comparisons gives , , , , , , , together with . The other comparisons are redundant: follows from , and or follows from and ; the remaining inequalities are nonnegativity of the Gaussian mutual informations. Conversely these same comparisons ensure the intervals intersect, providing the desired .
Suppose . The seven facets give from , from , from , and . Use a single Gaussian user 1 codebook of full power and only the nominal common user 2 power , carrying all of user 2's information; set its private layer to zero. At receiver 1 the user-1 bound is at least , and the user-2 bound is at least , the nominal ; the sum bound is at least because gives . Receiver 2's treating-user-1-as-noise bound is at least , the nominal , since removing user 2's private satellite reduces the noise. These four inequalities are precisely the Gaussian two-codeword MAC tests at receiver 1 and the single-codeword test at receiver 2; the likelihood-ratio union proof in step 1.1 with two streams proves achievability directly. The sum of the powers used is no larger than the prescribed powers, and step 2.1 selects deterministic power-feasible codebooks. This describes the changed labels and powers explicitly: all user 1 information is private at the unintended receiver, so its actual private INR can exceed the nominal ; user 2 uses only its nominal common power.
If instead , reflect the construction in step 4.1. Both extra individual inequalities cannot fail together, since that would give , contradicting a stated sum facet. When neither fails use step 3.1. Equality cases follow by closure of these achievable regions and the power-slack limit in step 2.1. If a layer is singleton it contributes no competing index; if both rates are zero use the all-zero code. This proves the entire seven-facet region, with the explicit nominal-policy and auxiliary-removal convention in the statement.
Finite discrete memoryless networks and causal codes
Definition
A finite discrete memoryless network (DMN) has a node set for an integer , finite nonempty input alphabets and output alphabets , and one transition probability vector for each input tuple. At each use, conditional on the current input tuple, the output tuple is drawn from this vector independently of earlier uses.
Node may have an independent uniform message in a finite nonempty set and a destination set . A length- causal code consists of encoders and, for each destination , a decoder ; here , with the empty tuple at . The average error is the probability that any required estimate differs from its message. A rate tuple is achievable if a sequence of such codes has error tending to zero and message-set rates tending to at least that tuple; the capacity region is the closure of achievable tuples.
Real scalar Gaussian multicast relay network and power constraints
Definition
A real scalar Gaussian relay network has node set for an integer , source set , destination set , one real input and output at each node, and channel equations where the gains are fixed and the noises are independent random variables, independent across channel uses and of all source messages. At each use the current noise vector is independent of all past observations and the current inputs; future inputs may depend on past noises through feedback. Each node has a nonnegative power budget and average power constraint . Each source has an independent uniform message in a finite nonempty set . For every non-source node , set and , so its encoder has no message information. A length- causal code uses measurable encoders and destination decoders based on , where is its own source message when and a singleton otherwise; multicast means every destination must decode every other source message, while its own message is already known. The average error probability is the probability that any required destination estimate is wrong. Write for the matrix with rows indexed by and columns by whose entries are .
Rates in this page's Gaussian formulas are measured in bits per use, .
Real and complex two-user Gaussian interference channels
Definition
The two-user Gaussian interference channel has independent messages, separate encoders, and outputs For the real model, are real and . For the complex model, the inputs and gains are complex and with density . The receiver-noise variables are independent across receivers and channel uses and independent of the messages, so the channel is memoryless. Each power budget satisfies . A length- code has independent uniform messages on for integers , deterministic separate encoders , and decoders ; no feedback is present. The expected average-power constraints are in the real model and in the complex model, with expectations under the uniform message law. The average joint error is . For either model define Rates are bits per use, . For a scalar unit-noise AWGN link with power constraint , the capacity is , attained by a centered real Gaussian input or a circular complex Gaussian input; in the real model and in the complex model.
Gaussian maximizes differential entropy at fixed positive-definite covariance
Statement
Assume the Axiom of Choice. If a random vector has a Lebesgue density, finite mean , positive-definite covariance , and finite differential entropy , then Equality holds exactly when has the Gaussian law .
Facts & Assumptions
Given: AC and a density of a random vector with finite mean , positive-definite covariance , and finite differential entropy.
The Axiom of Choice: AC is the choice axiom assumed by the Gaussian-law and KL suppliers used below.
A positive-definite multivariate normal law has its Gaussian density: if is positive definite, the law has an everywhere-positive Lebesgue density proportional to .
Kullback–Leibler divergence is nonnegative: , with equality only when , under AC.
Proof
Let be the everywhere-positive Gaussian density in [F1] with mean and covariance . Since is a Lebesgue density and everywhere, the law is absolutely continuous with respect to . The log ratio is integrable: is finite by hypothesis, while is a constant plus a quadratic form and has finite second moments. Hence The last expectation is , by expanding the finite quadratic form and using the covariance entries.
By [F2], the left side in step 1.1 is nonnegative, which rearranges to the displayed entropy bound. Equality holds exactly when , which by [F2] is equivalent to equality of the laws; thus . Conversely, substituting the density into the entropy integral gives equality because its centered quadratic expectation is .
Finite discrete memoryless relay channel and causal code
Definition
A finite discrete memoryless relay channel is the three-node instance of Finite discrete memoryless networks and causal codes with source input , relay input , relay observation , destination observation , and transition law . For a positive integer message-set size , the one-way message is uniform on and the destination estimates it from .
In the relay-only causal model, and . In the full output-feedback model, both encoders know the past pair , so and . In either model the channel outputs at time are drawn from ; no encoder sees a current-time output before choosing its current input. The rate is , and achievability uses average error under the uniform message law.
Finite two-user interference channel and strong-interference regime
Definition
A finite two-user interference channel is the two-sender, two-receiver memoryless channel with finite nonempty input alphabets , finite nonempty output alphabets , and transition law . Independent uniform messages on finite nonempty sets are encoded separately as and ; receiver estimates from . The strong-interference regime means that, for every product law , The inequalities are evaluated under the stated product law and the channel. They are universal hypotheses over input laws, not just inequalities at a chosen optimizing distribution.
Finite two-way relay channel and causal code
Definition
A finite two-way relay channel is the three-node DMN of Finite discrete memoryless networks and causal codes with terminal inputs , relay input , terminal outputs , relay observation , and transition law . Terminals 1 and 2 have independent uniform messages and and wish to exchange them. A causal code uses , , and ; terminal 1 estimates from and terminal 2 estimates from . The probability of error is the probability either estimate is wrong. This is a full-duplex model: all three nodes choose an input at every use, and each input depends only on that node's message and past observations.
Bounded densities with finite second moments have finite differential entropy
Statement
Let be a Lebesgue probability density on with and . Then , so the differential entropy in Differential entropy for real densities is a finite real number.
Facts & Assumptions
Given: A Lebesgue probability density with finite essential supremum and finite second moment.
Differential entropy for real densities: differential entropy is defined by in the absolutely integrable case.
Proof
Let and . On , , so the positive part is integrable. For , ; with , this gives . Thus on , The right side is integrable because is a probability density and is bounded by a constant plus . Hence the negative part of is integrable.
Both parts of are integrable by step 1.1. Therefore , and [F1] defines a finite differential entropy.
Circular complex Gaussian maximizes differential entropy at fixed second moment
Statement
Assume AC. Let have a Lebesgue density, finite mean , finite differential entropy, and positive-definite real covariance matrix for . Put . Then Equality holds exactly for the circular complex Gaussian law with density .
Facts & Assumptions
Given: AC and the density, mean, entropy, and positive-definite real covariance hypotheses in the Statement.
The Axiom of Choice: AC is required by the Gaussian-law and entropy supplier.
Gaussian maximizes differential entropy at fixed positive-definite covariance: a real vector with positive-definite covariance and finite differential entropy satisfies , with equality exactly for the matching real Gaussian law.
Proof
Identify with the real vector . This identification preserves Lebesgue measure and the differential-entropy integral, so [F1] with gives
Let be the eigenvalues of . Then , because . Substitution into step 1.1 gives . Equality requires equality in [F1] and , so is Gaussian with real covariance , exactly . Conversely, substituting that circular Gaussian density gives entropy .
Joint strong typicality for a finite IID source
Statement
Let be a probability vector on a finite alphabet . For every , the support-restricted strongly typical set of Finite strongly typical sets with support restriction satisfies
Facts & Assumptions
Given: A finite alphabet , a probability vector , and .
Finite strongly typical sets with support restriction: membership requires that each positive-mass letter's empirical frequency differ from its probability by at most the relative tolerance , and excludes zero-mass letters.
Proof
Fix with , and set . The variables are IID Bernoulli with mean and variance . Thus has mean and variance at most . If , then pointwise . Taking expectations bounds the deviation probability by .
If , then for each , so the probability that the word contains is zero by a finite union bound. There are finitely many positive-mass letters; summing the bounds from step 1.1 over them and adding the zero support event shows that the probability of failure of any condition in [F1] tends to zero.
Noise-level noisy-network-coding inner bound for real Gaussian multicast networks
Statement
All mutual informations and rates in this item are measured in bits; differential entropies in the proof are in nats and are divided by .
In the real Gaussian multicast network of Real scalar Gaussian multicast relay network and power constraints, take independent Gaussian inputs and independent Gaussian test-channel noises. For a chosen node set , set with for and let be constant otherwise. Every nonnegative rate tuple satisfying for every destination and every cut with and is achievable under the stated average-power constraints. The closure of the union of these strict regions over the stated choices, together with the all-zero tuple, is achievable.
In the special case for every node and , a noise-level evaluation gives the sufficient cut inequalities for every with and , where . Their closure is achievable. The all-zero rate tuple is always achievable by singleton source-message sets, independently of whether these cut right-hand sides are nonnegative.
Facts & Assumptions
Given: The real Gaussian network, arbitrary nonnegative node powers , independent Gaussian inputs and unit-variance quantization noises on the chosen set ; for the determinant specialization all powers equal and .
The Axiom of Choice: AC is assumed through the Euclidean conditional-law and conditional-KL suppliers.
Real scalar Gaussian multicast relay network and power constraints: with independent unit Gaussian noises across nodes and times, measurable causal encoders, destination knowledge of its own message, and per-node expected average-square constraint .
Likelihood-ratio network coding for finite or Euclidean multicast networks: square-integrable local and packing log likelihoods, finite cut informations and finite-second-moment slack input costs imply the NNC cut inner bound in nats, with deterministic measurable encoders, pointwise input-word cost bounds, constant reconstructions, and closure.
Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional-KL chain rules and nonnegativity apply to these finite Gaussian informations; adding observations cannot decrease mutual information.
Proof
Initially choose when , and set when . On positive-power nodes take independent . Use the stated reconstruction kernels. Remove constant coordinates when writing densities. The remaining joint coordinates are an invertible linear image of the independent nonconstant inputs, channel noises and quantization noises: recover inputs first, channel noises from , and quantization noises from . They therefore have a strictly positive nonsingular Gaussian density. Its needed marginal and conditional densities are likewise Gaussian with positive conditional covariance, so all local and reference likelihood ratios in [F2] exist measurably. Every log ratio is a constant plus a quadratic polynomial in Gaussian variables.
These log ratios are square-integrable: a quadratic polynomial squared is a finite sum of monomials of degree at most four, and Gaussian fourth moments are finite. Explicitly for a scalar density, integrating by parts twice gives ; Gaussian coordinates have those scalar marginal laws, and . The input cost also has finite second moment and mean . All the Gaussian cut mutual informations are finite, as differences of finite Gaussian conditional log-density expectations. Thus every Euclidean hypothesis of [F2] holds at the positive-power nodes with slack square costs; zero-power inputs are fixed zero coordinates satisfying their constraints pointwise and need no shell constraint.
Apply [F2] with constant time-sharing variable, converting . It gives precisely the first displayed strict cut inequalities at variances , since constant reconstructions may be deleted from both mutual informations. Its codes are deterministic and measurable, and every positive-power input word has empirical square cost at most a threshold strictly below . Hence the expected average-power constraints in [F1] hold for the chosen deterministic code, independently of messages and selected compression indices. Zero-power nodes always send zero.
Increase to simultaneously at positive-power nodes. Each mutual information in these finitely many cuts is a continuous function of the variances: its Gaussian entropy formula is a log determinant of a positive-definite conditional noise covariance plus a positive-semidefinite signal covariance. One may derive the formula directly from the Gaussian density: for positive-definite , integration of its log density gives because the expected quadratic form is . Conditional noise covariance is positive definite even at the limiting input variances. Therefore any tuple satisfying all strict inequalities at satisfies them at sufficiently close to . Use the codes from step 3.1, already satisfying the original power constraints. This proves the full chosen- achievability assertion, including arbitrary zero-power nodes.
For the target Gaussian law, conditioned on all inputs the noises at nodes in are independent of , since and channel and quantization noises are independent across nodes. Each active source-side test channel adds independent unit quantization noise to unit channel noise. Using the density entropy formula from step 4.1 gives Constants contribute zero. This calculation holds for every destination outside and all choices of powers.
When and all powers equal , condition on . The quantized vector is a known translation of plus an independent Gaussian vector of covariance . Its entropy minus the entropy of that noise, divided by , gives By [F3], adding can only increase this positive mutual-information term. Subtracting the penalty from step 5.1 proves the sufficient determinant inequality for every destination outside every admissible cut. Step 4.1 makes all tuples satisfying this finite family of strict sufficient inequalities achievable.
The closure of the strict regions follows from [F2], or by selecting successively longer reliable codes for rate tuples tending to the claimed boundary points. For the all-zero tuple give every source a singleton message set, transmit zero at all nodes, and return the unique messages at every destination; error and power are both zero. This argument applies even if a sufficient cut expression is negative.
Finite directed information and causal conditioning
Definition
For finite random sequences and , define the directed information from to by where and is the empty tuple. For a third finite sequence , define the causally conditioned version All conditional mutual information terms use the finite nats convention of Finite conditional mutual information. The conditioning includes because it is the current side-information symbol available at the receiving end of the directed-information term; and are the past.
Conditional random-codebook covering for finite alphabets
Statement
Let have a joint law on finite alphabets. Fix . There are tolerances such that, for every sufficiently large , every in the support-restricted strongly typical set , and every , a codebook of conditionally independent words drawn from contains a word making with probability tending to one uniformly over those fixed pairs.
Facts & Assumptions
Given: A finite law and .
Finite strongly typical sets with support restriction: a block is strongly typical when each positive-mass joint letter has empirical frequency within a relative tolerance of its probability and zero-mass letters are absent.
Finite conditional mutual information: is the finite average, over , of in nats.
Proof
Fix . For this concentration calculation, draw an auxiliary word under , rather than under the codebook law . For each positive-mass triple , its empirical frequency under has mean , which differs from by at most . Its variance is at most because its indicator summands are independent across positions. Chebyshev's inequality with deviation threshold and a finite union bound show that all positive-mass triple frequencies meet the conditions with probability tending to one uniformly over the fixed input pairs. Zero-mass input pairs are absent and zero conditional-probability outputs are never generated.
For a triple word in , the exact likelihood ratio is Every logarithm on the positive target support is finite. At the target law this finite sum is by [F2]; it is linear in the empirical probabilities. Choose small enough that it is at most on every target-typical triple. On the target-typical set , and . Therefore ; step 1.1 gives a one-word match probability at least , uniformly over the fixed input pairs.
The codewords are conditionally independent given . If is their one-word match probability and , then the probability that no word matches is . Since , step 2.1 gives uniformly, so the no-match probability tends to zero. This proves the covering claim.
Conditional joint-typicality packing bound for finite alphabets
Statement
Let have any joint law on finite alphabets. Fix . For every sufficiently small strong-typicality tolerance, every sufficiently large , and every fixed typical for the marginal , an independent candidate word drawn from the product law satisfies The conclusion includes the case that is constant, giving the exponent .
Facts & Assumptions
Given: A finite joint law , , and fixed typical .
Finite strongly typical sets with support restriction: typicality restricts empirical distributions to a finite-alphabet neighborhood of the target law and excludes unsupported atoms.
Finite conditional mutual information: is the finite conditional-KL average in nats.
Proof
For any jointly typical supported candidate , The logarithms are finite on the positive target support. At the finite sum equals by [F2], and it is linear in the empirical probabilities. Choose the typicality tolerance small enough that every jointly typical triple has this sum at most .
Sum the likelihood-ratio expression of step 1.1 over the jointly typical candidates. The target conditional law is a probability vector, so its mass on that set is at most one; the exponential likelihood ratio is at most . This gives the claimed bound. Joint typicality excludes unsupported triples; on each supported target triple both conditional probabilities in the ratio are positive.
Power bound for real and complex scalar Gaussian channels
Statement
Assume AC. Let be real or complex with finite second moment, let be independent unit-variance Gaussian noise, and let . In the real case take and ; in the complex case take with density and . Put and in the real case, in the complex case. Then in nats; division by gives the corresponding bit formula. Equality in the first inequality holds when is Gaussian in the real case or circular complex Gaussian in the complex case, including the zero-variance case.
Facts & Assumptions
Given: AC, an input law with finite second moment, independent unit-variance Gaussian noise of the stated type, and the scalar channel .
The Axiom of Choice: AC is inherited from the real and complex Gaussian entropy bounds and the measure-theoretic information definition.
Measure-theoretic mutual information: is the KL divergence from the joint law to the product of its marginals.
Differential entropy for real densities: when has a density with absolutely integrable , .
Bounded densities with finite second moments have finite differential entropy: a bounded density with finite second moment has absolutely integrable .
Proof
The output density is the convolution , so , and has finite second moment. By [F5], , so [F2] defines a finite differential entropy .
The positive Gaussian noise density makes . Relative to , the joint law of has density . By [F1], The two logarithmic integrals are finite by step 1.1 and the Gaussian density formula, so this identity involves no subtraction of infinite quantities.
Independence gives . Apply [F3] and the real Gaussian noise entropy in the real case, or [F4] and in the complex case. Step 2.1 then yields nats. Since , division by gives the corresponding bit bound. For the stated Gaussian inputs, the output is Gaussian of the same real or circular complex type and attains the matching maximum-entropy equality.
Gaussian Han-Kobayashi inner region for a fixed private-power split
Statement
For either Gaussian model in Real and complex two-user Gaussian interference channels, choose private powers and common powers . Split each message into independent common and private parts, and transmit with independent centered Gaussian codewords of powers and (circular in the complex model). At receiver 1, decode and treat as Gaussian noise of variance . At receiver 2, decode and treat as noise of variance . A nonnegative rate split is achievable if, at each receiver , every nonempty subset of its three decoded streams with positive total rate satisfies where , , , and ; for real and for complex channels. A zero-rate stream has a singleton message set and creates no false-message class; the all-zero split is always achievable. The closure of the union over feasible rate splits is an inner region.
Facts & Assumptions
Given: The Gaussian channel in [F1], a fixed pair of private powers, and a nonnegative rate split satisfying the strict inequalities for every nonempty decoded-stream subset with positive total rate.
The Axiom of Choice: AC is inherited through the nondegenerate Gaussian-law construction.
Real and complex two-user Gaussian interference channels: the two receivers observe the stated linear combinations with independent unit-variance Gaussian noises and satisfy the stated power constraints.
IID finite-variance weak law: every IID finite-variance information-density summand obeys the weak law.
Power bound for real and complex scalar Gaussian channels: the scalar additive Gaussian channel mutual information equals its Gaussian variance formula for the centered Gaussian input specified here.
Proof
Generate independent message-indexed Gaussian codebooks for , with each coordinate law matching its assigned power. The two components at transmitter sum to a Gaussian input of power ; when one component has zero power, set its rate to zero and omit it. The private component of user 2 contributes independent Gaussian noise at receiver 1, and the private component of user 1 contributes independent Gaussian noise at receiver 2, with the variances stated above.
At receiver , let be its three decoded streams. For every nonempty , define the information density where is the Gaussian output density with the other user's private stream included in its noise variance . Decode the positive-rate streams by threshold tests for every subset with positive total rate. A zero-rate stream has a singleton message set, so it creates no competing codeword. Choose thresholds between times each subset rate and its mutual information in nats. For each tested true subset, the information density is a sum of IID quadratic functions of Gaussian variables with finite variance, so [F2] makes the tests pass with probability tending to one. Condition on the complementary decoded streams and rescale the output by ; [F3] and its Gaussian equality case give the stated subset mutual information in nats.
For either receiver and any nonempty subset of incorrectly decoded streams, has positive total rate; its false codewords are independent of the output and the correctly decoded streams. The likelihood ratio for that subset has mean one under this false-candidate law, so Markov's inequality bounds the chance of passing a threshold by . There are at most false tuples. The union bound over the tested subsets tends to zero because each threshold exceeds the corresponding rate sum in nats.
The ensemble error argument alone does not yet impose deterministic codebook powers. For fixed , instead generate each positive component at power . The finitely many strict positive-rate subset inequalities remain valid for sufficiently small , by continuity; zero-power components have zero rate and are omitted. For user , let be the coordinate- input energy , averaged over all of its common/private message indices, including the cross term. These variables are IID across coordinates, have mean , and satisfy by Jensen and the real Gaussian fourth moment; in the circular complex case the sharper constant is . Thus the codebook's expected average input power has variance at most . Chebyshev shows that the probability of either user's power exceeding its unscaled constraint tends to zero, while Markov applied to the ensemble sum of receiver errors shows that the probability of an error exceeding the square root of that ensemble mean tends to zero. Consequently some deterministic codebook simultaneously meets both power constraints and has vanishing receiver errors. If , its codeword is identically zero and no concentration is needed. Taking achievable closures and then recovers the stated component powers and all boundary split rates by continuity. Singleton streams create no competing codewords; if every rate is zero, use the all-zero code and obtain zero error. This proves the full real and complex fixed-split region without changing the statement.
Random coding achieves the finite-dimensional Gaussian multiple-access region
Statement
At either receiver of the Gaussian channel in Real and complex two-user Gaussian interference channels, independent Gaussian codebooks with powers achieve every nonnegative rate pair for which each nonempty subset with satisfies where that receiver observes with unit-variance real or complex Gaussian noise and or , respectively. The codebook symbols are centered in the real model and circular in the complex model. A subset of zero total rate has no false-message candidates and requires no strict inequality; in particular the zero pair is achieved by singleton message sets. The closure of this achievable set is the usual closed Gaussian multiple-access region.
Facts & Assumptions
Given: The Gaussian channel in [F1], independent Gaussian input laws, and a nonnegative rate pair satisfying the strict inequality for every nonempty subset with positive total rate.
Real and complex two-user Gaussian interference channels: the noise is independent standard real Gaussian or unit circular complex Gaussian, with the displayed power convention.
The Axiom of Choice: AC is assumed by the Gaussian-law and scalar-channel information suppliers.
IID finite-variance weak law: IID square-integrable real random variables obey the weak law, with deviation probability bounded by variance divided by sample size and squared tolerance.
Power bound for real and complex scalar Gaussian channels: the mutual information of a scalar additive Gaussian channel is bounded by its variance formula, with equality for the centered Gaussian input specified here.
Proof
Use the stated full powers in the codebook laws and information densities. Generate codewords independently for each sender, with IID coordinates from its specified centered real or circular complex Gaussian input law. For a nonempty subset , define its one-use information density by where is the Gaussian channel output density and the denominator averages over the Gaussian input laws of the senders in . Use the sum of these densities over coordinates as the threshold statistic. For each with , choose so that , where is in nats. A subset with has no false-message candidates and needs no threshold. For each tested subset the true statistic is a sum of IID quadratic polynomials in Gaussian variables with finite variance; [F2] makes its threshold test pass with probability tending to one.
If a nonempty subset of positive total rate is wrong, its independently generated candidate codewords are independent of the output conditional on the correct codewords in . By the definition in step 1.1, the exponential of the threshold statistic is the likelihood ratio of the true conditional output density to the density averaged over the candidate input law; its expectation under the false-candidate law is one. The nonnegative likelihood ratio and Markov's inequality therefore bound acceptance by . Subsets of zero total rate cannot be wrong because all their message sets are singletons.
For each tested subset , the number of false candidates is at most , so the union bound gives ensemble-average error . For , write and ; the power constraint is . Gaussian moments and independence give , , and : in the real case the ratio is , and in the complex case it is . Hölder gives , hence . Since , Cauchy–Schwarz gives . If , its codebook is identically zero. The two independently generated codebooks therefore meet both power constraints with probability at least . Markov bounds the probability of error exceeding by ; for large this is less than , so there exists a deterministic power-feasible codebook with error at most (if , error is zero almost surely). For any fixed finite list of receivers satisfying their subset inequalities, apply steps 1.1–2.1 at each receiver to this same input ensemble and replace by the sum of their average errors; the identical selection then makes every receiver's error vanish.
For each nonempty subset , condition on the other codewords. The remaining signal is a centered real or circular complex Gaussian with variance . Its mutual information with the unit-noise output is exactly nats by [F3] and its Gaussian equality case. Dividing by gives the rates in bits. Step 3.1 selects deterministic codes from exactly the full-variance ensemble stated above, establishing the strict region under the allowed powers. If both rates are zero, singleton message sets achieve zero error. Taking closure gives the stated closed MAC region, including faces where a zero-rate subset has zero mutual information.
Decode-forward inner bound for a finite relay channel
Statement
For a finite relay channel with relay-only causality, fix a finite law . Every positive rate is achievable, and rate is always achievable with a one-message code. Taking the closure of the union over such laws gives the decode-forward inner bound. Mutual informations use the relay channel law and nats per use.
Facts & Assumptions
Given: A finite relay channel, a law , and either a positive rate strictly below both displayed mutual informations or the zero-rate case.
Finite discrete memoryless relay channel and causal code: the relay observes and its input at time may depend on .
Joint strong typicality for a finite IID source: IID blocks are strongly typical with probability tending to one.
Conditional joint-typicality packing bound for finite alphabets: a wrong independent codeword passes the relevant conditional joint-typicality test with exponent given by the corresponding mutual information.
Proof
Choose so that is below both mutual informations. For every block , independently generate a relay codebook with , each word IID from . Given each relay word, generate source words independently according to . Set as fixed dummy indices and use for the messages. In block , the source sends and the relay sends . This is causal under [F1].
At the end of block , the relay tests candidate using and accepts the unique jointly typical candidate. The true triple has the IID law , so [F2] makes its test pass with probability tending to one. For a wrong candidate, its source word is conditionally independent of the relay observation given the known relay word; [F3] bounds a false test by . There are at most false indices, so the union bound tends to zero because .
The destination decodes backward over blocks . It knows from the next block (or as the fixed dummy ), and tests each candidate against the block- source and relay codewords and . The true tuple is IID with law and passes by [F2]. For a wrong candidate, the pair of candidate codewords is independent of the output generated by the true pair; [F3] bounds a false test by . The union bound over at most wrong indices tends to zero because .
For positive there are message blocks and channel blocks, so the rate tends to as . For fixed , the ensemble-average error tends to zero by steps 2.1, 2.2; then letting approaches . The strict slack permits the typicality tolerances to shrink with , and closure gives the positive-rate part.
At , use a singleton message set and let the destination always return its sole element; the error probability is zero for every blocklength. Thus the zero-rate case is included even if one of the mutual informations vanishes.
Conditional mutual information is concave in the channel input law
Statement
Let be finite random variables and suppose the channel law depends on only through ; equivalently, is a Markov chain. Then Thus, for a fixed finite channel and fixed side information , averaging input laws over a time-sharing variable cannot increase the average conditional mutual information.
Facts & Assumptions
Given: The finite variables and Markov condition in the statement.
Finite conditional mutual information: conditional mutual information is defined by the finite conditional-KL sum.
Finite entropy and mutual-information chain rules: finite entropy and mutual information obey the chain rules used to expand the joint conditional mutual information.
Finite conditional mutual information identities and equality: conditional mutual information is nonnegative.
Proof
By the chain rule in [F2], since the Markov assumption makes the last term zero.
Expanding in the other order gives The first term on the right is nonnegative by [F3], proving the inequality.
Mutual information splits into directed information and feedback
Statement
For finite sequences , with directed information as in Finite directed information and causal conditioning, where and the term is zero.
Facts & Assumptions
Given: A joint law of finite sequences .
Finite entropy and mutual-information chain rules: finite entropy and mutual information obey the chain rules used to expand the sequence variables.
Proof
Expand by the chain rule in the order to obtain . For each , split and apply the chain rule again: Summing the first terms gives by [F1].
Write and each term of as . The interleaved chain rule gives Subtracting the directed-information terms therefore yields The finite chain rule expands , so the right-hand side is by symmetry of finite mutual information. This is the stated feedback term, including its zero summand.
Strong-interference information inequalities tensorize over product code inputs
Statement
Assume the strong-interference inequalities of Finite two-user interference channel and strong-interference regime. For independent random vectors , pass each coordinate through independent uses of the channel. Then
Facts & Assumptions
Given: The finite interference channel in [F1], product-over-time channel uses, and independent input vectors .
Finite two-user interference channel and strong-interference regime: for each fixed input of one user and every law of the other, the corresponding single-letter output channel has the indicated mutual-information ordering.
Finite conditional mutual information identities and equality: conditional mutual information is nonnegative.
Finite entropy and mutual-information chain rules: finite mutual information obeys the chain rule used in the telescoping sum.
Proof
First fix . Under this conditioning, and are product channels from , with the th channel determined by . Set , , and for . The chain rule [F3] gives Because the channel is memoryless across coordinates, each term reduces to the mutual information between and that coordinate's output conditional on the common context . For each value of this context, [F1] applies to the induced law of and fixed , so . Summing over yields . Average over .
Exchange the user indices and exchange . The second strong-interference inequality in [F1] gives the same telescoping argument with receiver 1 as the more informative output for user 2. Averaging over gives .
Noisy network coding inner bound for finite multicast networks
Statement
Consider a finite DMN as in Finite discrete memoryless networks and causal codes. Let be a source-node set, let be a destination-node set, and let each source send an independent message of rate to every destination. For a finite time-sharing variable , choose For every destination and every nonempty cut set with and , the noisy-network-coding inner bound is The closure of the union of these rate tuples, together with the all-zero rate tuple, is achievable; the separate zero tuple is attained by singleton message sets even if some cut expression is negative. A constant reconstruction is permitted at any node.
Facts & Assumptions
Given: The finite DMN, independent source messages, finite , product inputs conditional on , and finite local reconstruction kernels in the statement.
Finite discrete memoryless networks and causal codes: nodes use causal encoders; destinations know their own messages; achievability uses average error over all required estimates.
Likelihood-ratio network coding for finite or Euclidean multicast networks: for finite alphabets the square-integrable local and packing likelihood hypotheses give precisely the displayed cut inner region, with finite coded time sharing, constant reconstructions, closure, and a separate singleton-message zero tuple; its finite assertion uses no choice axiom.
Finite conditional mutual information: finite conditional mutual information is the finite conditional-KL average, with the same logarithm convention for rates and informations.
Proof
For each positive-probability value of , use the target law in the statement. Its alphabets are finite. A target-positive joint atom has positive local marginal-reconstruction probability and positive reference probability for every reference law in [F2], because all its displayed marginal factors are positive. Thus every required likelihood ratio is finite on target support; the finitely many log values are bounded and hence square-integrable. All cut informations are finite. No cost constraint is imposed. These observations verify every hypothesis of the finite branch of [F2], including arbitrary zero-probability letters, which can simply be omitted.
Apply [F2] with this law and source/destination sets. Its independent messages, causal encoders and destination side information have exactly the conventions of [F1]. Its cut expression is for every required , so every tuple satisfying the displayed strict inequalities is achievable. A constant reconstruction is allowed in [F2] and contributes zero local and conditional information.
The closure-of-union conclusion follows from [F2], or by choosing a sequence of strict-region laws and rate tuples tending to the claimed point and selecting successively longer codes with error tending to zero and rates tending to that point. Independently, singleton message sets at every source and a destination that returns those unique messages have error exactly zero; this realizes the separate zero tuple even when a cut expression is negative.
Compress-forward and noisy-network-coding bounds for a finite relay channel
Statement
For a finite relay channel, choose . Every positive noisy-network-coding rate is achievable by the finite multicast NNC theorem in [F1]; rate is always achievable by a one-message code. In particular, if then every positive compress-forward rate is included, along with the zero rate.
Facts & Assumptions
Given: The finite relay model in [F2], the product input and test-channel law above, and the NNC inner-bound statement [F1].
Noisy network coding inner bound for finite multicast networks: for the one-source, one-destination three-node network, its cut gives the first mutual-information term, and cut gives the second term.
Finite discrete memoryless relay channel and causal code: the one-way relay network has source, relay, destination and causal relay input.
Finite conditional mutual information, Finite conditional mutual information identities and equality, and Finite entropy and mutual-information chain rules: the finite conditional-KL definition, nonnegativity identity, and entropy/mutual-information chain rules apply.
Proof
Substitute and into [F1]. The first cut has no source-side reconstruction penalty because the source reconstruction can be constant; the second cut has only the relay penalty . These substitutions give the displayed NNC minimum.
The test-channel Markov relation conditional on gives Indeed, expand in both orders; the term is zero by the test-channel factorization.
Subtract the first NNC term from the second and use [F3]: Thus the stated compress-forward condition makes the second term at least the first. Thus [F1] proves the asserted positive-rate achievability.
At , choose a singleton message set at the source and let the destination return its sole message. This achieves zero error without needing either strict mutual-information inequality.
Noisy-network-coding inner region for the finite two-way relay channel
Statement
For the finite two-way relay channel in Finite two-way relay channel and causal code, choose independent inputs and a relay test channel . The following rates are achievable by the finite multicast NNC theorem [F1]: The closure of the union over such laws, together with the zero-rate pair, is an inner region, not asserted to be capacity. The zero pair is attained by singleton message sets at both terminals.
Facts & Assumptions
Given: The finite two-way relay model, independent terminal messages, and the input and relay test-channel laws above.
Noisy network coding inner bound for finite multicast networks: for each destination, every cut separating that destination from its required message sources gives the corresponding NNC rate inequality.
Finite two-way relay channel and causal code: terminal 1 wants terminal 2's message and terminal 2 wants terminal 1's message; all inputs depend only on local messages and past local outputs.
Finite conditional mutual information, Finite conditional mutual information identities and equality, and Finite entropy and mutual-information chain rules: the finite conditional-KL definition, nonnegativity identity, and entropy/mutual-information chain rules apply.
Proof
For destination 2 and message source 1, the cut containing only node 1 yields ; the cut containing nodes 1 and yields . The other node's observation reconstruction may be constant. These are the two bounds on .
For destination 1 and message source 2, the two cuts are respectively node 2 alone and nodes 2 with the relay. Substitution into [F1] yields the displayed two bounds on . Both destinations can use their own message as side information, as in [F2].
Taking the intersection of the two destination constraints and then closure over rates yields the stated inner region; the finite mutual-information quantities use the chain-rule and conditional-law conventions of [F3]. The simultaneous multicast code supplied by [F1] serves both destinations, with each terminal using its own message as side information.
If , both terminals use singleton message sets and return their unique required messages, so the error probability is zero. This includes the zero-rate pair even if a displayed right-hand side is negative.
Conditional mutual-information chain rule and data processing for standard-Borel variables
Statement
Assume AC. Let take values in standard-Borel spaces. Then and also where these are equalities of extended nonnegative quantities. In particular, if the conditional law of given depends only on , then
Facts & Assumptions
Given: AC and standard-Borel variables with a joint law.
The Axiom of Choice: AC is required by the standard-Borel conditional-law and KL-chain-rule suppliers.
Standard Borel spaces and Finite products of standard Borel spaces are standard Borel: the finite product variables and their conditional laws remain standard Borel.
Mutual-information chain rule without subtracting infinities: for standard-Borel variables, as an equality in .
Conditional mutual information by a same-marginal product law: conditional mutual information is the KL divergence from the same-marginal conditionally independent product law; it vanishes when that law is the actual joint law.
KL chain rule for standard-Borel disintegrations: with a common conditioning marginal, joint KL is the integral of the conditional KLs.
Kullback–Leibler divergence is nonnegative: every KL divergence in the statement is nonnegative.
KL is invariant under a measurable bijection: permuting coordinates preserves KL, hence conditional mutual information is symmetric in its two unconditioned variables.
Proof
For -almost every , apply [F2] to the conditional law of given . It gives Integrate over ; by the conditional-KL definition [F3] and disintegration chain rule [F4], the three integrals are the corresponding conditional mutual informations given . This proves the first identity without subtracting extended values.
Exchange the roles of and in step 1.1 to obtain the second identity. The symmetry of conditional mutual information between the grouped variables follows from [F6].
Suppose the conditional law of given depends only on . Then and are conditionally independent given , so [F3] gives . The two chain-rule identities in steps 1.1 and 2.1 now give . Since by [F5], the claimed inequality follows.
Mutual information tensorizes over a memoryless vector channel
Statement
Assume AC. Let and take values in standard-Borel spaces. Let their joint law have an arbitrary input marginal and the memoryless conditional channel law where each is a probability kernel. No independence across the input coordinates is assumed. Then, as an inequality in ,
Facts & Assumptions
Given: AC, standard-Borel coordinate spaces, an arbitrary joint input law, and the displayed product conditional channel law.
The Axiom of Choice: AC is the choice axiom required by the standard-Borel conditional-law and mutual-information chain-rule suppliers.
Standard Borel spaces and Finite products of standard Borel spaces are standard Borel: each coordinate space and each finite product used below is standard Borel.
Mutual-information chain rule without subtracting infinities: for standard-Borel random elements, as an equality of extended nonnegative quantities.
Conditional mutual information by a same-marginal product law: conditional mutual information is the KL divergence from the same-marginal conditionally independent product law; it is zero when the conditional joint law equals that product law.
Kullback–Leibler divergence is nonnegative: mutual information and conditional mutual information, being KL divergences, are nonnegative.
KL is invariant under a measurable bijection: a measurable coordinate permutation preserves KL divergence, so mutual information and conditional mutual information are symmetric in their two unconditioned variables.
KL chain rule for standard-Borel disintegrations: when two laws have the same conditioning marginal, their joint KL is the integral of the conditional KLs.
Proof
By [F2], successively adjoining to gives The first equality and the last equality use the coordinate swap in [F5]; the initial term for the empty tuple is zero. Every term is an extended nonnegative quantity, so no subtraction of infinities is involved.
Fix and put , , and . For -almost every , the conditional channel law makes independent of given . Apply [F2] to the conditional law of given and use [F3]: Integrating this identity over gives by [F6] and the conditional-KL definition [F3].
The product channel law gives by [F3]. Expanding with [F2] first in the order gives . Expanding in the reverse order and using the coordinate-swap invariance [F5] gives Because the omitted term is zero and by [F4], this proves in the extended nonnegative order.
Sum the coordinate inequalities from step 1.3 and use the chain-rule expansion in step 1.1 together with step 1.2. This gives for arbitrary dependent input coordinates.
Genie-aided outer bounds for the two-user Gaussian interference channel
Statement
For the complex Gaussian channel in Real and complex two-user Gaussian interference channels, the following are outer bounds in the listed regimes; all logarithms are base two. Write SNR and INR as defined there.
Weak regime: If and , every achievable pair satisfies
Mixed regime: If and , every achievable pair satisfies the two individual bounds above and The other mixed regime is obtained by interchanging user indices 1 and 2.
Facts & Assumptions
Given: A complex Gaussian interference code with independent messages and the SNR/INR convention below; logarithms and entropies in the proof are base two.
The Axiom of Choice: AC is inherited through the Gaussian-law and information suppliers.
Real and complex two-user Gaussian interference channels: the channel has independent unit circular Gaussian receiver noises and the stated average powers.
Fano bound for finite messages and density observations: a vanishing-error decoder gives a message-entropy bound by mutual information plus .
Mutual information tensorizes over a memoryless vector channel: vector mutual information on a memoryless channel is bounded by the sum of its coordinate values.
Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional chain rules and data processing identify deterministic-message and codeword information and allow revealing side information.
Power bound for real and complex scalar Gaussian channels: the scalar Gaussian information power bound and its equality case.
Entropy estimates for complex Gaussian interference converses: the entropy-difference bound and every unconditioned and genie-conditioned output entropy estimate used below, with only average power assumptions.
Proof
Write , , , . Give to receiver 1 and subtract its deterministic codeword. Fano, conditional data processing in both directions, and tensorization give . The scalar Gaussian power bound followed by Jensen and the average input constraint gives . Reflection gives . The same argument applies when a direct gain vanishes and then forces the corresponding rate to zero. Throughout the proof independent messages give independent user input vectors, regardless of coordinate dependence inside a vector; the additive Fano remainders disappear on division by and passage to the coding limit.
Reveal to receiver 1. The chain rule and independent inputs give the following exact expansion of the two augmented mutual informations: . If , the input vector is zero and this entropy difference and the claimed logarithmic ratio are both zero. Otherwise, if , the entropy-difference estimate [F6] applies with , , ; phases are removed by unit-modulus rotations. This is precisely the coupling condition : the lower-SNR observation can be formed by scaling the higher-SNR observation and adding circular Gaussian noise of variance . The proof of [F6] covers zero gains without division by a cross gain. Its unconditioned-output bound therefore yields . Only is needed. Reflecting the argument gives the second weak sum bound under , using the reflected noise coupling.
Define and using independent receiver noises. Give to receiver 1 and to receiver 2. Expanding both augmented informations gives : the positive and cancel the interference-plus-noise entropies of the two conditional channels. Applying the two conditional-output estimates in [F6] and proves the third displayed weak sum bound. This calculation is valid in every regime and requires no degradation inequality.
Add two copies of receiver 1's Fano bound and one of receiver 2's. Augment receiver 2 by and one receiver 1 copy by . The resulting information sum equals . Indeed the three information terms contribute, respectively, , , and . The unconditioned, conditional, and entropy-difference estimates of [F6] give . The only degradation hypothesis is , exactly as in step 2.1. Reflection proves the displayed bound under . Thus the stated weak regime supplies every required coupling.
In the mixed regime and , the individual bounds and first sum bound still follow from steps 1.1 and 2.1. For the MAC sum bound, receiver 1 first decodes . On the event of correct decoding it subtracts and obtains . If , step 1.1 gives and the required MAC sum bound already follows from the individual bound. Otherwise, if , scale by and add independent circular Gaussian noise of variance , which is nonnegative because and . Add the known vector and apply receiver 2's decoder. Coupling this simulation to the one using the true bounds its joint-message error by the sum of the two original errors; a deterministic MAP decoder has no larger average error. Joint-message Fano and the unconditioned-output estimate [F6] give . If , then and step 1.1 forces , so the same sum bound follows immediately. This establishes the exact mixed sum claim, including degenerate gains.
For the mixed weighted bound add the three Fano information terms , , and . The first expands as , the second as , and the third as . Their sum is . Apply the three corresponding bounds in [F6] to obtain exactly . This particular weighted estimate is universal and uses no degradation condition. Reflection gives the other mixed regime. Combining the preceding steps proves every displayed inequality with precisely the hypotheses asserted in the statement.
Cut-set outer bound for causal and full-feedback relay channels
Statement
For either causal model in Finite discrete memoryless relay channel and causal code, every achievable rate is in the closed convex hull of rate values satisfying, for some finite time-sharing variable and law , with the relay transition law used to evaluate the mutual informations. In particular, this is an outer bound; it need not be achievable for relay-only causality.
Facts & Assumptions
Given: A length- causal relay code with uniform message , error probability , and the memoryless relay law of Finite discrete memoryless relay channel and causal code.
Finite discrete memoryless relay channel and causal code: at each time the output pair is drawn from ; current inputs are functions of the message and past outputs only.
Finite-alphabet Fano inequality: for every finite nonempty message set; for the conditional entropy is zero.
Finite conditional mutual information identities and equality: conditional mutual information is nonnegative.
Finite entropy and mutual-information chain rules: finite entropy and mutual information obey the chain rules used to expand the time-indexed terms.
Conditional mutual information is concave in the channel input law: for a fixed channel , averaging over an input time-sharing variable gives .
Proof
Fano's inequality gives . Apply the chain rule to write .
Since conditional mutual information is nonnegative, each summand is at most . Given , the current inputs are fixed by causality in either model, and [F1] makes the current output depend on those variables only through . Thus the summand equals . For the fixed channel , the past is a time-sharing variable independent of the current output once the current inputs are fixed. Applying [F5] gives .
For the second cut, . The relay input is determined by the past. Given the past and , the source input is determined; memorylessness therefore reduces each term to . Conditional on a fixed , the past is a time-sharing variable for the fixed channel . Applying [F5] and averaging over bounds the term by .
Let be uniform on and conditionally draw according to the time- joint law induced by the code and channel. Steps 2.1, 2.2 imply both cut inequalities with conditioning on . Dividing the Fano bound by , then taking a sequence of codes with , gives the stated outer bound after closure and convexification.
Cut-dependent Gaussian multicast gap to the cut-set bound
Statement
For the real Gaussian multicast network in Real scalar Gaussian multicast relay network and power constraints with common node power , compare the noisy-network-coding inner cut in [F1] with the cut-set outer region. For each admissible cut , the outer cut is at most Consequently the outer and inner cut bounds differ by at most bits per use on that cut. This is a cutwise comparison; it does not assert a single cut-independent gap constant.
Facts & Assumptions
Given: A length- causal Gaussian multicast code in [F2] with error , block rates , all node powers at most , and a cut with and .
The Axiom of Choice: AC is inherited through the Gaussian maximum-entropy and Gaussian-law suppliers.
Noise-level noisy-network-coding inner bound for real Gaussian multicast networks: the exact NNC expression for destination is With , , and unit-variance quantization noise, its first term is at least , while the penalty is . Hence . The NNC theorem also separately achieves the all-zero tuple.
Real scalar Gaussian multicast relay network and power constraints: causal encoders use each node's own message and past output; outputs across the cut have form with identity noise covariance.
Gaussian maximizes differential entropy at fixed positive-definite covariance: a vector with positive-definite covariance has differential entropy at most .
Fano bound for finite messages and density observations: a finite message tuple estimated from a density observation and finite side information with error at most satisfies ; for a singleton message its conditional entropy is zero.
Real spectral theorem: a self-adjoint endomorphism of a finite-dimensional real inner product space has an orthonormal eigenbasis: real symmetric matrices have real eigenvalues and an orthonormal eigenbasis; a positive-definite matrix has positive eigenvalues and a positive-definite square root.
Conditional mutual-information chain rule and data processing for standard-Borel variables: the conditional mutual-information chain rule expands the length- observation, and conditional data processing bounds each current observation by its current inputs.
Bounded densities with finite second moments have finite differential entropy: a bounded density with finite second moment has a finite, absolutely defined differential entropy.
Proof
Fix a destination . Give the messages of nodes in to that destination, and also give it all outputs . The revealed messages are independent of the source messages in , and the original decoder is still available. Since rates are bits and Fano's bound is in nats, [F4] gives the exact finite-code bound By the conditional chain rule [F6], expand the mutual information across time. For time , condition on . Each input in is then fixed by causality in [F2]. The current outputs depend on messages in only through the current inputs , so conditional data processing [F6] gives The right side is the mutual information of under the conditional input law given .
For almost every , the conditional input second moment given is finite, since its average is bounded by the node power constraints. The conditional output is a translate of a Gaussian convolution, so its density is bounded by the standard Gaussian noise peak; [F7] makes its differential entropy finite. Let be the conditional covariance of given . The channel noise is independent with covariance , so [F3] bounds each conditional mutual information in step 1.1, measured in nats, by Set . Since covariance trace is at most the corresponding second moment and each node's average power is at most , and .
For positive-definite matrices , let . Its eigenvalues are positive by [F5], and because has derivative , decreases on , increases on , and vanishes at . Thus Apply this with and , then average over ; the trace term averages to zero. Hence the average natural log determinant in step 2.1 is at most . The spectral theorem gives , since every nonnegative eigenvalue is at most their sum; hence . If , then for some , so its eigenvalues are at least one and . Applying this order property and dividing the Fano bound in step 1.1 by yields Along a sequence of reliable codes , this finite bound first bounds the cut rate sums, and then passage to their achievable lower limits gives No a priori bounded-rate hypothesis is needed.
Put and ; both are positive. For any positive-semidefinite of size , , so determinant monotonicity gives The block determinant of , computed by taking either identity block as the Schur complement pivot, gives . Apply the previous inequality once in dimension and once in dimension , then use this identity to take the smaller additive term. The cut-set outer bound is at most
Write , so the sufficient lower bound in [F1] is . Step 4.1 gives the cut-set outer value . If , the exact NNC expression satisfies , so . If , use the separately achievable zero-rate tuple from [F1]; then , so the outer cut is within of that achievable rate. This proves the cutwise comparison without treating the determinant expression as the exact NNC rate and covers negative sufficient-cut values.
Exact strong-interference region for the two-user Gaussian interference channel
Statement
For the real or complex Gaussian interference channel of Real and complex two-user Gaussian interference channels, assume the strong regime Then the capacity region is the set of nonnegative rate pairs satisfying where for real and for complex channels.
Facts & Assumptions
Given: A length- interference code with independent messages, the channel and power constraints of [F1], and the two gain inequalities in the statement.
The Axiom of Choice: AC is inherited through the Gaussian random-coding and scalar-channel information suppliers.
Real and complex two-user Gaussian interference channels: noises are independent unit-variance real or circular complex Gaussian; the input power constraints and SNR/INR conventions are as displayed there.
Random coding achieves the finite-dimensional Gaussian multiple-access region: independent Gaussian codebooks achieve both receivers' multiple-access regions.
Fano bound for finite messages and density observations: a finite message estimated from a density observation with error has conditional entropy at most .
Mutual information tensorizes over a memoryless vector channel: for a memoryless channel and any dependent input vector, vector mutual information is at most the sum of its coordinate mutual informations.
Conditional mutual-information chain rule and data processing for standard-Borel variables: conditional mutual information obeys the chain rule and the data-processing inequality for standard-Borel variables, including finite message side information.
Power bound for real and complex scalar Gaussian channels: for either scalar Gaussian model, nats, with equality for the corresponding Gaussian inputs.
Proof
For the individual bound on , give to receiver 1. Fano gives in nats. For each fixed , is fixed; translating by the known vector is invertible, so [F5] in both directions preserves this conditional mutual information. The shifted channel from is memoryless. The codeword map is deterministic and the channel law depends on only through , so [F5] in both Markov directions gives . Apply [F4] for each and average to bound this by . By [F6], each term is at most nats, where . Jensen's inequality and the power constraint give . Exchanging users gives the stated bound.
First suppose both cross gains are nonzero. Receiver 1 first forms its estimate . On the event , it reconstructs and subtracts , obtaining . Since , it scales this residual by and adds independent Gaussian noise of variance ; for complex channels use circular Gaussian noise. Adding back gives a simulated . For the error analysis, construct the same vector using the true : it then has exactly the law of receiver 2's , and on it equals the receiver's simulation. Hence the joint error is at most . Since the message pair is finite, the randomized decoder has a deterministic MAP decoder with no larger average error. Exchanging users and using gives the symmetric joint decoder at receiver 2.
In the nonzero-cross-gain case of step 1.2, apply the density-observation Fano bound [F3] to the joint decoder at receiver 1. Let and . The deterministic codeword map and channel law give both Markov directions between and with observation , so [F5] yields . The two input vectors are independent because their messages are independent. By [F4], . The output variance at time is at most , because the independent inputs have zero cross covariance after centering. These single-coordinate mutual informations are finite by the power bound and [F6].
For each coordinate put . The channel output depends on the input pair only through , so [F5] in both directions gives . Independence gives ; [F6] therefore bounds this term by nats. Jensen's inequality and the average power constraints yield . The joint decoder at receiver 2 analogously gives . If , then , so by step 1.1; the first sum bound is the individual bound and the second is no tighter because . If , then , so and the second sum bound is the individual bound while the first is no tighter because . Thus both sum bounds hold also when a cross gain vanishes.
Use the same independent Gaussian codebook ensemble at the two receivers. The finite-receiver construction in the proof of [F2] sums the two ensemble-average errors and jointly selects codebooks meeting both deterministic power constraints, so one codebook pair achieves the intersection of the two Gaussian MAC regions. The strong gain inequalities make each unintended-receiver individual constraint at least as large as the corresponding intended-receiver constraint; the two sum constraints are exactly those displayed. Therefore every rate pair strictly inside the claimed region is achievable, and closure removes strictness.
Capacity of a finite relay channel with output feedback to source and relay
Statement
For the finite relay channel with full output feedback to source and relay in Finite discrete memoryless relay channel and causal code, the capacity is
Facts & Assumptions
Given: A finite relay channel with full feedback to both encoders.
Finite discrete memoryless relay channel and causal code: the source uses , while the relay uses with no message argument; current outputs follow the memoryless law.
Cut-set outer bound for causal and full-feedback relay channels: any causal relay code satisfies both cut-set bounds with a finite time-sharing variable.
Decode-forward inner bound for a finite relay channel: block-Markov decode-forward achieves the minimum of the source-to-relay-observation and source-plus-relay-to-destination mutual informations.
Finite distributions, entropy, divergence, and stochastic matrices: the finite entropy summand , extended by zero at , is continuous on the probability simplex.
Conditional mutual information is concave in the channel input law: for a fixed channel, conditional mutual information is concave in the input law, including conditional input laws given .
Proof
Apply [F2]. Its outer bound has a finite time-sharing variable and bounds and . Apply [F5] first with input and no side information, then with input and side information . Averaging over cannot increase either conditional mutual information, so both are bounded by the corresponding quantities under the averaged joint input law . This gives the displayed maximum as an outer bound.
For achievability, view as the relay's observation and as the destination output. This is a finite relay channel whose relay encoder can causally use the observation pair because it has full feedback in [F1]. Apply the block-Markov construction of [F3] with the relay observation ; its decoding term becomes , while the destination decoding term is . Every joint input law factors as , so the construction achieves every rate below the displayed minimum.
The outer bound in step 1.1 and achievable rates in step 1.2 coincide for every joint input law. The joint-input probability simplex is compact. Each mutual information is continuous there because it is a finite sum of terms , with extended continuously by at ; the minimum of the two continuous functions is continuous. It therefore attains a maximum, and taking that maximum and closure proves the capacity formula.
Capacity region of a finite two-user interference channel under strong interference
Statement
For the channel and universal strong-interference assumptions of Finite two-user interference channel and strong-interference regime, the capacity region is the closure of the union over finite and laws of rate pairs satisfying
Facts & Assumptions
Given: A finite interference channel satisfying the universal inequalities in [F1].
Finite two-user interference channel and strong-interference regime: the two mutual-information orderings hold for every product input law.
Strong-interference information inequalities tensorize over product code inputs: these orderings tensorize for independent codeword vectors.
Finite-alphabet Fano inequality: decoding with error gives conditional message entropy at most .
Independent-private-message DM-MAC capacity region: for each finite product input law with public time sharing, the no-feedback DM-MAC capacity region has the two individual mutual-information bounds and the joint sum bound; its achievability proof uses independent random codebooks with the stated product law.
Finite entropy and mutual-information chain rules: finite entropy chain rules and conditioning identities give the coordinatewise entropy bound in the converse.
Proof
For any length- code, independence of the messages makes the induced vectors independent. Fano at receiver 1 and the fact that revealing cannot reduce mutual information give . The analogous receiver-2 bound is .
Fix finite and product conditional input laws. Apply [F4] to the marginal MAC at receiver 1 and to the marginal MAC at receiver 2. Both uses of [F4] generate the same ensemble of independent sender codebooks, because the input laws and time-sharing sequence are the same; only the two decoders differ. Under the strong-interference inequalities [F1], receiver 2's individual bound for sender 1 is at least receiver 1's intended individual bound, and receiver 1's individual bound for sender 2 is at least receiver 2's intended bound. The intersection of the two MAC regions is therefore exactly the three inequalities in the statement.
For the first individual bound, the finite entropy chain rule [F5] and memorylessness give where the first entropy is at most by the chain rule and conditioning, and the second entropy is exactly by the memoryless channel. The same calculation applies to user 2.
By the block-lift inequality [F2], . Since is independent of , Fano at receiver 2 implies Fano at receiver 1 gives . Thus . Exchanging receivers gives the corresponding sum bound at .
Let be uniform on and let have the time- input law; since the message vectors are independent, . Combining steps 2.1, 2.2 gives the stated inequalities for this . Taking limits and closure proves the converse.
The [F4] random-coding proof gives ensemble-average error tending to zero at each receiver under the strict MAC inequalities. The expected sum of the two receiver errors is at most the sum of those two vanishing bounds, so a deterministic codebook pair exists for which both errors tend to zero. Closure removes strictness and the finite variable supplies time sharing.
The two-user Gaussian interference capacity region to within one bit
Statement
For the complex Gaussian interference channel of Real and complex two-user Gaussian interference channels, the Etkin–Tse–Wang Han–Kobayashi scheme is within one bit per user of capacity, in the coordinatewise sense that for every capacity pair there is an achievable pair with . The scheme uses Gaussian common/private splits with the following nominal power policy, permitting auxiliary removal and rate moving as in Gaussian superposition Han–Kobayashi region with nonunique decoding and rate moving: in the weak regime each private signal's nominal received power at the unintended receiver is ; in the mixed regime the user causing strong interference uses only a common message and the other nominal private signal is at noise level or uses its entire power if its INR is below one. Auxiliary removal may replace a nominal split by the explicitly described one-common/one-unsplit-user construction. In the strong regime both messages may be decoded at both receivers using the exact region of [F1].
Facts & Assumptions
Given: A complex Gaussian channel with nonnegative finite powers and the SNR/INR convention in [F2]; all logarithms in the proof are base two.
The Axiom of Choice: AC is inherited through Gaussian input and information suppliers.
Exact strong-interference region for the two-user Gaussian interference channel: in the strong regime, the Gaussian MAC-intersection region is exact.
Real and complex two-user Gaussian interference channels: is user 2's interference power at receiver 1 and is user 1's interference power at receiver 2.
Gaussian Han-Kobayashi inner region for a fixed private-power split: fixed Gaussian private/common powers achieve every feasible three-stream subset-decoding rate split, including singleton streams and closure.
Genie-aided outer bounds for the two-user Gaussian interference channel: capacity obeys the displayed weak and mixed individual, sum, and weighted outer bounds.
Gaussian superposition Han–Kobayashi region with nonunique decoding and rate moving: the seven Gaussian HK facets, with an explicit nine-facet elimination and auxiliary-removal construction, are achievable under the nominal split policy; its proof selects deterministic codebooks satisfying the average power constraints.
Power bound for real and complex scalar Gaussian channels: the scalar Gaussian converse bounds a remaining user's rate by its single-user power formula when the other input vanishes.
Proof
First suppose both prescribed powers are positive; zero powers are handled separately below. Write , , , and . The weak regime is , , the mixed regimes have exactly one reversed comparison, and the strong regime is , . Positive powers make these comparisons equivalent to the gain comparisons in [F1]. In the strong regime [F1] supplies the exact region, so there is no loss. We treat one mixed regime and obtain the other by exchanging all user indices.
In the weak regime set , , , , , , , and . These correspond to the nominal private powers and , including zero cross gains without division by an INR. Let be [F5]'s quantities for this split. Then , , , , and : for example and . These elementary inequalities will compare all facets uniformly, including INR below one. Denote by the three weak outer sum right-hand sides in their displayed order and by the outer and right-hand sides.
In the mixed regime , , take , , , , , . Thus user 2 is nominally all common, and the private user 1 signal has unintended received power . The seven-facet quantities become , , , , , , , and . Let and , the mixed outer first sum and weighted right sides. The remaining sum bound is . Since , we have and .
It remains to justify clipping a coordinate at zero; a negative-coordinate polygon argument would not do this. If both capacity coordinates are at most one, use the zero code. Suppose and write . The capacity individual bound gives , so it suffices to achieve on the axis. Shut user 1 off. In a weak nominal split, if user 2 is entirely private and achieves . If , its desired private power is and its unintended private power is one. Its common layer can be decoded at the unintended receiver while treating its private layer as noise at any rate up to . At its intended receiver the private rate bound is , the common bound is , and the total bound is . The product identities and give and . For a total rate , allocate private rate and common rate ; this common rate is at most both and . Every intended MAC subset inequality and the unintended common decoding inequality therefore holds, with closure for equality, so [F3] achieves at least with this same nominal split. At the common power and are zero and the calculation still holds.
The complete weak facet comparison table is . Here the first two comparisons follow from and its reflection. For , cancel the common factor in the numerator and use ; the denominator is . The reflected inequality proves the next row. For , each of its numerator factors and dominates the corresponding outer factor by step 2.1. For the row cancel and compare the remaining inner factors with the outer factors , factor by factor using step 2.1; the denominator is . Reflection gives the final row. This verifies every entry of the table by multiplication of nonnegative factors.
The full mixed comparison table is . The third row follows by canceling and using . The fifth uses . The sixth uses the former inequality after canceling ; its capacity upper bound is the sum of the individual bound and the MAC sum bound, hence is a valid bound on . In the last row has the same output numerator as the first term of , and ; the sole additional outer factor is because . These calculations prove all rows, and each gap is no larger than its facet's sum of coefficients. They include , , , , and directly. Therefore for mixed capacity pairs with both coordinates at least one, obeys all seven achievable facets. Reflecting indices proves the other mixed regime.
If a weak-regime capacity pair has , put . Subtracting one in each coordinate reduces the linear functionals with coefficient pairs , , , , and by respectively . The table therefore places in all seven facets of [F5], which is achievable with the nominal split and its authorized auxiliary-removal alternatives. There are no missing INR subcases: if then and user 2's common power is zero; if the reflected fact holds. The formulas remain exact, and facets made redundant by singleton streams do not need to be imposed anew. At or the formulas from the two sides coincide. If , both common layers vanish and the seven-facet region reduces to the rectangle , ; each individual gap is at most one. Thus the same calculation covers both sub-noise INRs, either one, and their zero and unit boundaries.
For a mixed axis, the nominally all-common strongly interfering user has unintended link at least as strong as its intended link; with the other user shut off its entire intended single-user rate is decodable at both receivers. The other user's axis is covered by the calculation in step 2.3, including the entirely-private case when its INR is below one. Reflecting indices handles . Singleton layers and boundary rates follow from [F3]'s closure; the superposition and fallback regions use the explicit slack-power selection in [F5]. Thus for every weak, mixed, or strong capacity pair with positive prescribed powers there is an achievable pair whose coordinates are at least . All changes of layer labels and powers in the non-axis seven-facet construction are exactly the permitted auxiliary removal of [F5], so the full coordinatewise claim and nominal power policy in the statement both hold.
Finally let a prescribed power vanish. If , the average nonnegative energy constraint forces user 1's codeword to vanish almost surely, so and ; the scalar individual converse gives . If also , both rates are zero. Otherwise, when the nominal all-common user 2 code achieves its exact single-user rate at both receivers, since ; there is no condition on user 1's gains to check because it sends no information. When the nominal private user 2 split achieves at least by the direct axis construction of step 2.3. The case is reflected. All deterministic zero-power layers are omitted, and no argument divides by a gain or a zero power. This proves the asserted full-channel claim for nonnegative finite powers as well as the positive-power cases.
5 · Examples, counterexamples and false statements
None yet.
Sources
- Sung Hoon Lim, Young-Han Kim, Abbas El Gamal, and Sae-Young Chung, Noisy Network Coding, IEEE Transactions on Information Theory 57(5), 2011
- Raul H. Etkin, David N. C. Tse, and Hua Wang, Gaussian Interference Channel Capacity to Within One Bit
- Abbas El Gamal and Young-Han Kim, Lecture Notes on Network Information Theory, arXiv:1001.3404v4
- Raul H. Etkin, David N. C. Tse, and Hua Wang, Gaussian Interference Channel Capacity to Within One Bit, IEEE Transactions on Information Theory 54(12), 2008
- Thomas M. Cover and Abbas A. El Gamal, Capacity Theorems for the Relay Channel, IEEE Transactions on Information Theory 25(5), 1979
- M. H. M. Costa and Abbas A. El Gamal, The Capacity Region of the Discrete Memoryless Interference Channel with Strong Interference, IEEE Transactions on Information Theory 33(5), 1987
- Yury Polyanskiy and Yihong Wu, Information Theory: From Coding to Learning, author prepublication
- John Duchi, Lecture Notes on Statistics and Information Theory
- Yury Polyanskiy and Yihong Wu, Information Theory: From Coding to Learning, Cambridge University Press prepublication book
- Robert M. Gray, Entropy and Information Theory, corrected author-hosted first edition
- A. S. Avestimehr, S. N. Diggavi, and D. N. C. Tse, Wireless Network Information Flow: A Deterministic Approach, IEEE Transactions on Information Theory 57(4), 2011