Alphabeta Math
TheoremStatement: Literature-sourcedProof: AI-generatedPipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

Random coding achieves every rate below finite DMC capacity

Statement

For every finite DMC W and every 0≤R<C(W), there are fixed-length codes with lim inf⁡n→∞n−1ln⁡Mn≥R and average error tending to zero.

Facts & Assumptions

Given: A finite DMC W and a rate 0≤R<C(W).

[F1]

Finite DMC information capacity is attained: some input law PX∗ satisfies I(PX∗;W)=C(W).

[F2]

Finite DMC information density: the information density is ln⁡(W(y∣x)/QPX∗(y)) on the induced joint support, with its block value the coordinate sum.

[F3]

IID DMC information density converges to mutual information: under IID input PX∗ and DMC output, the normalized information density converges in probability to C(W).

[F4]

Finite stochastic kernels and The DMC product laws are stochastic kernels: each block transition law is a probability vector.

[F5]

Fixed-length codes for a finite DMC and Average and maximal error of a fixed-length code: a selected codebook and deterministic decoder define a code and its average error.

Proof

1.1F1F3givenchoose

If R=0, one message gives zero error. Otherwise choose δ:=(C(W)−R)/3>0 and Mn:=⌊enR⌋. Then ln⁡Mn/n→R, so for all sufficiently large n, (ln⁡Mn+nδ)/n<C(W)−δ. By [F3], the probability that the transmitted IID pair fails the threshold ıPX∗(Xn;Yn)>ln⁡Mn+nδ tends to zero.

2.1F2F4step 1.1algebra

Draw Mn codewords independently from PX∗ n. Decode to the unique codeword with information density greater than ln⁡Mn+nδ, using a fixed default output if there is not exactly one. Conditional on the transmitted message, an error is contained in the union of the true-codeword miss event from step 1.1 and the event that some independent competing word passes the threshold. For one competitor X′n∼PX∗ n independent of Yn∼QPX∗ n, [F2] gives EeıPX∗(X′n;Yn)=∑xnPX∗ n(xn)∑yn:QPX∗ n(yn)>0Wn(yn∣xn)=1 by [F4], since every output reachable from a positive-probability input has positive QPX∗ mass. On a false pass, the nonnegative variable Z=eıPX∗(X′n;Yn) exceeds eln⁡Mn+nδ, so 1=EZ≥eln⁡Mn+nδPr⁡[Z>eln⁡Mn+nδ], and the false-pass probability is at most e−ln⁡Mn−nδ. A union bound over at most Mn−1 competitors makes this term at most e−nδ.

3.1F5step 1.1step 2.1choose∎

The ensemble-averaged average error is at most the miss probability plus e−nδ, so it tends to zero by step 1.1 and step 2.1. The ensemble has finite support; therefore at each n some deterministic codebook has average error no greater than the ensemble mean. Its rate tends to R, proving the claim.

Depends on

Used by

Dependency tree · two levels

18 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.

Sources