How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite-Blocklength Bounds and Reliability — Examples
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Binary Operations, Monoids, Groups and Subgroups
- Compactness in Metric Spaces
- Completeness, Completion, and Uniform Continuity
- Conditional Distributions and Regular Conditional Probability
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Discrete Memoryless Channel Capacity
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Estimators and Randomized Procedures
- F-Divergences, Rényi Information, and Hypothesis Testing
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability Spaces and Random Variables
- Finite-Alphabet Entropy and Divergence
- Finite-Blocklength Bounds and Reliability
- Foundations of the Real Numbers for Analysis
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Loss, Risk and Decision Theory
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Probability Spaces Random Variables and Expectation
- Properties of the Integral and the Working FTC
- Quantum Communication and Fingerprinting
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Roots, Rational Powers, and Classical Inequalities
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Simple Field Extensions and the Construction of the Complex Numbers
- Statistical Experiments, Models and Identifiability
- Suprema and Infima
- Tests, Neyman–Pearson and Valid P-values
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Lebesgue Integral and the Convergence Theorems
- The Logarithm and General Powers
- The Riemann Integral: Definition and Integrability
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
These examples evaluate the one-shot dependence-testing expression and meta-converse on a binary symmetric channel, then give a finite noiseless-channel counterexample separating small average error from maximal error. The calculations retain the null/alternative convention for and distinguish average-error bounds from per-message guarantees.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
Small expected average code error need not control maximal error
Statement refuted
Expected average error tending to zero for singleton random-code ensembles on finite DMCs forces the corresponding maximal errors to tend to zero.
Facts & Assumptions
Given: , input/output alphabet , and the noiseless DMC .
Fixed-length codes for a finite DMC: a fixed-length code consists of an encoder from messages to input words and a deterministic decoder from outputs to messages.
Average and maximal error of a fixed-length code: average error is the uniform-message mean, and maximal error is the largest individual error.
Counterexample
For every integer , there is a singleton random-code ensemble on a finite noiseless DMC whose expected average error is while the code's maximal error is . Thus a small expected average error alone does not make every message's error small.
Use blocklength one, encode message as for and encode message as . Decode output as message . These maps are defined on the stated finite alphabets and form a code by [F1].
On the noiseless channel, messages are decoded correctly, while message is decoded as and is always wrong. Hence [F2] gives average error and maximal error . Take the random-code ensemble to put probability one on this single code; its expected average error remains , while its maximal error remains . Letting proves the claimed separation.
Exact evaluation of a one-use BSC dependence-testing bound
Example
For a one-use BSC with crossover , uniform input, and , the dependence-testing upper bound on achievable average error is exactly .
Facts & Assumptions
Given: The BSC transition probabilities for and for , uniform input, and .
Finite-DMC dependence-testing achievability bound: a deterministic code exists whose average error is at most .
Finite discrete memoryless channels: a BSC row is a probability vector, and its output law under an input vector is the matrix product .
Verification
Under the uniform input, the output is uniform. Therefore with probability and with probability .
The threshold is . On the correct-output event, the integrand is , contributing . On the crossover event, , so the positive part is zero and the integrand is one, contributing . Thus the expectation is , and [F1] supplies a code with average error at most this value.
Exact beta value for a one-use BSC meta-converse test
Example
For the one-use BSC with , the identity encoder/decoder with two equiprobable messages has average error . With its true joint law and the uniform-message/uniform-output auxiliary law , the oriented testing value is exactly .
Facts & Assumptions
Given: Messages are uniform, the input is , the decoder outputs , and the BSC crossover probability is .
Finite type-II testing function with explicit orientation: minimizes over tests with .
Finite-DMC hypothesis-testing meta-converse: every -message code with average error satisfies for any auxiliary output law.
Finite discrete memoryless channels: the BSC has transition probability on and on .
Verification
The four true joint masses are on and on . The auxiliary law assigns to each pair. The identity decoder is wrong with total true mass , so its average error is .
Write for the acceptance probability. The constraint in [F1] is , and the objective is . Let be the sum of on the two correct pairs and its sum on the two crossover pairs. Then , the constraint is , and the objective is .
If , the objective is at least . If , the constraint forces , so where the last inequality follows from and . Thus every randomized feasible test has objective at least . Taking on the two correct pairs and on the crossover pairs attains constraint equality and objective . Hence , as also bounded by [F2].
Sources
- Yury Polyanskiy and Yihong Wu, Information Theory: From Coding to Learning, Chapter 19 §19.2
- MIT 6.441 Information Theory, Lecture 12, Spring 2010
- Yury Polyanskiy, H. Vincent Poor, and Sergio Verdú, Channel Coding Rate in the Finite Blocklength Regime
- Yury Polyanskiy and Yihong Wu, Information Theory: From Coding to Learning, Chapter 22 §22.3