How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Secrecy and Information Privacy — Examples
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Binary Operations, Monoids, Groups and Subgroups
- Compactness in Metric Spaces
- Completeness, Completion, and Uniform Continuity
- Conditional Distributions and Regular Conditional Probability
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Convexity
- Countability and Uncountability
- Discrete Memoryless Channel Capacity
- F-Divergences, Rényi Information, and Hypothesis Testing
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability Spaces and Random Variables
- Finite-Alphabet Entropy and Divergence
- Foundations of the Real Numbers for Analysis
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Measurable Functions and Simple Approximation
- Measures and Their Basic Properties
- Metric Spaces
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Order, Zorn's Lemma, and the Axiom of Choice
- Power Series and Real-Analytic Functions
- Probability Spaces Random Variables and Expectation
- Properties of the Integral and the Working FTC
- Quantum Communication and Fingerprinting
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Roots, Rational Powers, and Classical Inequalities
- Secrecy and Information Privacy
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Sigma Algebras and Borel Sets
- Suprema and Infima
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Logarithm and General Powers
- The Riemann Integral: Definition and Integrability
- The ZFC Axioms and the Basic Set Constructions
- Topological Spaces and Continuity
- Topology of ℝ
- Trust region and cubic regularization methods
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
These examples separate normalized from unnormalized leakage, compute a finite binary privacy–utility objective and its perfect-privacy boundary, and evaluate a degraded binary erasure wiretap channel. Each calculation uses finite alphabets and natural-log nats.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
A finite information-bottleneck privacy model
Statement
Let be a fair bit, let be independent, and set . For every finite stochastic release kernel , the induced law is . With and ,
and equality is attained by releasing (or any bijective relabeling of ). If , then necessarily for every such release kernel.
Facts & Assumptions
Given: A fair sensitive bit , independent noise , useful bit , and a finite release kernel .
Finite-source privacy–utility region: the kernel induces , written , with leakage and retained-information utility .
Finite mutual information: mutual information is finite joint-law KL in nats.
Finite conditional entropy: conditional entropy is the finite average of the conditional entropies, with zero-mass branches omitted.
Finite entropy and mutual-information chain rules: mutual information equals the corresponding entropy difference and the finite entropy chain rule holds.
A finite kernel criterion for perfect privacy: exactly when each positive-support conditional output law is the same across .
Finite distributions, entropy, divergence, and stochastic matrices: finite entropy is with .
Proof
The fair bit has entropy . Since is fair and independent of the symmetric noise, is fair as well. Given either value of , the posterior error probability for estimating is , so . The factorization in [F1] is .
Using [F2] and [F4], expand the objective as The conditional-entropy chain rules in [F4] give . By [F3] and [F6], and , so . The factorization in [F1] gives on positive-mass pairs, hence by step 1.1. Therefore , and .
For the identity release , and step 1.1 gives . Substitution gives equality in the bound. A bijective relabeling preserves these conditional entropies and mutual informations, so also attains equality.
Suppose . By [F5], for each with , the two rows of agree. If , then , and nonnegativity forces both entries to be zero, so the rows agree for every release value. With row order and , the binary symmetric channel matrix from to is so for the column the output column is for some . Since and , invertibility gives . This holds for every , so the two rows of coincide and are independent. Therefore .
Weak secrecy does not imply strong secrecy
Statement
Consider the noiseless finite wiretap channel with and exactly when . At blocklength , let , let be uniform on , and transmit . Bob and Eve both observe the transmitted word exactly. This reliable code sequence satisfies weak secrecy but not strong secrecy: its leakage is , whereas . In general, strong secrecy implies weak secrecy.
Facts & Assumptions
Given: The finite wiretap code model, finite mutual information and the weak/strong secrecy criteria.
Finite discrete memoryless wiretap channel and code model: a wiretap code has a uniform message, Bob observes , Eve observes , and error includes erasure.
Information leakage and equivocation for finite observations: leakage is in nats and normalized leakage is .
Weak and strong secrecy for wiretap code sequences: weak secrecy requires normalized leakage to vanish, while strong secrecy requires unnormalized leakage to vanish.
Finite mutual information: for finite variables.
Finite entropy and mutual-information chain rules: and the entropy chain rule holds for finite variables.
Finite KL divergence is nonnegative with equality exactly at equal laws: finite KL divergence is nonnegative.
Finite distributions, entropy, divergence, and stochastic matrices: a uniform law on points has entropy .
Proof
For each , the input string has length . The noiseless channel gives with probability one, so Bob recovers the first bits exactly and the error probability is zero. Eve's observation also determines exactly, hence .
By uniformity and [F7], . Thus [F5] gives .
Since , one has and . Step 2.1 therefore gives unnormalized leakage tending to infinity and normalized leakage tending to zero by [F2]. With zero error this is weak secrecy and failure of strong secrecy by [F3].
For any wiretap code sequence, [F4] identifies mutual information with finite KL divergence, and [F6] makes it nonnegative. Hence for . If the right side tends to zero, so does the left side, proving that strong secrecy implies weak secrecy.
A degraded binary erasure wiretap channel
Statement
Bob observes a binary erasure channel (BEC) with input alphabet , output alphabet , and erasure probability . Eve observes Bob's output after independently erasing each surviving bit with probability , while an erasure remains an erasure. This is a finite degraded wiretap channel. Its strong- and weak-secrecy capacities under average or maximal error are all nats per use. Define with . For Bernoulli- input the single-letter difference is , which is zero at and maximal at .
Facts & Assumptions
Given: Bob's channel is BEC and Eve's output is obtained by an independent BEC erasure of Bob's non-erased symbols.
Finite degraded wiretap channel: a degraded wiretap channel has factorization .
Secrecy capacity of a finite degraded wiretap channel: all four operational secrecy capacities equal .
Finite mutual information: mutual information is finite joint-law KL in nats.
Finite entropy and mutual-information chain rules: finite mutual information satisfies and the entropy chain rule.
Finite KL divergence is nonnegative with equality exactly at equal laws: finite KL divergence is nonnegative and vanishes exactly for equal laws.
Finite distributions, entropy, divergence, and stochastic matrices: with zero terms omitted, and the uniform binary entropy is .
Proof
Define , , and for , with all other entries zero. Each row sums to one. Given input , the joint probabilities are for , for , and for ; all other pairs have probability zero. Thus and [F1] applies.
For a Bernoulli- input, a BEC with erasure probability has : on a received bit the conditional entropy is zero, and on erasure it is . Since by [F4], Bob's mutual information is and Eve's is . Their difference is .
For every , compare the Bernoulli- law with the uniform binary law. By [F5], with equality exactly when . At and , the zero-term convention in [F6] gives . Thus has maximum at the fair input and vanishes at both deterministic endpoints. The capacity claim follows from [F2] and step 2.1.
Sources
- Ali Makhdoumi, Salman Salamatian, Nadia Fawaz, and Muriel Médard, From the Information Bottleneck to the Privacy Funnel, ITW 2014
- Paul Cuff, Princeton ELE 538: Information Theoretic Security, Lecture 15
- Matthieu R. Bloch and J. Nicholas Laneman, Strong Secrecy from Channel Resolvability, arXiv:1105.5419
- Abbas El Gamal and Young-Han Kim, Network Information Theory, arXiv:1001.3404v3
- Paul Cuff, Princeton ELE 538: Information Theoretic Security, Lecture 11