How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite Probability Spaces and Random Variables — Examples and Counterexamples
1 · Prerequisites
- Binary Operations, Monoids, Groups and Subgroups
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Countability and Uncountability
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability Spaces and Random Variables
- Foundations of the Real Numbers for Analysis
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Roots, Rational Powers, and Classical Inequalities
- Suprema and Infima
- The ZFC Axioms and the Basic Set Constructions
2 · Summary
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
A loaded die as a nonuniform finite probability space
Example
On assign weights This is a loaded die with a possible zero-weight outcome. Let and .
Facts & Assumptions
Given: The weights and events in the Example.
Finite probability spaces allow nonnegative outcome weights summing to (Finite probability spaces, outcome weights, events, and event probabilities).
Complements and differences obey the finite probability laws (Normalization, nonnegativity, monotonicity, complements, and differences in a finite probability space).
when (Conditional probability for ).
The multiplication rule is (The multiplication rule and finite chain rule for conditional probability).
Verification
The six weights sum to , so [L1] gives a finite probability space; is nonempty but has probability zero.
Direct summation gives , , and .
Since , [L3] gives .
Finally , verifying [L4] in this nonuniform space.
Bayes' theorem for choosing one of two urns and observing a colour
Example
Choose urn with probability and urn with probability , independently choose a uniform auxiliary value , and declare the observation red when was chosen and , or when was chosen and . Thus the red likelihoods are and , respectively. The posterior probability of after observing red is .
Facts & Assumptions
Given: The finite two-stage experiment in the Example.
Bayes' theorem over a positive-probability finite partition gives posterior probability as prior times likelihood divided by total likelihood (Bayes' theorem over a finite partition).
A finite product experiment assigns product weights to its branches (The finite product of finite probability spaces).
Conditional probability is the probability of an intersection divided by the positive probability of the conditioning event (Conditional probability for ).
Verification
In the product space, the three red branches over have total weight , and the one red branch over has weight . Hence .
Directly, .
Bayes' formula [L1] has the same numerator and denominator , so it also gives .
Three pairwise-independent events that are not mutually independent
Example
On the uniform space , let be the event that the first bit is , let be the event that the second bit is , and let be the event that the two bits agree. Then are pairwise independent but not mutually independent.
Facts & Assumptions
Given: The uniform four-point space and events in the Example.
In a uniform finite space, probability is cardinality divided by the outcome count (The uniform probability space on a nonempty finite set).
Pairwise independence requires each pairwise intersection to have product probability, while mutual independence also requires the triple identity (Independent events, pairwise independence, and mutual independence of a finite family).
Verification
Each of has two outcomes and probability . Moreover , so every pairwise intersection has probability .
Therefore every pair satisfies .
The triple intersection is and has probability , whereas the product of the three probabilities is .
Thus the events are pairwise independent but not mutually independent.
Events with the same probability need not be independent
Statement refuted
If two events have the same probability, then they are independent.
Facts & Assumptions
Given: The uniform probability space on .
Uniform event probability is event cardinality divided by (The uniform probability space on a nonempty finite set).
Independence requires (Independent events, pairwise independence, and mutual independence of a finite family).
Counterexample
Let and . Then .
Their intersection is , so .
Thus equal event probabilities do not imply independence.
For dependent variables, need not equal
Statement refuted
Every pair of finite random variables satisfies .
Facts & Assumptions
Given: A uniform random sign on and the variable .
A uniform two-point space gives both outcomes probability (The uniform probability space on a nonempty finite set).
Independence requires joint attained-value probabilities to factor (Pairwise and mutual independence of finite-valued random variables).
Expectation is the weighted finite sum of values (Expectation of a real random variable on a finite probability space).
Counterexample
For the constructed pair , directly , while everywhere and hence .
Also , so the variables are dependent.
Thus , refuting the statement.
False: linearity of expectation requires independence
Statement
The identity is valid only when and are independent.
Facts & Assumptions
Given: Finite real random variables on one finite probability space.
Expectation is linear for every finite family of random variables, without any independence hypothesis (Expectation is linear for every finite family of random variables, without any independence hypothesis).
A uniform two-point space assigns each outcome probability (The uniform probability space on a nonempty finite set).
Independence requires every joint attained-value probability to factor (Pairwise and mutual independence of finite-valued random variables).
Refutation
On the uniform random-sign space, take and . Then , so [L3] shows that and are dependent.
Nevertheless [L1] gives . Therefore independence is not necessary for linearity, so the statement is false.
The union bound can be strict for overlapping events
Example
On the uniform four-point space, let , , and . Then the three events cover the space, but the sum of their probabilities is .
Facts & Assumptions
Given: The uniform space and events in the Example.
Uniform event probabilities are cardinality ratios (The uniform probability space on a nonempty finite set).
Two-event inclusion-exclusion subtracts the probability of the overlap (Two-event inclusion-exclusion: ).
The finite union bound compares union probability with the sum of marginal probabilities (The finite union bound).
Verification
Each event has probability , while has probability .
Thus [L3] reads , and the inequality is strict.
The common outcome is counted in all three marginal probabilities; [L2] displays this overlap correction already for each pair.
A symmetric two-point distribution attains equality in Chebyshev's inequality
Example
For every , let be uniform on . At the weak threshold , equality holds in Chebyshev's inequality.
Facts & Assumptions
Given: A real and the random variable in the Example.
The two points in a uniform finite space each have probability (The uniform probability space on a nonempty finite set).
A finite real random variable and its expectation are defined by finite weighted sums (Real random variables on finite probability spaces and their finite distributions, Expectation of a real random variable on a finite probability space).
Variance is the expectation of the squared centred variable (Variance, standard deviation, and covariance on a finite probability space).
Chebyshev states for (Chebyshev's inequality on a finite probability space).
Verification
Symmetry gives , and everywhere, so .
The event is all of the outcome space and has probability .
The right side of [L4] at is , so equality holds. Positivity of licenses the division.
A two-valued random variable attains equality in Markov's inequality
Example
Let and . On a two-outcome finite probability space, give an event probability and define on and off . Then equality holds in Markov's inequality at threshold .
Facts & Assumptions
Given: Parameters , , and the construction in the Example.
Zero outcome weights are permitted in a finite probability space (Finite probability spaces, outcome weights, events, and event probabilities).
Real random variables and expectation are finite functions and weighted sums (Real random variables on finite probability spaces and their finite distributions, Expectation of a real random variable on a finite probability space).
Markov gives for nonnegative and (Markov's inequality on a finite probability space).
Verification
Give the two outcomes weights and ; these are nonnegative and sum to , including at .
The variable is nonnegative, , and has probability .
Hence , so [L3] is sharp.
Markov's conclusion can fail without nonnegativity
Statement refuted
The conclusion of Markov's inequality remains valid when the hypothesis is removed.
Facts & Assumptions
Given: The uniform two-point probability space and a random variable taking values and .
Each point in a uniform two-point space has probability (The uniform probability space on a nonempty finite set).
A real random variable and its expectation are a function and its weighted finite sum (Real random variables on finite probability spaces and their finite distributions, Expectation of a real random variable on a finite probability space).
Markov's theorem assumes that is nonnegative (Markov's inequality on a finite probability space).
Counterexample
For the constructed two-valued variable, direct calculation gives .
At threshold , , while .
The purported conclusion would be , which is false. This refutes removal of the nonnegativity hypothesis, not [L3].
Sources
Standard references
Recommended treatments; not extraction sources.
- C. M. Grinstead and J. L. Snell, Introduction to Probability, 2nd ed., Section 1.2
- C. M. Grinstead and J. L. Snell, Introduction to Probability, 2nd ed., Section 4.1
- J. Matousek and J. Vondrak, The Probabilistic Method, Section 1.1
- H. Pishro-Nik, Introduction to Probability, Statistics, and Random Processes, Section 1.4.1
- H. Pishro-Nik, Introduction to Probability, Statistics, and Random Processes, Section 5.3.1
- C. M. Grinstead and J. L. Snell, Introduction to Probability, 2nd ed., Theorem 6.2
- H. Pishro-Nik, Introduction to Probability, Statistics, and Random Processes, Section 6.2.1
- C. M. Grinstead and J. L. Snell, Introduction to Probability, 2nd ed., Section 8.1 after Example 8.1
- H. Pishro-Nik, Introduction to Probability, Statistics, and Random Processes, Section 6.2.2