How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite Trellises, Viterbi, and Sequence Decoding — Examples
1 · Prerequisites
2 · Summary
Worked finite models show how ties and unreachable trellis states affect traceback, how exact HMM path masses determine a sequence MAP, and why zero observation evidence leaves no posterior MAP path. A second HMM calculation distinguishes a whole-sequence MAP from independently maximizing each time-indexed posterior marginal.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
Zero-evidence observations have no conditional MAP path
Statement refuted
For every finite HMM and every finite observation sequence, the posterior distribution on hidden paths is defined and therefore has a sequence MAP path.
Facts & Assumptions
Given: A finite discrete HMM with two hidden states and one observed symbol.
Finite hidden Markov models for sequence decoding: For an observation sequence , its evidence is ; the conditional path mass is defined only when , and a sequence MAP path maximizes this conditional mass.
Counterexample
Take , , and initial probabilities . Let both transition rows be . In each state let and . These are normalized initial, transition, and emission parameters. Observe the length-one sequence .
For the two possible hidden paths, the joint masses are and . Thus .
By [F1], division by this zero evidence does not define conditional path masses, so there is no posterior MAP path for this observation. Both paths maximize the zero joint mass, but that arbitrary tie is not a conditional posterior distribution. This refutes the Statement.
Coordinatewise posterior modes need not be a sequence MAP
Statement refuted
For every finite HMM with positive observation evidence, choosing a posterior-most-probable hidden state separately at each time always produces a sequence MAP path.
Facts & Assumptions
Given: A finite discrete HMM, an observation sequence , and . The time- posterior marginal at state is .
Finite hidden Markov models for sequence decoding: For positive evidence, ; a sequence MAP path maximizes this whole-path conditional mass.
Counterexample
Let and . Set and . The transition rows are and . Both states emit with probability . Observe . The four hidden-path masses are They sum to , so these are also the posterior path masses.
The initial weights sum to , each transition row sums to , and each emission row has its single entry equal to , so this is a valid HMM. The path masses follow by multiplying the initial and transition factors: , , , and . Their sum is .
The time-1 marginal masses are and , so the unique time-1 mode is . The time-2 marginal masses are and , so the unique time-2 mode is . Their coordinatewise mode is , whose mass is strictly below . Hence is not a sequence MAP path, refuting the Statement.
A finite trellis with tied maxima and an unreachable high-score state
Example
Take , vertex layers , , and . Set and . The only layer-2 edges are and , each of weight . The layer-3 edges are and , each of weight , and of weight . The vertex order in layer 2 is .
Columns in the diagram are layers and arrow labels are multiplicative edge weights. The dashed vertex has no incoming edge, so it is unreachable. The proof below uses the explicit edge list and scores, not the drawing.
\begin{tikzpicture}[>=stealth]
\node[circle,draw] (s) at (0,0) {$s$};
\node[circle,draw] (a) at (2,1) {$a$};
\node[circle,draw] (b) at (2,0) {$b$};
\node[circle,draw,dashed] (c) at (2,-1) {$c$};
\node[circle,draw] (t) at (4,0) {$t$};
\draw[->] (s) -- node[above] {$2$} (a);
\draw[->] (s) -- node[above] {$2$} (b);
\draw[->] (a) -- node[above] {$3$} (t);
\draw[->] (b) -- node[below] {$3$} (t);
\draw[->] (c) -- node[below] {$100$} (t);
\end{tikzpicture}
Facts & Assumptions
Given: The weighted trellis and vertex order specified in the Example.
Finite weighted trellises: A path must start with positive initial weight, follow allowed edges through every layer, and end with positive terminal weight; its score is the product of these weights.
Max-product Viterbi decoding on a finite trellis: Viterbi computes the maximum prefix products, stores a maximizing predecessor for each positive value, then chooses a maximum terminal product and follows the backpointers.
Finite-trellis Viterbi decoding returns a maximum-score path: If a path exists, the algorithm returns a path of maximum score.
Verification
Any path must leave for or , since these are the only layer-2 edges. From either state it must go to . Thus the complete path set is and , each with score . There is no path through because no edge enters , despite its outgoing edge of weight .
The prefix values are , , and . Therefore . The stated order selects predecessor on the tie, so traceback returns with maximum score , as [F3] also guarantees.
An exact two-state HMM sequence-MAP calculation
Example
Let , , and , . The transition rows are and . The emissions are , , , and . For observations , use the state order . The eight joint path masses are:
| Hidden path | Joint mass |
|---|---|
The observation evidence is .
The diagram uses arrows for transition probabilities and initial weights. Emission probabilities are listed in the prose above each state.
\begin{tikzpicture}[>=stealth]
\node[draw] (start) at (-2,0) {start};
\node[circle,draw] (u) at (0,1) {$u$};
\node[circle,draw] (v) at (0,-1) {$v$};
\draw[->] (start) -- node[above] {$3/4$} (u);
\draw[->] (start) -- node[below] {$1/4$} (v);
\draw[->] (u) edge[loop above] node {$3/4$} (u);
\draw[->] (v) edge[loop below] node {$3/4$} (v);
\draw[->] (u) to[bend left=15] node[right] {$1/4$} (v);
\draw[->] (v) to[bend left=15] node[left] {$1/4$} (u);
\end{tikzpicture}
Facts & Assumptions
Given: The HMM parameters and observation sequence specified in the Example.
Finite hidden Markov models for sequence decoding: A hidden path and observation sequence have joint mass equal to the initial, emission, transition, and later emission factors multiplied in order; positive evidence defines the conditional path mass by division by that evidence, and a sequence MAP path maximizes this conditional mass.
Viterbi sequence decoding for a finite hidden Markov model: The induced trellis starts with , uses edge weights for positive factors, and has terminal weights .
Finite-HMM Viterbi decoding is exact sequence MAP: With positive observation evidence, the algorithm returns a hidden-state sequence maximizing the posterior mass of the entire sequence.
Verification
The common denominator in each joint path mass is . The numerator factor products, in the order initial, first emission, first transition, second emission, second transition, third emission, are , , , , , , , and . Their sum is , so the evidence is positive and is the unique maximum-mass path.
The max-product table starts with and . At time , the best incoming products give and . At time , and . The last pointer is from to , and the preceding pointer for is from to , so traceback gives . This agrees with the exhaustive maximum in step 1.1; by [F3] it is a sequence MAP path. Its posterior mass is .