How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite-grid masked sampler defines a normalized law
Statement
Let be finite and nonempty, , , , and . For each , let be a probability vector on , put , and define the reverse coordinate rows to copy an unmasked token and, from , assign mass to and mass to each . Their product rows are probability vectors. Composing these kernels from the point mass at therefore gives a normalized finite law, and its final state lies in because removes every remaining mask.
Statement references
Finite-grid masked reverse sampler: defines , the position-wise reverse rows, their product kernel, and the start state .
Measure kernel and probability kernel: a probability kernel has probability-law rows.
Facts & Assumptions
Given: A finite strict survival schedule and the probability-vector family from the sampler definition. Prove the reverse kernels are normalized and end in .
Finite-grid masked reverse sampler: ; a masked coordinate stays masked with mass and moves to with mass ; unmasked coordinates are copied.
Measure kernel and probability kernel: on a finite power-set state space, a nonnegative row summing to one is a probability kernel.
Proof
For , strict decrease gives and , so . Since , , hence .
If , the coordinate row in [F1] is a point mass and sums to one. If , its mass is because is a probability vector. The product over positions therefore has nonnegative entries summing to the product of ones, namely one; by [F2] it is a probability-kernel row.
Fix a current state and position . If and , the uniform threshold satisfies and . For an ordered vocabulary , put and . The inverse-CDF rule selects on the interval , whose uniform probability is . The fallback at has probability zero and so does not change this law, even if the fallback token has zero mass. Since the mask and token uniforms are independent, the resulting row assigns mass to and to each . If , the direct token draw has law and no mask is retained. Unmasked coordinates are copied, and independence of the random pairs across positions makes the sequence row the product in [F1]. Thus the stated random instructions realize the coordinate and product rows from step 2.1.
The loop has exactly reverse-step iterations, each updates the finite set of positions once, and each inverse-CDF search checks at most the finite number of tokens; the fallback defines the draw also at . Hence every instruction terminates and the algorithm terminates after finitely many operations. Starting from the point mass at , composition of the normalized rows from step 2.1 gives a normalized finite path and endpoint law. At , , so the algorithm's direct token-draw branch removes every remaining mask and copies every already clean coordinate. Thus , completing the support claim.
Depends on
Used by
- Negative expected finite masked-diffusion ELBO is weighted cross-entropy Corollary
- Finite masked-diffusion generative model Definition
- Finite masked-diffusion joint model is normalized Lemma
- Forward path law is admissible for the finite masked model Lemma
- Masked-diffusion KL reduces to weighted cross-entropy Theorem
Cited to discharge well-definedness by Finite-grid masked reverse sampler.
Dependency tree · two levels
5 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.
Sources
- Subham Sekhar Sahoo et al., Simple and Effective Masked Diffusion Language Models, arXiv v1 (standard reference, not scraped)