How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Spectral clustering and graph cuts
1 · Prerequisites
- Algebraic Closure, Embeddings, and Separability
- Algebraic Extensions, Extension Degree, and Finite Fields
- Binary Operations, Monoids, Groups and Subgroups
- Composition Series, the Jordan–Hölder Theorem and Solvable Groups
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Cyclic Groups and Direct Products
- Determinants of Matrices over a Commutative Ring
- Diagonalisation and the Minimal Polynomial
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Eigenvalues, Eigenvectors and the Characteristic Polynomial
- Finite Counting, Factorials and Binomial Coefficients
- Foundations of the Real Numbers for Analysis
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Group Homomorphisms and the Isomorphism Theorems
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- K-means, Gaussian mixtures, and soft assignments
- Limits of Real Functions
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Polynomial Rings, the Division Algorithm and Roots
- Primes, Euclid's Lemma and the Fundamental Theorem of Arithmetic
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Roots, Rational Powers, and Classical Inequalities
- Sequences and Limits
- Simple Field Extensions and the Construction of the Complex Numbers
- Splitting Fields
- Suprema and Infima
- Sylow's Theorems, p-Groups and Nilpotent Groups
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Fundamental Theorem of Algebra
- The Fundamental Theorem of Finite Abelian Groups
- The Galois Correspondence
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The ZFC Axioms and the Basic Set Constructions
- Topology of ℝ
- Triangularisation, Generalised Eigenspaces and Jordan Canonical Form
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Logical flowchart
3 · Definitions, theorems and proofs
Finite weighted graph Laplacian
Definition
Let , , and let satisfy and . Define , , and . The support graph has vertex set and edge exactly when ; isolated vertices are singleton connected components. Put , let and be the principal submatrices indexed by , and, only when , define on .
Finite-dimensional trace minimization under orthonormal constraints
Statement
Let be symmetric, let be its real eigenvalues repeated with multiplicity, and define for square . For , The minimum is attained by taking the columns of to be orthonormal eigenvectors for the smallest eigenvalues, counted with multiplicity; when an eigenvalue at the cutoff is repeated, the minimizer need not be unique.
Statement references
Facts & Assumptions
Given: A real symmetric matrix and an integer .
Real spectral theorem: a self-adjoint endomorphism of a finite-dimensional real inner product space has an orthonormal eigenbasis: a self-adjoint endomorphism of a finite-dimensional real inner-product space has an orthonormal eigenbasis.
The smallest and largest eigenvalues of a self-adjoint endomorphism are the minimum and maximum Rayleigh quotients: for a self-adjoint endomorphism with eigenvalues ordered decreasingly, the minimum nonzero-vector Rayleigh quotient is the smallest eigenvalue.
Proof
If , every feasible is a unit column , so . By [F2], its minimum is the smallest eigenvalue, which is in the increasing order of the Statement.
Suppose . By [F1], choose an orthonormal eigenbasis with eigenvalues , and let be the matrix with these columns. For any feasible , put ; then and . Writing for the entries of and , direct expansion of the diagonal sum gives .
The matrix is symmetric and idempotent because . Hence it is the orthogonal projection onto the column space of , and lies in . Also .
Using , subtract the bottom- eigenvalue sum to obtain Every term on the right is nonnegative. Taking gives equality, so the stated minimum is attained. This proves the claim for as well as the case of step 1.1.
Projected coordinate vectors give a deterministic orthonormal basis
Statement
Let , let be a subspace of with its standard inner product, and let be the orthogonal projection onto . Let be the standard coordinate vectors. Start a list with an optional unit vector . For each in order, set , subtract from its orthogonal projections onto the vectors already in the list, discard the residual if it is zero, and otherwise append the residual divided by its Euclidean norm. The resulting list is an orthonormal basis of , beginning with when it is supplied.
Statement references
Facts & Assumptions
Given: A subspace with the standard inner product, its orthogonal projection , the standard coordinate vectors , and an optional unit vector .
The orthogonal projection is the -component in : every vector has a unique decomposition as a component in plus a component in , and is the -component.
Proof
Write . The unique decompositions of two vectors add, and scalar multiples of a decomposition remain decompositions, so uniqueness makes linear. If , its decomposition is , hence . Therefore , and the projected coordinate vectors span .
Start with if supplied, then process in order. Each residual lies in and is orthogonal to every previously accepted orthonormal vector . If , then is already in their span; if , appending preserves orthonormality and the span of all processed vectors. By induction, after the finite scan the accepted list is orthonormal and spans the initial vector together with all . Step 1.1 shows this span is , and the initial unit vector is first when present.
RatioCut and normalized cut for a finite weighted graph
Definition
Let , , and let be symmetric, entrywise nonnegative, and zero-diagonal. Define , , , and . For , put , , and . For a partition of into pairwise disjoint nonempty sets, define For a partition of into pairwise disjoint nonempty sets, each of positive volume, define For these partitions, the RatioCut indicator column is , and the Ncut indicator column is , extended by zero on isolated vertices.
Quadratic form and kernel of a weighted graph Laplacian
Statement
Let with , let be symmetric, nonnegative, and zero-diagonal, let , let , and let the support graph have edge exactly when . For every , Consequently is positive semidefinite and including isolated singleton components.
Statement references
Facts & Assumptions
Given: A finite symmetric nonnegative zero-diagonal weight matrix , its degree matrix , Laplacian , support graph, and an arbitrary vector .
Finite weighted graph Laplacian: , , , and the support graph has edge exactly when .
Proof
By [F1], . Replacing by , using to identify the two square sums, and collecting terms gives .
The displayed sum is nonnegative for every , and is symmetric because both and are symmetric. Therefore is positive semidefinite.
If , then . By step 1.1 this is a finite sum of nonnegative terms, so every term with vanishes and on every support edge. Equality propagates along each finite path, hence is constant on every connected component, including an isolated singleton.
Conversely, suppose is constant on each support component. For each vertex , every with lies in the same component, so . Hence for every , and . The two inclusions give the stated kernel equality.
RatioCut and Ncut as indicator-matrix traces
Statement
Let be as in the finite weighted graph definition. For a square matrix , set . If partition , define by for and otherwise. Then and . If partition , define by for and otherwise. Then and .
Statement references
Facts & Assumptions
Given: A finite weighted graph with symmetric nonnegative zero-diagonal , degree matrix , Laplacian , and either a partition of all vertices or a partition of its positive-degree vertices.
Finite weighted graph Laplacian: , , and .
RatioCut and normalized cut for a finite weighted graph: , , RatioCut divides each cut by , Ncut divides it by , and the indicator columns are normalized by or respectively.
Quadratic form and kernel of a weighted graph Laplacian: for every real vector .
Proof
The supports of distinct RatioCut indicator columns are disjoint, and each column has entries equal to . Thus each column has squared norm and distinct columns have inner product , so .
The supports of distinct Ncut indicator columns are disjoint, and . Distinct columns have -inner product , so .
By [F3], the energy of a RatioCut indicator column is . Terms with both indices inside or both outside vanish. Each ordered crossing pair has squared difference ; symmetry makes the two directed crossing sums equal, so the factor leaves .
For a Ncut indicator column the same finite energy sum has zero terms except across and its complement, and each crossing squared difference is . Pairing the two equal directed sums gives .
By the stated trace definition, and . Summing steps 1.3 and 1.4 gives the RatioCut and Ncut identities, while steps 1.1 and 1.2 give their respective indicator constraints.
Weighted RatioCut and Ncut spectral relaxations
Statement
Let , , and let be symmetric, entrywise nonnegative, and zero-diagonal. Put , , , and . If , let and be the principal submatrices indexed by and set . The matrices and, when defined, are positive semidefinite. For square , define . For , let be the minimum of over partitions of into nonempty sets. Then where the eigenvalues, repeated with multiplicity, are ordered increasingly, and a minimizer consists of orthonormal eigenvectors for the smallest eigenvalues. This relaxed minimum is a lower bound for . When , let be the minimum of over partitions of into nonempty sets. Then attained at for bottom- orthonormal eigenvectors of . The corresponding columns satisfy , and the relaxed minimum is a lower bound for . These lower bounds make no approximation guarantee for a subsequent rounding. Isolated vertices are excluded from the Ncut objective and may be reported separately as singleton outputs.
Statement references
Facts & Assumptions
Given: A finite weighted graph with , zero diagonal, , , positive-degree set , and an integer in the admissible range for the partition objective under consideration.
Finite weighted graph Laplacian: , , , and on when it is nonempty.
RatioCut and normalized cut for a finite weighted graph: RatioCut partitions all of and sums ; Ncut partitions only and sums .
Quadratic form and kernel of a weighted graph Laplacian: is positive semidefinite and .
RatioCut and Ncut as indicator-matrix traces: RatioCut partitions yield and ; positive-volume Ncut partitions yield and .
Finite-dimensional trace minimization under orthonormal constraints: for a real symmetric matrix , the minimum of over is the sum of its smallest eigenvalues, attained by bottom- orthonormal eigenvectors.
Proof
By [F1] and [F3], is symmetric positive semidefinite. If , extend it by zero on isolates to ; then , so is positive semidefinite. Since is a real diagonal matrix, . Thus both Laplacians in the Statement are positive semidefinite.
For every partition of into nonempty sets, [F4] supplies a feasible for the real constraint with trace equal to that partition's RatioCut. The relaxed feasible set therefore contains every discrete indicator matrix, so the infimum over the relaxed feasible set is at most the minimum over the finite nonempty family of partitions.
Let partition . By [F4], their normalized indicators, restricted to , satisfy and have trace objective equal to Ncut. Indeed, if is isolated then and with forces every , so row and column of vanish; extending by zero on isolates leaves the active trace unchanged. Thus the active real feasible set contains every discrete Ncut indicator, and the infimum over the active real feasible set is at most .
The matrix is real symmetric by [F1]. Applying [F5] with gives , attained by orthonormal eigenvectors for the smallest eigenvalues. Together with step 1.2 this is the claimed RatioCut lower bound.
The diagonal entries of are strictly positive, so is a bijection from to . It also gives . Applying [F5] to gives the stated Ncut relaxed minimum and optimizer ; with step 1.3 this is the claimed lower bound.
If and , multiplying by gives . Conversely, if , then satisfies . Thus the symmetric normalized problem is equivalent to the generalized eigenproblem stated.
Every Ncut part is a nonempty subset of , so its volume is positive; an isolate has zero volume but is excluded from and can only be reinserted as a separately reported singleton. Steps 1.2, 1.3, 2.1, and 2.2 compare feasible sets and compute the lower bounds; they do not bound the RatioCut or Ncut value after an arbitrary rounding.
Deterministic weighted spectral clustering with explicit isolate and eigenspace conventions
Definition
Inputs. Integers , data , a fixed deterministic graph-construction procedure , mode or , and cluster count . In normalized mode also supply a Boolean row-normalization option, defaulting to false.
-
Compute . Reject the input unless is symmetric, entrywise nonnegative, and zero-diagonal. Set , , , and .
-
In ratio mode require , use all vertices in increasing index order, and set . In normalized mode, if , return every vertex as a separately reported singleton with status . Otherwise require , use only in increasing index order, and set .
-
Compute the exact real eigenspaces of and order its eigenvalues increasingly with multiplicity. For each eigenspace , use the deterministic projected-coordinate basis rule: for , first use in ratio mode or in normalized mode; then process the standard coordinate vectors in vertex order, project each onto , orthogonalize against accepted vectors, skip zero residuals, and normalize each nonzero residual. Take the first eigenvectors as columns of .
-
In normalized mode, if row normalization is true, replace each row by , where . The prescribed first zero-mode vector has positive entries on every active vertex, so every active row norm is positive.
-
Treat the rows of as points in with Euclidean distance . Initialize the first Lloyd center at the row whose vertex index is smallest among the vertices selected in Step 2. For each subsequent center, choose an unused row maximizing its minimum distance to previously chosen centers, breaking ties by smallest vertex index. Assign each row initially to a nearest center, breaking ties by smallest center index. At each later assignment retain its current label when it is among the nearest centers; otherwise choose the smallest nearest-center index. Replace each nonempty center by the mean of its assigned rows, leave empty-cluster centers unchanged, and repeat until both labels and centers stop changing.
-
Return the nonempty label sets. In normalized mode append every isolate as a separately reported singleton. Graph rule, edge weights, bandwidth, kNN symmetrization, and cluster count are modeling inputs; this procedure makes no rounding, approximation, graph-consistency, or manifold-recovery guarantee.
Definition references
Finite weighted graph Laplacian
RatioCut and normalized cut for a finite weighted graph
Quadratic form and kernel of a weighted graph Laplacian
Weighted RatioCut and Ncut spectral relaxations
Lloyd's k-means algorithm with explicit tie handling
Lloyd iteration is objective-decreasing and terminates
Projected coordinate vectors give a deterministic orthonormal basis
Ulrike von Luxburg, A Tutorial on Spectral Clustering, Statistics and Computing 17(4), 2007
4 · Examples, counterexamples and false statements
None yet.
Sources
- Ulrike von Luxburg, A Tutorial on Spectral Clustering, Statistics and Computing 17(4), 2007
- Jean Gallier, Notes on Elementary Spectral Graph Theory: Applications to Graph Clustering Using Normalized Cuts, 2013
- Trevor Hastie, Robert Tibshirani, and Jerome Friedman, The Elements of Statistical Learning, 2nd ed., corrected 12th printing