How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Sparse direct elimination and ordering
1 · Prerequisites
- Binary Operations, Monoids, Groups and Subgroups
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Determinants of Matrices over a Commutative Ring
- Direct Matrix Factorisations: LU, Cholesky and QR
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Finite Counting, Factorials and Binomial Coefficients
- Finite-precision direct factorizations and least squares
- Foundations of the Real Numbers for Analysis
- Group Actions, Orbits, Stabilisers and Cayley's Theorem
- Hilbert Space Geometry and Riesz Representation
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Matrices, the Matrix of a Linear Map, and Change of Basis
- Matrix Norms, Condition Numbers and Numerical Stability
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Polynomial Rings, the Division Algorithm and Roots
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Roots, Rational Powers, and Classical Inequalities
- Sequences and Limits
- Series: Convergence and the Nonnegative Tests
- Simple Field Extensions and the Construction of the Complex Numbers
- Sparse matrix models and kernel costs
- Suprema and Infima
- Symmetric Groups, Cycle Decomposition and the Sign Homomorphism
- The Determinant of a Linear Operator, Cofactors and Cramer's Rule
- The Spectral Theorem, Positive Operators and Singular Value Decomposition
- The ZFC Axioms and the Basic Set Constructions
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
This page builds on the structural graph, ordering, filled graph, and elimination-forest interfaces owned by the sparse-matrix-models-and-kernel-costs page. It defines the Cholesky column patterns and elimination-tree reach needed locally, proves the path characterization used to confine nested-dissection fronts, and derives work and factor-storage bounds for the two- and three-dimensional nearest-neighbor grids. The stated grid bounds do not extend to arbitrary graphs.
Threshold LU and symmetric-indefinite block LDL* carry explicit pivot, fill, and failure rules. The real threshold-LU residual bound retains the actual active-matrix growth. The block LDL* result retains its general conditional local-update statement and now instantiates it with a proved complex real-component kernel, actual amplification and block inverse norms. No universal small-growth guarantee is asserted.
The Hermitian block LDL* branch includes a certified one-by-one/two-by-two real-component kernel, explicit normalized-determinant conditioning and pivot-inconclusive status, and proved local unit-roundoff bounds. Actual stored factors use the complete reconstruction residual, including multiplier coupling errors, with their actual transformation growth. The exact-multiplier conditional bound remains available separately.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Threshold partial-pivot sparse LU with explicit fill and failure statuses
Definition
Input a nonsingular real matrix with , an initial simultaneous row-and-column permutation matrix under the row-action convention of Permutation matrices, partial pivoting, and the pivot-growth factor, and a threshold . Choose the exact-arithmetic branch or the finite-precision branch. In the latter, additionally supply a format from Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add; the entries of must already be stored values in that format, with no input conversion. The exact-arithmetic branch permits arbitrary real entries and evaluates every scalar operation exactly, without finite-format range restrictions. Initialize the active matrix by permuted copies, the accumulated row permutation , the unit lower-triangular factor , and the upper-triangular factor . Treat an unstored active entry as zero. In finite precision every real scalar operation uses the supplied model; if an exact intermediate is nonzero and subnormal, overflows, or the operation reports range failure, return range-failure with its stage. Pivot tests and tie-breaking comparisons are exact guards on current values. For , ties for a maximum are resolved by choosing the smallest current row index.
At stage , let . If , return singular-pivot. If , select row ; otherwise select the smallest row attaining . If , swap rows and of the active matrix and the already stored entries in columns of those rows of . Also replace by , where is the permutation matrix swapping rows and . Do not change the previously stored rows of . If the selected pivot is zero, return singular-pivot.
Save the active pivot row by setting for every ; entries with remain zero. Set for every , interpreting a missing as zero. For every , update In a sparse representation it suffices to visit positions where or ; missing entries in this formula are zero. Allocate any position whose rounded update is nonzero; this is numerical fill. If an arithmetic operation is not representable or reports a range error, return range-failure with its stage. Any failure return is a status only and asserts no factorization. On success return . In exact arithmetic the updates give ; the procedure makes no claim of a universal fill or growth bound.
Undirected structural graph of a Hermitian matrix
Definition
Let satisfy , where . Define a real symmetric pattern matrix by and, for , set exactly when ; otherwise set both entries to zero. Since , this pattern records exactly the undirected off-diagonal support of .
Apply the graph and elimination-ordering convention of Structural graphs and ordered symmetric elimination to . Its structural graph is the Hermitian structural graph of , and its filled graphs are the symbolic pattern used for Hermitian elimination. The real matrix records only support; numerical Schur complements are formed from .
Recursive coordinate-separator ordering for two- and three-dimensional grids
Definition
Input an integer and dimension . The coordinate vertices are . Identify them with the zero-based matrix indices by the lexicographic bijection . The grid graph has an edge between two coordinate vertices exactly when they differ by in one coordinate and agree in all others. Use the graph and ordering conventions of Structural graphs and ordered symmetric elimination on these indices. Thus gives the five-point graph and the seven-point graph.
Order a rectangular coordinate subbox recursively as follows. For each coordinate whose side length is at least , choose its lower median coordinate, namely the coordinate with positions below it in a side of length . Let be the union of the coordinate hyperplanes at those selected medians. Delete , obtaining at most nonempty rectangular child boxes. Recursively order the child boxes in lexicographic order of their lower corners, then append the vertices of in lexicographic order. If no coordinate has side length at least , append the remaining vertex as a terminal separator. Apply this rule first to the whole grid. The resulting order is the coordinate nested-dissection ordering.
The recursion uses only the graph geometry. It makes no fill or complexity claim for arbitrary graphs.
Filled edges are witnessed by paths through earlier eliminated vertices
Statement
Use the zero-based graph and ordering of Structural graphs and ordered symmetric elimination. For distinct remaining vertices , the pair is an edge of if and only if the original graph contains a finite walk from to all of whose internal vertices belong to . A walk may repeat vertices; its internal vertices are the entries other than its two endpoints.
Facts & Assumptions
Given: A finite simple graph, an elimination ordering, and the filled graphs defined by the supplier.
Structural graphs and ordered symmetric elimination: At step , delete , retain edges between remaining vertices, and add every pair of distinct later neighbors of .
Proof
At , a walk with no internal vertices consists of one edge, so the claimed equivalence is exactly the definition of .
Suppose the equivalence holds at stage . A retained edge in already has a witnessing walk whose internal vertices are among . An edge newly added at step joins two vertices that are each adjacent to in . The induction hypothesis gives walks from to and from to with internal vertices among ; concatenating them gives the required walk with the additional internal vertex . This proves the forward implication at stage .
Conversely, let a witnessing walk from to have internal vertices among . If it has no internal occurrence of , the induction hypothesis gives an edge in , which is retained. Otherwise take the first and last internal occurrences of . The initial subwalk from to the first occurrence and the terminal subwalk from the last occurrence to have all internal vertices among . By induction, and are both later neighbors of in . Since , the update inserts in .
The base case and steps 1.2 and 2.1 prove both implications for every stage by induction on .
Real threshold sparse LU has a backward residual bound with actual growth
Statement
Let be nonsingular, , and run Threshold partial-pivot sparse LU with explicit fill and failure statuses with . Assume a successful run under the real operation model of Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add, with unit roundoff and every exact intermediate either zero or normal. Let , let be the active matrix at stage including its current pivot row, and define the actual growth of this run by
For its computed factors and accumulated row permutation, there is a residual such that The bound retains this run's actual growth and makes no uniform small-growth claim. This residual theorem is for real arithmetic; the local operation model used here does not specify a general complex division primitive.
Facts & Assumptions
Given: A successful real threshold-pivoted elimination run, the stated real relative operation model, and the no-range-failure hypothesis.
Threshold partial-pivot sparse LU with explicit fill and failure statuses: At stage , use the diagonal only if its modulus is at least times the active column maximum; otherwise swap a maximum-modulus row into the pivot position. The algorithm swaps previously stored entries of the same rows of and updates each active entry by one product and one subtraction.
Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add: Each real add, subtract, multiply, or divide is one rounded operation; on a successful in-range real operation, the computed result is the exact result times with , and exact zero is returned exactly.
Proof
The initial active matrix is , whose entrywise maximum is because only permutes rows and columns; hence . Let and at a successful pivot. If the diagonal is accepted, [F1] gives . If a maximum-modulus entry is selected, . The rounded division therefore gives . Also every pivot-row entry and every active entry has modulus at most .
For a trailing update, write and . Define . By [F2], The triangle inequality and yield using and .
For a computed multiplier, , so [F2] gives a division residual with .
Track each active row together with its previously stored entries of and its accumulated update residuals. Before stage , for every active row and active column , maintain where is the row permutation accumulated so far. At this is . Swapping two active rows also swaps their earlier entries and residual histories, so it preserves the invariant. After the pivot, ; each lower-row update is , so substitution gives the same invariant at stage . For the pivot column, by definition of the division residual. Thus after all stages, for , and for , These identities define . Each entry contains at most update residuals and at most one division residual.
By steps 2.1–2.2, every residual entry is bounded by since and . Summing at most such bounds in any row gives .
The definition of in step 3.1 gives the displayed nearby-factorization identity, and step 4.1 gives both residual bounds. The only growth quantity in the estimate is the maximum active-entry magnitude of this executed run.
Elimination-tree column patterns and reach
Definition
Let satisfy , use the Hermitian structural graph of Undirected structural graph of a Hermitian matrix, and fix an elimination ordering of its vertices. For this chosen ordering, construct the filled graphs, parent map, and elimination forest by Structural graphs and ordered symmetric elimination. All column sets, counts, ancestors, descendants, and reaches below are relative to . For each , let be the later-neighbor set at elimination of , and define its structural column set Its off-diagonal size is the column count . An ancestor of is obtained by following one or more supplied parent edges; a descendant is the inverse relation. The reach of is the set of vertices visited by following its parent path, including .
Nested-dissection grid fronts are bounded by a box separator and its exterior boundary
Statement
Let and use the coordinate grid and recursive ordering of Recursive coordinate-separator ordering for two- and three-dimensional grids. For a recursion box , let be its median separator; for the terminal one-vertex box take . Let be the set of grid vertices outside adjacent to some vertex of . If , then every later filled neighbor of lies in . If every side of has length at most , then
Facts & Assumptions
Given: The finite nearest-neighbor grid, the recursive coordinate-separator order, and its symbolic elimination graph.
Recursive coordinate-separator ordering for two- and three-dimensional grids: Each box orders all child boxes before its separator; the separator is the union of its selected coordinate hyperplanes, and removing it leaves the child boxes.
Filled edges are witnessed by paths through earlier eliminated vertices: A filled edge at the elimination of is witnessed by an original grid walk whose internal vertices were eliminated before .
Structural graphs and ordered symmetric elimination: The vertices of each filled graph are exactly those not yet eliminated, and the ordering position strictly increases from a vertex to any later neighbor.
Proof
The root box has empty exterior boundary. If is a child of a box , every grid neighbor just outside is either in or just outside : distinct child boxes are separated by the removed coordinate hyperplanes. Thus . Induction up the finite recursion tree, using that each ancestor separator is ordered after all vertices in its child boxes by [F1], shows that every vertex of is ordered after every vertex of .
Fix and a later filled neighbor . If , then cannot lie in a child box because every child is ordered before ; hence . If , [F2] gives an original grid walk from to whose internal vertices were eliminated before . The first vertex of this walk outside lies in and, by step 1.1, is ordered after . It therefore cannot be an internal vertex of the walk, so it must be its endpoint . Hence .
If the side lengths of are , each of its at most coordinate hyperplanes contains at most vertices, so . The exterior grid neighbors lie across the faces, each with at most vertices, so . The containment in step 2.1 therefore gives the stated column-size bound.
Steps 2.1 and 3.1 establish both the filled-neighbor containment and its numerical bound for every separator vertex, including the terminal one-vertex case.
Hermitian Schur-complement support stays inside the symmetric filled graph
Statement
Let be Hermitian and use the Hermitian structural graph adapter of Undirected structural graph of a Hermitian matrix. Fix an ordering and suppose each scalar pivot is nonzero. Form the Hermitian Schur updates Then every is Hermitian, every nonzero off-diagonal entry of is an edge of the corresponding filled graph, and the later neighbors of every eliminated vertex form a clique in the next filled graph.
Facts & Assumptions
Given: A Hermitian matrix, an ordering, nonzero scalar pivots, and the displayed Schur update.
Undirected structural graph of a Hermitian matrix: The undirected graph has edge exactly when the Hermitian matrix has a nonzero off-diagonal entry in that pair.
Structural graphs and ordered symmetric elimination: At each step the graph deletes the pivot, retains all edges between remaining vertices, and adds every edge between distinct later neighbors of the pivot.
A field has no zero divisors: or : In a field, a nonzero product has every factor nonzero.
is a field, every element is uniquely , and every nonzero element has inverse : The complex numbers form a field containing ; for , .
Proof
At stage , is Hermitian. If is Hermitian, then its diagonal pivot is real. Since it is nonzero, substituting in [F4] gives ; the denominator is nonzero by [F3]. For remaining , Thus the update preserves Hermitian symmetry.
By [F2], the graph update itself joins every pair of distinct later neighbors of . Thus each such later-neighbor set is a clique in the next filled graph.
Induct on the elimination stage for support. Initially every nonzero upper-triangular entry is an edge by [F1]. Suppose the inclusion holds at stage and for . If , its edge is retained by [F2]. Otherwise the correction term is nonzero. Since is a field by [F4], applying [F3] to and then to shows that and . Hermitian symmetry from step 1.1 gives the undirected edges from to and from to in the active graph. Hence both vertices are later neighbors of , and [F2] inserts . This proves the support inclusion at stage .
The base case and step 2.1 prove the support inclusion at every stage; step 1.2 proves the clique property. The proof uses conjugate symmetry for Hermitian matrices and therefore supplies the complex-Hermitian extension beyond the real-symmetric supplier theorem.
Sparse symmetric-indefinite block LDL* with threshold tests and failure status
Definition
The exact-arithmetic branch is specified first; the finite-precision branch below implements the same declared pivots by certified real-component kernels. Input a Hermitian , an ordering and its simultaneous permutation matrix in the convention of Permutation matrices, partial pivoting, and the pivot-growth factor, an ordered partition of all permuted positions into consecutive blocks of size or , and a threshold . The partition is exhaustive and disjoint; for it is empty and is the unique empty permutation matrix (the extension of the referenced row convention to dimension zero). Apply once and initialize the exact active matrix , , and the block-diagonal output array . Scalar complex absolute values mean exact complex moduli; below means entrywise absolute value, and vector inequalities are componentwise. Form the structural graph from Undirected structural graph of a Hermitian matrix, then relabel its vertex by ordered position ; use the graph and fill convention of Structural graphs and ordered symmetric elimination on this position-labeled graph. At stage , let be the next declared block, which is the leading active block, and let be the remaining positions after . Write the current active matrix as with the blocks indexed by . For a block , write and require and For a block , is the Hermitian principal block Require , and let and , with an empty maximum equal to zero. Accept the pair only if componentwise, where scalar absolute values are complex moduli. If a declared block fails its test, return pivot-failure.
For each accepted block in the exact branch, compute , store in the block of and in the block of , and update the active trailing matrix to . In the symbolic graph, let be the union of the active graph neighbors of the vertices in , restricted to ; remove and connect every pair of distinct vertices in . Retain all positions allowed by this symbolic update, including positions whose current numerical value is zero. If a block fails its test, return pivot-failure with no factor arrays. On completion return the stored arrays , including the empty arrays in dimension zero. The exact branch makes no universal growth bound.
For the finite-precision branch, additionally supply the kernel's floating-point format with unit roundoff and a nonnegative integer certificate budget for each declared block. The input entries must be stored values in that format. In this branch, independently initialize the stored active matrix , , and . At each declared block call Certified real-component Hermitian one-by-one and two-by-two LDL* kernels on with threshold , unit roundoff , a fresh controller budget , and the same symbolic block-neighbor clique. Budgets are local to their calls; unused units do not carry to another stage. On kernel success, store its returned pivot in the block of , store in the block of , and continue on its Hermitian . On any kernel failure, return its range-failure, pivot-failure or pivot-inconclusive status together with the outer stage index ; discard scratch data for that block and return no factor arrays. On completion return together with its pivot certificates. Only certified admissible blocks are accepted; unresolved determinant or threshold tests are inconclusive. No general complex division, automatic pivot existence or universal factor-growth guarantee is assumed.
Remarks
Block LDL* residual errors propagate with actual block growth ↗ proves that a successful exact-arithmetic run returns a unit lower block-triangular and block-diagonal with , including the empty case. Its proof derives the block congruence directly from the update instructions; the identity is a correctness result, not an additional instruction.
Every later filled neighbor lies on the elimination-tree parent path
Statement
Let be a vertex in the elimination forest supplied by Elimination-tree column patterns and reach. Every later filled neighbor of lies on its parent path and is therefore an ancestor. Consequently, if is a child of , then every later neighbor of other than is a later neighbor of ; equivalently,
Facts & Assumptions
Given: The zero-based ordered vertices, filled graphs, and parent forest from batch-2's graph definition.
Elimination-tree column patterns and reach: , and reach follows the supplied parent path.
Structural graphs and ordered symmetric elimination: The parent is the later neighbor with least position greater than the child's position.
Structural graphs and ordered symmetric elimination: The graph update adds every edge between two distinct vertices in the pivot's later-neighbor set.
Proof
Fix and a later filled neighbor . If is the parent, it is an ancestor by definition. Otherwise let be the parent. By [F2], . Since and are both later neighbors of , [F3] inserts when is eliminated. Thus remains a later neighbor of .
Now let be a child of . Every later neighbor of is either or is later than . In the latter case both and are later neighbors of , so [F3] joins them in the filled graph. Thus every element of belongs to .
If is not the parent of , replace by and repeat. At each repetition the ordering position strictly increases and is at most , because the current vertex remains adjacent to and its parent is the earliest later neighbor. The finite increasing sequence must reach position ; it cannot stop earlier at a root while still having later neighbor . Hence lies on the parent path from and is an ancestor.
Step 2.1 proves the ancestor assertion, and step 1.2 gives the child-column containment used to assemble fronts.
Ordered sparse Cholesky with explicit pivot and range statuses
Definition
Input a Hermitian positive-definite in the convention of Hermitian positive-definite matrices and Cholesky factorisation A = LL* with positive diagonal, its Hermitian structural graph from Undirected structural graph of a Hermitian matrix, and an ordering . Use the operation model of Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add. Let be the permutation matrix whose row is row of , so the ordered matrix is and . Relabel the filled graph on the original vertices by positions: exactly when is an edge of the filled graph. In every displayed sum, accumulate in increasing from left to right.
Preallocate only the diagonal and lower-triangular positions permitted by . The support guarantee for complex Hermitian Schur complements is proved in Hermitian Schur-complement support stays inside the symmetric filled graph. Initialize those positions from the lower triangle of , using zero where a position is not present in the original pattern. For , perform these instructions:
- Compute using only already computed entries, with an empty sum equal to zero. If an operation reports range failure, return range-failure. If is not a finite positive real number, return invalid-pivot.
- Set . If the square root is not finite and positive, return range-failure.
- For each such that , compute If an operation reports range failure, return range-failure. Set structurally absent entries to zero.
If all columns finish, return success. In exact arithmetic, the intended factor convention is with lower triangular and positive real diagonal. The finite-arithmetic procedure makes no claim that every positive-definite input returns success: a rounded pivot can fail the stated test.
Block LDL* residual errors propagate with actual block growth
Statement
Consider a successful run of Sparse symmetric-indefinite block LDL* with threshold tests and failure status on a Hermitian input with its declared permutation and fixed pivot-block sequence. In every formula, is the operator norm induced by the Euclidean inner products. At stage , write the active matrix as Suppose the computed trailing block is where is the exact local update residual. Embed it into the full permuted coordinates as , with zeros on all previously eliminated and current pivot indices. Let be the identity on previously eliminated coordinates and the padded unit lower block elimination matrix on the current pivot and trailing coordinates. Set and for . Then provided the actual local residuals satisfy Here is the product of the exact-multiplier transformations , not a rounded stored multiplier factor. For a nonempty run, is the actual amplification from this pivot sequence. For an empty pivot partition set ; all stage sums are then zero. The trailing-only statement is conditional in this general form. For the specified kernel, Hermitian block LDL* kernels have explicit roundoff and actual-factor residual bounds proves it with , retaining the actual normalized-determinant and range certificates. It makes no uniform smallness claim for , , or .
In exact arithmetic every accepted block is nonsingular and each update has , so a successful run returns .
For the actual rounded output, let be the transformation built from stored , padded by the identity on previously eliminated coordinates. Let be the reconstruction residual from the local kernel lemma, and define by embedding into the current pivot and trailing coordinates, with zero rows and columns on all previously eliminated indices. Set and . Then where is the proved explicit local bound. For a nonempty run set , and for an empty pivot partition set . This includes multiplier coupling residuals as well as trailing updates. Neither actual growth nor inverse-pivot conditioning is assumed uniformly small.
Facts & Assumptions
Given: A successful sequence of Hermitian or pivots, the actual local update residuals , and the displayed local error bounds.
Sparse symmetric-indefinite block LDL* with threshold tests and failure status: The declared permutation is applied once; each accepted pivot block is Hermitian and nonsingular, and the exact trailing update is .
The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv||: For a linear map between finite-dimensional inner-product spaces, the operator norm is the maximum of over unit vectors (and is zero on the zero domain).
For each stage , the computed trailing block is and .
Hermitian block LDL* kernels have explicit roundoff and actual-factor residual bounds proves the concrete local trailing residual, exact pivot acceptance, and full stored-multiplier reconstruction residual.
Proof
For each accepted block, is invertible by its pivot test. Direct block multiplication gives with the right-hand side an ordinary matrix product. Thus in exact arithmetic each elimination step is a valid Hermitian congruence. In the increasing-stage product , the earlier factors act as the identity on columns supported on the still-active coordinates, so multiplication by inserts precisely the stored multiplier columns for . The product is therefore the stored unit lower block-triangular , and completion gives with block-diagonal ; empty products give the empty identity.
With a computed update, the middle trailing block differs by . Hence the reconstructed active matrix at stage differs from the block factorization with by the embedded matrix whose only nonzero block is in the trailing coordinates.
Substitute the next-stage factorization into the trailing block of step 1.2. The local residual from stage is conjugated by the padded stage- lower elimination transformation. Repeated substitution therefore yields After one stage this is step 1.2. Replacing the next trailing block adds ; each later substitution adds the next embedded residual conjugated by all preceding . Induction on the number of processed pivot blocks gives exactly and the displayed identity.
For any compatible maps , [F2] gives , so . If is the zero-padded trailing block , then , hence . Also : express the Euclidean norm as by Cauchy-Schwarz and take the two finite unit-vector suprema in either order. These inequalities and the triangle inequality bound each summand in step 2.1 by and give the first asserted bound.
Apply [A1] to each in step 3.1 and use . Summing gives the second bound. Since every is invertible but may be ill-conditioned and the transformation products may grow, no universal stability constant follows.
For each accepted concrete kernel apply [F3]. Its supplies [A1], so steps 1.1, 1.2, 2.1, 3.1, and 4.1 give the claimed trailing-only estimate for the conceptual . For actual stored multipliers, let be the active block of . Then [F3] gives the active identity , including the off-diagonal residual . Padding this identity uses as defined above; zero-padding preserves its operator norm, so .
Substitute the next active identity into the previous trailing block. After one stage the reconstruction residual is ; each additional stage adds its padded conjugated by all preceding stored-multiplier transformations. Induction gives . The same submultiplicativity from step 3.1 and [F3] give the actual-growth bound. In exact arithmetic every local multiplier and Schur residual is zero, recovering the original exact factorization.
Ordered sparse Cholesky has the symbolic filled pattern when no cancellation occurs
Statement
Let be Hermitian positive definite and use its pattern from Undirected structural graph of a Hermitian matrix. The local Hermitian Schur-support lemma Hermitian Schur-complement support stays inside the symmetric filled graph applies. In exact arithmetic, the Cholesky recurrence in Ordered sparse Cholesky with explicit pivot and range statuses returns the unique factor satisfying and positive diagonal, and every nonzero strict-lower entry of is permitted by the filled graph .
For with (where ordered position represents original vertex ), define the recurrence numerator If at every permitted strict-lower position, then the numerical nonzero pattern of is exactly the lower-triangular part of together with its diagonal. Without this no-cancellation hypothesis only the upper-pattern inclusion is asserted.
Facts & Assumptions
Given: A Hermitian positive-definite matrix , the stated batch-2 graph/ordering interface, and its Schur-support hypothesis.
Ordered sparse Cholesky with explicit pivot and range statuses: The permutation matrix has row equal to row of , and the exact algorithm uses , , and on filled positions.
Hermitian Schur-complement support stays inside the symmetric filled graph: With nonzero scalar pivots, each Hermitian Schur complement is supported inside the Hermitian filled graph.
A matrix admits a Cholesky factorisation with positive diagonal exactly when it is Hermitian positive definite, and that factor is unique: A Hermitian positive-definite matrix has a unique factorization with lower triangular and positive real diagonal.
Proof
A permutation preserves positive definiteness: for , and . Thus [F3] gives a unique exact Cholesky factor of .
Independently of the sparse algorithm, define dense active matrices on by . Since and is lower triangular, and for . Subtracting gives . Thus these are precisely the dense Hermitian Schur updates starting from , with every pivot nonzero, without assuming anything about the sparse output.
Apply [F2] to the dense Schur sequence from step 2.1, using original vertex labels for ordered positions . If with , it is absent from the active filled graph at stage , so . As and , this forces . Hence the dense factor already has the required structural support, before it is compared with the sparse recurrence.
Induct on the sparse column index , with no preceding columns at . Assume for all . By step 2.1 the pivot recurrence in [F1] gives and . On every permitted position its numerator is , so the computed equals . On an omitted position the algorithm sets , which equals by step 3.1. This completes the induction, proving and success at every exact pivot.
At each permitted strict-lower position, the recurrence gives and step 4.1 gives . Hence implies . Under the stated no-cancellation condition every permitted position is nonzero; together with step 3.1 and this gives equality of patterns.
Step 4.1 establishes that the exact algorithm returns the unique Cholesky factor; step 3.1 proves the structural upper pattern in the complex Hermitian case; step 5.1 proves equality under the no-cancellation hypothesis. No finite-precision success or stability claim follows from this exact-arithmetic theorem.
Scalar multifrontal Cholesky and solves on the elimination forest
Definition
Input a Hermitian positive-definite matrix with , its Hermitian structural graph from Undirected structural graph of a Hermitian matrix, and an ordering . Let be the permutation matrix whose row is row of , and put . Use the filled graph and parent forest of Structural graphs and ordered symmetric elimination and the column patterns of Elimination-tree column patterns and reach. For each original vertex , let its front index set be where is its later-neighbor set in the filled graph. Assign each nonzero off-diagonal matrix entry and each diagonal entry once to the front of the endpoint eliminated first (the diagonal goes to its own front); zero off-diagonal entries need no assignment. Treat front arrays as indexed by original-vertex labels, but store the factor in ordered coordinates of : for , its factor entry is , where is the ordering position. Initialize to zero on ordered diagonal and lower-triangular positions, allocating every position permitted by the filled column pattern, including structural zeros. Use the operation model of Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add for all finite arithmetic, including contribution assembly and solves. A range failure during assembly, factorization or solving returns range-failure with the current position.
Traverse fronts in increasing pivot position (every child has smaller position than its parent). At front , initialize a zero dense Hermitian array indexed by and add the entries assigned to . Process the children in increasing pivot position ; for each child, add its stored contribution array to the entries whose indices lie in , using the common original-vertex labels. The inclusion needed for this addition is supplied by Every later filled neighbor lies on the elimination-tree parent path. For the pivot , let . If it is not finite and positive, return invalid-pivot; otherwise compute and, for each later position with , compute in increasing . Apply Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add to each operation and return range-failure at the first range error. Store the computed diagonal and all entries in the preallocated slots. For lower-triangular trailing positions with later positions and , in increasing order, update ; set the Hermitian counterpart by conjugation and keep the diagonal real. Send the trailing contribution array to the parent; at a root discard only the empty final remainder. A failed pivot or range operation stops the factorization with its indexed status. These scalar steps have the same exact pivot and Schur update as Ordered sparse Cholesky with explicit pivot and range statuses.
After a successful factorization, input a right-hand side and use these solve instructions:
- Set .
- For , divide by , then for every stored with in increasing set .
- For , set , accumulating the sum from left to right in increasing , using the backward-substitution convention of Forward and backward substitution for triangular linear systems.
- Return .
The factorization returns either or a pivot/range status. The solve returns the computed vector or range-failure with the current position. The solve arithmetic uses the declared finite-precision model; no exact-solution or finite-precision error guarantee is asserted here.
Scalar multifrontal elimination is equivalent to sparse Cholesky with column-count costs
Statement
Assume exact arithmetic, a Hermitian positive-definite , and a successful ordered factorization using Scalar multifrontal Cholesky and solves on the elimination forest. The fronts and contribution arrays give the same Cholesky factor as scalar elimination in ordering . With , the arithmetic work for assembly and scalar front updates is the symbolic factor allocation has exactly positions, and each forward/back substitution solve uses scalar operations. These are arithmetic and factor-storage counts; they are not wall-clock or total workspace bounds.
Facts & Assumptions
Given: A Hermitian positive-definite matrix, an ordering, its filled graph and elimination forest, and exact-arithmetic multifrontal execution.
Scalar multifrontal Cholesky and solves on the elimination forest: Each nonzero off-diagonal entry and each diagonal entry is assigned once to its earliest endpoint's front; each front adds child contribution arrays, eliminates its one pivot by a Schur update, and retains every permitted symbolic factor slot.
Every later filled neighbor lies on the elimination-tree parent path: For a child of , .
Every later filled neighbor lies on the elimination-tree parent path: Every later filled neighbor of a vertex lies on its parent path, so vertices in distinct descendant branches cannot have a filled edge.
Forward and backward substitution are correct, unique, and quadratic in scalar operations: Forward and backward substitution solve nonsingular triangular systems uniquely by the row recurrences stated in that theorem.
A matrix admits a Cholesky factorisation with positive diagonal exactly when it is Hermitian positive definite, and that factor is unique: Every Hermitian positive-definite matrix has an exact Cholesky factor with positive diagonal, hence is nonsingular.
Proof
For each vertex , let be its subtree in the elimination forest and let . Define the local matrix for on to contain exactly the original entries assigned to fronts in ; its block is zero, since entries wholly within are assigned to later fronts. If and had an original edge, then either is earlier than , making a later filled neighbor and ancestor of , which would put in , or is later than , making a later filled neighbor and ancestor of . In the latter case, repeated application of the child-column containment in [F2] from up to puts in ; since and , it belongs to . Both cases contradict the choice of by [F2,F3]. The induction invariant is that the returned array is the Schur contribution on after eliminating from this local matrix. If is a leaf, every entry assigned to its front has at least one endpoint , so its initialized front is exactly this local matrix, with zero external-external block. The scalar update therefore returns its Schur contribution.
Let have children . By [F2], each child interface lies in , so every extend-add is defined. By [F3], there is no original matrix coupling between interiors of distinct child subtrees: such an edge would make its later endpoint a filled neighbor outside the earlier endpoint's parent path. Form the local matrix on the union of those child interiors and , using only original entries assigned to these child subtrees or to and leaving entries wholly in zero. Its child-interior block is , and its coupling to the current front is partitioned by child subtree. Each is a principal submatrix of the positive-definite , so it is positive definite; [F5] gives a Cholesky factor with positive diagonal and therefore shows is nonsingular. Its Schur complement on the current front is . The correction is exactly the sum of child contributions by the induction invariant; adding them to the entries assigned to assembles this same local Schur complement. The pivot update then eliminates and proves the invariant for .
The invariant at each root eliminates all vertices. Each pivot column is therefore computed from the same exact Schur complement as scalar elimination in , so the multifrontal factors equal the scalar Cholesky factors.
Front has indices. Its dense scalar pivot update and initialization from assigned entries use at most a constant multiple of arithmetic operations. Embedding and adding a child contribution touches at most that child's dense trailing block, whose entries are already counted by the child's bound. Summing over fronts gives arithmetic work. By [F1], each factor column retains one diagonal slot and all later-neighbor slots, including structural zeros, so symbolic factor storage is exactly .
The forward column updates in [F1] solve : after column is processed, row satisfies its equation, and the pivot contribution has been subtracted from each later row. This is the unique solution in [F4]. The descending conjugate updates solve by the backward recurrence in [F4]. Since , these equations imply ; multiplying by gives . Thus is the unique solution of .
Each stored off-diagonal factor entry is visited once in each triangular solve, with one multiply and one subtraction; each diagonal contributes one division. Hence the two solves use operations, separate from the factorization work in step 3.2.
Step 3.1 gives scalar equivalence, step 3.2 gives factorization work and factor storage, and steps 4.1–5.1 give solve correctness and work.
Nested dissection gives the stated work and factor-storage bounds on regular grids
Statement
Let , , and . Identify the coordinate grid with the zero-based matrix indices by the lexicographic bijection in Recursive coordinate-separator ordering for two- and three-dimensional grids. Let be symmetric positive definite, with structural graph a subgraph of the -dimensional nearest-neighbor grid. Under the coordinate nested-dissection ordering, exact scalar multifrontal Cholesky has The storage is the number of allocated factor entries, including structural zeros, and excludes temporary contribution arrays. The bounds use the stated grid geometry; they assert no general-graph bound. For , there is one pivot and both work and factor storage are .
Facts & Assumptions
Given: A real symmetric positive-definite matrix with a grid-subgraph pattern, the recursive ordering, and exact scalar multifrontal Cholesky.
Recursive coordinate-separator ordering for two- and three-dimensional grids: Every box is separated by the union of its selected median coordinate hyperplanes; child boxes are ordered before that separator.
Nested-dissection grid fronts are bounded by a box separator and its exterior boundary: For the full grid and a vertex in the separator of a box of side at most , its factor-column size is at most .
Filled edges are witnessed by paths through earlier eliminated vertices: A filled edge at the elimination of a vertex is equivalent to an original-graph walk between its endpoints whose internal vertices were eliminated earlier.
Scalar multifrontal elimination is equivalent to sparse Cholesky with column-count costs: Exact factorization work is and symbolic factor storage is exactly .
Proof
If a box side has length , the median rule leaves each child side with length at most ; a side of length stays . Iterating gives side lengths at depth at most . There are at most boxes at that depth because each box has at most children. By depth , every side has length , so all remaining boxes are terminal. For , , hence .
If , the grid and its ordering contain one terminal pivot and its factor column contains only the diagonal. Hence for its unique vertex, and [F4] gives work and exactly one stored factor entry.
Let be the structural graph of and let be the full nearest-neighbor grid on the same vertices. They use the same coordinate ordering. If a pair is an edge in a filled graph of , [F3] supplies a witness walk in with internal vertices eliminated earlier; since is a subgraph of , the same walk witnesses that edge in the corresponding filled graph of . Thus every later filled neighbor in is also one in , and each subgraph column size is at most the full-grid column size. Fix a box at depth . Its separator has at most vertices by the union bound over its at most median hyperplanes; the terminal singleton satisfies the same bound. By [F2], each such pivot has full-grid column size at most , so the same bound holds for .
The factorization work contributed by one depth- box is therefore at most a constant depending only on times , using [F4]. Summing over at most boxes at each depth and using gives For , the geometric ratio is , so this is . For , the ratio is , so it is .
The storage contributed by one depth- box is at most a constant times , again by [F2] and [F4]. Summing over boxes and using gives For , there are equal-order terms, giving . For , the series is bounded by , giving .
When , gives and for . When , gives and . Thus steps 1.2, 2.1 and 2.2 give the displayed rates and the case. The proof used the coordinate-box and grid-boundary counts in [F1]–[F2] together with the fill containment proved in step 1.3, so it does not imply a bound for arbitrary graphs.
Certified real-component Hermitian one-by-one and two-by-two LDL* kernels
Definition
Input stored Hermitian , and , with , , threshold , unit roundoff , and a finite certificate budget. Use Operationwise real and complex floating point arithmetic with rounded square roots and fused multiply-add. Divide complex values by a nonzero real denominator by separately dividing their real and imaginary components, using the model's real operations; no complex division is used. Any invalid operation, nonfinite output or nonzero exact intermediate outside the normal range returns range-failure. Hermitian counterparts, sign changes and conjugation are exact copies.
For a complex value , denotes its exact mathematical modulus ; this convention does not add a modulus operation to the floating-point model. Moduli in guard specifications and error bounds have this meaning, while the algorithm obtains only the rigorous bounds produced by the rounded scaled-norm procedure below.
The pivot controller uses exact real-RAM arithmetic on the stored real components and the supplied exact , separately from the rounded numerical kernel. Its allowed operations are real addition, subtraction, multiplication, division by a certified nonzero real denominator, fixed nonnegative integer powers, and comparisons. Each field operation or comparison consumes one unit of the nonnegative integer controller budget; a fixed power is expanded into its stated finite chain of multiplications. Before any controller operation, if no unit remains, return pivot-inconclusive. Exact sign/absolute-value and maximum decisions use comparisons and conditional sign changes. For binary/rational stored values and rational , exact rational arithmetic implements this controller with finite integers; no bit-complexity bound is claimed. There is no optional unspecified certifier or sign oracle. For complex modulus guards, a successful two-component scaled norm first scales by the larger absolute real component, then rounds both divisions, squares, sum, positive square root and rescaling. Its returned gives bounds ; zero is exact. Maxima use the corresponding lower/upper bounds and an empty maximum is zero. Evaluate modulus guards once per distinct stored complex value in row-major order, using only the displayed rounded scaled norm; its finite floating operations carry their own range status. No exact square root or additional modulus operation is used by the controller. Evaluate each displayed rational bound left to right, entrywise in row-major order; evaluate column maxima in increasing row order, then the at-most-two-term matrix-vector bounds in increasing column order, and finally the acceptance comparisons in row order. Compute each of by left-associated repeated multiplication. These prescribed finite expression trees and finite input loops fix the guard procedure and its budget count. If acceptance is not established, evaluate the stated lower-bound failure comparisons; if neither conclusion follows, return pivot-inconclusive without refinement.
For , write , real. If return pivot-failure. Certify using the guard bounds. A rigorous lower maximum exceeding returns pivot-failure; an unresolved comparison returns pivot-inconclusive. Set by rounded real-component divisions of by .
For , write with real , and set . If return pivot-failure. Compute the four real entries of and the conjugate counterpart by copying. In order compute
Put and by copies. Unless is certified, return pivot-inconclusive. For each entry obtain rigorous modulus bounds and set
Let bound . Accept only if componentwise. If any coordinate of exceeds return pivot-failure; otherwise an unresolved test returns pivot-inconclusive. On acceptance compute , by sequential two-term complex dots, then by real-component divisions. No explicit reciprocal is formed.
For either block size, compute each allocated lower-triangle entry of by sequential -term dots. Compute there, retain only its real component on the diagonal, and obtain upper entries by exact conjugation. Return success with stored and the pivot certificates. An empty trailing block returns empty . In the sparse application, allocate the original block-neighbor clique and retain positions even when their numerical value is zero. Additional sparsity drops must be recorded separately as additive perturbations.
Hermitian block LDL* kernels have explicit roundoff and actual-factor residual bounds
Statement
For a successful Certified real-component Hermitian one-by-one and two-by-two LDL* kernels, let and be its trailing dimension. Every accepted is nonsingular and satisfies the original exact componentwise threshold test. For either size put for . For put . For put For either size define Then, writing and , For all residuals are zero and use . The coefficients are explicit unit-roundoff bounds, at fixed nonzero normalized determinant as ; near-singular scaled pivots have no uniform smallness guarantee.
The actual stored multipliers also have coupling residual . Set . The full reconstruction residual satisfies This additional residual is necessary for actual rounded output factors; the trailing-only residual applies to conceptual exact multipliers.
Facts & Assumptions
Given: The stated successful kernel, its finite pivot certificates and no-underflow operations; . For a matrix , the Frobenius norm is . Norms in a certificate are exact or rigorously bounded.
Certified real-component Hermitian one-by-one and two-by-two LDL* kernels fixes real-component divisions, determinant order, threshold certificates and Hermitian storage.
The proof, Step 2.1, of Rounded matrix products give certified linear and normal-equation residual allowances bounds a successful complex length- dot by times its absolute-product sum, including exact zeros, when . Apply that rowwise proof to each dot here; for its condition follows from regardless of .
The operator norm is zero on the zero domain and otherwise is max_{||v||=1} ||Tv|| supplies the induced Euclidean norm; Cauchy-Schwarz gives submultiplicativity and .
Proof
For two-by-two , put and . Each real component of has magnitude at most one. Expansion of the determinant computation multiplies each of its three quadratic terms by at most five factors , , including scaling. For , the coefficient deviation is at most , since the lower deviation is no greater. Also . Thus . Acceptance gives . The entrywise scaling bound implies and . The algorithm's therefore bound above and below. The modulus guard follows by expanding its scaled sum, square root and rescaling, giving relative factors between and . The resulting maximum/product interval tests prove exact acceptance or definite threshold failure; unresolved cases are explicitly inconclusive. Scalar pivots satisfy the same scalar threshold argument.
Define for analysis only. Scaling gives . The inverse formula gives , and step 1.1 gives . Subtract the two inverse expressions to obtain and . This retains the actual scaled-determinant sensitivity.
The computed has Frobenius error at most . By [F2], its product with adds at most . Since , the product discrepancy relative to is at most . Final real-component division adds the factor to that error and at most . Thus . Step 2.1 proves the stated and . For a scalar pivot the direct real-component divisions instead give these bounds with .
The update dot bound [F2] gives . Replacing by adds at most . Final subtraction adds at most . Combining these with step 3.1 gives raw Schur error at most . The exact Schur complement is Hermitian. Copying one chosen computed triangle doubles at most the squared Frobenius error; projecting the diagonal to its real part decreases error. Thus . Finally and , proving the stated bound. Empty trailing arrays have zero residual.
Put . Direct block multiplication gives the displayed full residual, because and . The Hermitian off-diagonal matrix has norm : its square is block diagonal with , or equivalently use the defining singular-value maximum. Also . Triangle inequality and step 4.1 therefore give . Every coefficient is an explicit finite function under successful certification, and tends to zero linearly for a fixed nonsingular normalized pivot as .
5 · Examples, counterexamples and false statements
None yet.
Sources
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 6, §6.1 and Chapter 7, §7.3.1
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 7, §7.3.1
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 4
- Timothy A. Davis, Siva Rajamanickam, and Wissam M. Sid-Lakhdar, A survey of direct methods for sparse linear systems, §§4–5
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 8, §8.4
- David Bindel, CS 5220, Lecture 16: Sparse Direct Solvers, slides 7–17
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 4, §§4.1–4.3
- Timothy A. Davis, Siva Rajamanickam, and Wissam M. Sid-Lakhdar, A survey of direct methods for sparse linear systems, §4
- Timothy A. Davis, Siva Rajamanickam, and Wissam M. Sid-Lakhdar, A survey of direct methods for sparse linear systems, §6
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 4, §4.2
- Timothy A. Davis, Siva Rajamanickam, and Wissam M. Sid-Lakhdar, A survey of direct methods for sparse linear systems, §4.1
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 7, §§7.2.4 and 7.3
- Timothy A. Davis, Siva Rajamanickam, and Wissam M. Sid-Lakhdar, A survey of direct methods for sparse linear systems, §11
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 4, §§4.1–4.2
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapters 4–5
- Jennifer Scott and Miroslav Tůma, Algorithms for Sparse Linear Systems, Chapter 5, §5.4
- Timothy A. Davis, Siva Rajamanickam, and Wissam M. Sid-Lakhdar, A survey of direct methods for sparse linear systems, §§3 and 11
- David Bindel, CS 5220, Lecture 16: Sparse Direct Solvers, slides 13–14
- Timothy A. Davis, Siva Rajamanickam, and Wissam M. Sid-Lakhdar, A survey of direct methods for sparse linear systems, §§8 and 11