Linear Algebra
Linear algebra develops vector spaces, linear maps and matrices over fields, then follows the structural and computational consequences of these objects. Core topics include dimension, bases, rank-nullity, change of basis, Gaussian elimination, determinants, bilinear and quadratic forms, inner products and spectral theory. Further topics include complexification and realification, exterior powers and Hodge duality, LU, Cholesky and QR factorizations, Krylov methods, conjugate gradients, MINRES, GMRES and pseudoinverses. Matrix norms, conditioning and regularized least squares connect the theory to numerical stability, while matrix differentiation and perturbation pages analyze changing operators.
Some topics draw on Abstract Algebra, Real Analysis, Topology and Combinatorics. Linear algebra supplies methods used in Abstract Algebra, Representation Theory of Groups, Coxeter Groups, Algebraic Geometry and Differential Topology. Its inner-product, spectral, matrix and subspace tools support Numerical Linear Algebra and Approximation, Quantum Algorithms, Quantum Computing and Statistical Learning and Classical Models. Other applied connections include Machine Learning Algorithms, Neural Networks and Learning Dynamics, and Inverse Problems.
Pathway
The parts run in order. Everything a page needs from this group has been read by the time you reach it, and the level on each row is how many dependency steps into the group that page sits.
Part 1 · Spaces and linear maps
3 pagesA vector space is defined over an arbitrary field, and the first results are the ones that need no counting: subspaces, spans, sums and internal direct sums. Linear independence then buys dimension, with every basis of a space having the same size, and a linear map is measured by its kernel and image through rank-nullity and the quotient space.
This page opens the linear algebra track. It defines a vector space over an arbitrary field and develops the structure theory that needs no counting: linear subspaces, the…
7 definitions, 10 lemmasExamples & counterexamples- Linear Independence, Bases and Dimension20 results
This page discharges the promise made at the end of Vector Spaces, Linear Subspaces, Span and Direct Sums, which says in as many words that it does not develop linear independence, bases or dimension.
3 definitions, 6 lemmas, 6 theorems, 5 corollariesExamples & counterexamples Vector spaces, linear combinations, bases, and finite dimension are the prerequisites for this development.
3 definitions, 2 lemmas, 2 theoremsExamples & counterexamples
Part 2 · Matrices and elimination
2 pages · after Part 1A matrix is what a linear map becomes once bases are chosen at both ends, and change of basis is what happens when they are chosen differently. Row reduction is the algorithm that answers the concrete questions, so elementary matrices, reduced row echelon form and the uniqueness of that form carry the computational weight of everything later.
Finite sums in the scalar field and the published matrix-space structure make row-by-column multiplication meaningful, including empty index sets.
11 definitions, 2 lemmas, 3 propositions, 9 theorems, 7 corollariesExamples & counterexamplesFinite matrices over a field, their products and identity matrices, and the coordinate action x↦ Ax come from The vector space M m × n(F) := F^ m × n of m by n matrices over…
6 definitions, 4 lemmas, 12 theorems, 7 corollariesExamples & counterexamples
Part 3 · Determinants
2 pages · after Part 2The determinant is built over a commutative ring, from the permutation sum, so that it applies to matrices whose entries are polynomials as well as to matrices of numbers. It is multiplicative, it detects invertibility, and because similar matrices share it, it descends to an endomorphism and gives cofactor expansion and Cramer's rule.
Commutative rings provide finite sums, products and units, while the earlier matrix interface supplies field-valued multiplication, transpose, invertibility and similarity.
7 definitions, 2 lemmas, 1 proposition, 8 theorems, 6 corollaries, 1 exampleExamples & counterexamplesThe matrix determinant, its multiplicative law, and its behaviour under elementary row operations come from determinants-of-matrices-over-a-commutative-ring and gaussian-elimination-and-row-reduction.
4 definitions, 2 lemmas, 9 theorems, 5 corollariesExamples & counterexamples
Part 4 · Forms and inner products
2 pages · after Part 3The dual space collects the linear functionals, and a bilinear or quadratic form is classified over the reals by Sylvester's law of inertia, which says the signature is what survives a change of basis. An inner product adds length and angle, and with it come Gram-Schmidt, orthogonal projection, the adjoint of an operator, and the geometry that makes least squares and spectral arguments possible.
The page builds on finite-dimensional bases and unique coordinates (Basis of a vector space: a linearly independent spanning subset; and ordered basis: an injective finite…
10 definitions, 2 lemmas, 1 proposition, 16 theorems, 4 corollariesExamples & counterexamplesThe published sesquilinear and Hermitian forms over a field with an involution fix the convention used here: linear in the first argument and conjugate-linear in the second.
8 definitions, 2 lemmas, 5 propositions, 15 theorems, 4 corollariesExamples & counterexamples
Part 5 · Eigenvalues and canonical forms
13 pages · after Parts 3 and 4An eigenvalue is a characteristic-polynomial root, and the minimal polynomial, generalized eigenspaces, Jordan form, scalar-change comparisons, Schur form, singular values, norms, conditioning, and exterior powers organize similarity, orthogonality, and perturbation. LU, Cholesky, QR, the pseudoinverse, and regularized least squares add factorization and inverse-problem techniques, while matrix differentials give Fréchet derivative rules and sharp sensitivity phenomena at defective or crossing spectra. Krylov, Arnoldi, Ritz, and GMRES then turn polynomial approximation into matrix-free solvers. The added Hermitian page specializes that story: conjugate gradients are the energy-minimizing Galerkin method for positive-definite systems, Lanczos is Arnoldi with a three-term recurrence, MINRES handles Hermitian residual minimization, and preconditioning is analyzed through the transformed operator.
The development uses the basis-independent determinant of an endomorphism (The determinant of an endomorphism of a finite-dimensional vector space: its matrix determinant in…
6 definitions, 2 lemmas, 1 proposition, 9 theorems, 5 corollariesExamples & counterexamplesAn endomorphism of a finite-dimensional vector space has eigenvalues, eigenspaces and a characteristic polynomial whose root set is its spectrum, together with algebraic and…
4 definitions, 4 lemmas, 1 proposition, 10 theorems, 7 corollariesExamples & counterexamplesTensor products over a commutative ring, their universal property, uniqueness up to unique isomorphism, functoriality, and basis formulas supply the construction machinery…
6 definitions, 1 proposition, 8 theorems, 3 corollariesExamples & counterexamplesThis page first builds the quotient-vector-space machinery missing from the published linear-map page: well-defined operations and projection, lifted bases, the universal…
7 definitions, 4 lemmas, 7 propositions, 13 theorems, 5 corollariesExamples & counterexamplesIterated tensor products and their basis and functoriality theorems supply the construction machinery; determinants, linear bases, dimension, and linear independence supply…
10 definitions, 2 propositions, 10 theorems, 6 corollariesExamples & counterexamplesThe adjoint, orthonormal bases, orthogonal projections, Jordan form, and the fundamental theorem of algebra are already in place.
8 definitions, 1 lemma, 5 propositions, 15 theorems, 5 corollariesExamples & counterexamplesThe published p-norms on ℝⁿ and their norm axioms, the operator norm and the singular value decomposition with the rank and Eckart–Young consequences, matrix multiplication…
9 definitions, 1 lemma, 2 propositions, 11 theoremsExamples & counterexamplesThis page collects the standard direct factorizations used to solve dense linear systems and least-squares problems.
9 definitions, 15 theoremsExamples & counterexamplesThis page works over the underlying real vector space throughout.
5 definitions, 7 propositions, 8 theorems, 1 corollary, 2 counterexamplesExamples & counterexamplesThis page treats the classical exact-arithmetic eigenvalue iterations with all of their hypotheses stated.
7 definitions, 5 propositions, 8 theoremsExamples & counterexamplesThis page develops the Moore--Penrose pseudoinverse through the singular value decomposition and keeps the projection geometry visible throughout.
3 definitions, 6 propositions, 7 theorems, 1 corollaryExamples & counterexamples- Krylov Subspaces, Arnoldi and GMRES20 results
This page builds the nonsymmetric Krylov route in the order the later proofs actually spend it.
7 definitions, 6 propositions, 4 theorems, 3 corollariesExamples & counterexamples This page follows the Hermitian Krylov route that the preceding Arnoldi and GMRES page leaves open.
8 definitions, 3 propositions, 9 theorems, 1 remarkExamples & counterexamples