How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Finite Fourier Analysis and the Fast Fourier Transform
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Binary Operations, Monoids, Groups and Subgroups
- Compactness in Metric Spaces
- Completeness, Completion, and Uniform Continuity
- Congruences, the Integers Modulo n and the Chinese Remainder Theorem
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Cosets, Index and Lagrange's Theorem
- Countability and Uncountability
- Divisibility, Euclidean Domains, Principal Ideal Domains and Unique Factorisation
- Divisibility, Greatest Common Divisors and Bézout's Identity
- Dual Spaces, Bilinear and Quadratic Forms, and Sylvester's Law of Inertia
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Foundations of the Real Numbers for Analysis
- Fundamental Trigonometric Identities
- Hilbert Space Geometry and Riesz Representation
- Ideals, Quotient Rings and the Isomorphism Theorems for Rings
- Inner Product Spaces, Gram-Schmidt, Projections and Adjoints
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Measures and Their Basic Properties
- Metric Spaces
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- Normal Subgroups and Quotient Groups
- Order, Zorn's Lemma, and the Axiom of Choice
- Polynomial Rings, the Division Algorithm and Roots
- Power Series and Real-Analytic Functions
- Properties of the Integral and the Working FTC
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Simple Field Extensions and the Construction of the Complex Numbers
- Sine, Cosine, and the Definition of Pi
- Suprema and Infima
- The Complex Exponential and Euler's Formula
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Logarithm and General Powers
- The Riemann Integral: Definition and Integrability
- The ZFC Axioms and the Basic Set Constructions
- Topology of ℝ
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
This page develops the discrete Fourier transform on the finite cyclic group from finite sums alone, with no convergence, regularity or topological hypothesis anywhere. It fixes the counting inner product on complex functions on the group, the unnormalised cyclic convolution, and the negative-sign, -normalised unitary transform. The orthogonality of the characters is proved directly from the recursion for finite sums, including the length-one case, and it drives inversion, Parseval–Plancherel, and the convolution law, in which the unnormalised convolution costs one explicit factor . The square of the transform is reflection and its fourth power is the identity.
The second half converts the unitary convention into the unnormalised engineering convention , in which the convolution law has no extra factor and the inverse formula carries the visible . The radix-two step then splits an even length into the even and odd coefficient lists and combines their shorter transforms with twiddle factors ; the recursive algorithm built from that step is defined for lengths , proved to compute the unnormalised transform, and shown to use at most complex additions and multiplications in an explicitly stated operation model that excludes twiddle evaluation, index arithmetic and bit complexity. This recursive algorithm and its bound apply to the specified power-of-two lengths. The companion page executes the small cases: the transforms at and , a four-point cyclic convolution computed through the transform, the full four-point radix-two recursion, and two counterexamples showing the wrap of an unpadded product and the failure of the even/odd split for odd lengths.
3 · Logical flowchart
4 · Definitions, theorems and proofs
The counting inner product on
Definition
Let and let be the complex vector space of all functions , with pointwise addition and scalar multiplication (The vector space of all functions with pointwise operations, and as the case , Vector space over a field). For define
the sum being the finite sum over the finite index set in the additive commutative monoid of (A finite sum in a commutative monoid indexed by an arbitrary finite set). Enumerating the group by its standard representatives gives the equivalent formula
where is complex conjugation (Real and imaginary parts, complex conjugation, and modulus). The two displays agree. By For , every class in has one representative with , so ; while is in bijection with the map is a bijection from the von Neumann natural onto , and the summand depends only on the class ; a finite commutative-monoid sum is unchanged by reindexing along a bijection (Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule, part 1), so the second display is a rewrite of the first. No representative of a class is ever selected: every application of or of is an evaluation at a class.
The pairing is an inner product in the sense of Real and complex inner product spaces, with the inner product linear in the first argument and Real and complex inner-product spaces and their induced length, with the linear-first convention fixed there. Linearity in the first argument, for , follows from the field laws of ( is a field, every element is uniquely , and every nonzero element has inverse ) together with the two elementary laws of a finite sum over a fixed finite index set, and ; each of these laws is proved from the recursion clauses of A finite sum in a commutative monoid indexed by an arbitrary finite set by induction on an enumeration of the index set. Conjugate symmetry, , follows from the same two laws together with the fact that complex conjugation is an involutive field automorphism, hence and conjugation commutes with finite sums (Conjugation is an involutive real-field automorphism, , and modulus is definite, multiplicative, and subadditive).
Positive definiteness. Taking gives by (Conjugation is an involutive real-field automorphism, , and modulus is definite, multiplicative, and subadditive), a sum of nonnegative real numbers, so . For the vanishing clause, reindex by the standard representatives to identify this group sum of the real family with the sequential real sum (Finite sums and finite products, by recursion, Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule); by claim 4 of Laws of finite sums and finite products a finite sum of nonnegative reals vanishes only if every term vanishes, and happens exactly when (Conjugation is an involutive real-field automorphism, , and modulus is definite, multiplicative, and subadditive). Since every class of is for some , this forces .
This is the pairing induced by the counting set function on the finite set , which weights a finite set by its cardinality and therefore gives weight to each point (Counting measure on an arbitrary set). No factor is inserted anywhere in the definition; a normalisation constant is carried by the transform, not by the pairing.
Remarks
- Why the counting normalisation and not -counting. Taylor's (11.5) weights the function space on by -times counting measure and the space on by counting measure, matching the factor carried by his forward transform (11.1); this page uses the counting pairing on both sides and puts the constant in the transform. Under the identification the two conventions are related by , a relabelling of the same finite sums, not a change of the mathematics.
The unnormalised cyclic convolution on
Definition
Let and let be the complex vector space of functions on the finite group (The vector space of all functions with pointwise operations, and as the case ). For the cyclic convolution of and , unnormalised, is the function defined for by
where is the group operation of (For every natural , is an abelian group, multiplication is a commutative monoid operation, and both distributive laws hold) and the sum is the finite sum in the additive commutative monoid of over the finite index set (A finite sum in a commutative monoid indexed by an arbitrary finite set). No factor or is inserted, and this unnormalised convention is the one used throughout the page.
Well-definedness. The standard-representatives bijection gives (For , every class in has one representative with , so ; while is in bijection with ). For fixed , and are values at classes, so the finite sum of the complex family is a single complex number (A finite sum in a commutative monoid indexed by an arbitrary finite set). Thus is a well-defined function .
The operation is commutative. Fix and let be ; then , so is its own two-sided inverse and hence a bijection (Injection, surjection, bijection, For every natural , is an abelian group, multiplication is a commutative monoid operation, and both distributive laws hold). Reindexing the finite sum along a bijection (Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule, part 1) with the substitution gives
the middle equality being commutativity of multiplication in ( is a field, every element is uniquely , and every nonzero element has inverse ). Hence .
Attached to the finite set is its counting set function, which gives weight to each point (Counting measure on an arbitrary set); the displayed sum is the convolution of and against that weight on the finite group. This cyclic convolution is a different operation from the linear convolution of finite sequences of coefficients, which agrees with it only after the sequences are padded with enough zeros; the companion page exhibits the wrap that occurs without such padding, and the transform law proved later on this page computes the cyclic, not the linear, convolution.
Remarks
-
The factor that this convention costs. Because no normalisation is built into , the unitary transform of this page does not turn into an unadorned pointwise product: the transform law later on this page carries a factor . That factor is not an artefact of the proof but the exact price of leaving the convolution unnormalised, and it is recorded here once so that no later item silently mixes the two conventions.
-
Cyclic convolution as reduction of polynomial products. Writing a function on as the coefficient list of a residue-class polynomial identifies with the coefficient of in the product of the two polynomials taken modulo : exponents add under the group operation and are reduced modulo . This is the viewpoint of Taylor's (11.30)–(11.33) and of the MIT lecture, and it is what makes the diagonalisation of by the discrete Fourier transform the discrete analogue of the Fourier-multiplier calculus.
The unitary discrete Fourier transform on
Definition
Let and let be the complex vector space of all functions (The vector space of all functions with pointwise operations, and as the case , Vector space over a field). For define the unitary discrete Fourier transform by
where is the class of the integer in (The congruence class and the quotient set , Congruence modulo every integer is an equivalence relation on ), is the complex exponential (The complex exponential by its power series), and is the rational power of the positive real (Rational powers of a positive base, Laws of rational exponents), read in through the embedded copy of ( is a field, every element is uniquely , and every nonzero element has inverse ).
The summands depend only on classes, and the transform is periodic in . Each summand is a complex number determined by the class and the integer , and the classes are pairwise distinct and exhaust (For , every class in has one representative with , so ; while is in bijection with ); so the display is the finite sum, over the finite group, of the family , and reindexing by any other representative list leaves it unchanged (Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule, part 1). Reindexing by the transition uses and for every integer , because (, and the complex exponential extends the real exponential, , and exactly when ). For periodicity in , the same two facts give for every integer , so for every (, and the complex exponential extends the real exponential, , and exactly when ). Consequently factors through the quotient and is a well-defined function on , and is a map .
Form in terms of characters. Define for . The assignment is well defined on classes because replacing by multiplies the exponential by (, and exactly when ); it is multiplicative, , by the addition law (, and the complex exponential extends the real exponential); and it takes values of modulus , since (, , and ). Thus the are characters of the finite group (homomorphisms into the unit circle; no continuity is required on a discrete group), and the definition reads
with the positive-sign transform obtained by replacing with . This fixes the negative-sign, -normalised convention of the whole page: the forward transform carries the minus sign in the exponent and the factor , and the inverse transform of the inversion theorem carries the plus sign with the same factor. A different, unnormalised convention is introduced later on this page for the algorithmic part; the two are related by a single explicit rescaling recorded there.
Linearity, recorded for later use. For and one has : the identity holds at each by distributivity in ( is a field, every element is uniquely , and every nonzero element has inverse ) and the elementary laws of finite sums over a fixed finite index set, which follow from the recursion clauses of A finite sum in a commutative monoid indexed by an arbitrary finite set by induction on an enumeration. Nothing else about — unitarity, invertibility, the convolution law — is asserted here; those are proved in the items that follow.
Remarks
-
Why the normalisation is split as . The factor is exactly what makes the transform an isometry for the counting inner product, and is the finite analogue of the convention in the Fourier transform. Taylor writes the finite transform (11.1) with the factor in the forward direction and weights by -counting measure; the two descriptions differ by relabelling the sides, not by mathematics, and the translation used here sends to and to .
-
No convergence hypothesis is needed or used. The index set is finite, so the definition involves no limit, no summability condition and no auxiliary topology; it applies to every function in , including the zero function, and it is total at , where the single summand is with coefficient .
Orthogonality of the characters on
Statement
Let and let . Then
At the congruence holds for all and the sum is . The sum is the finite sum of the complex family over the von Neumann natural (A finite sum in a commutative monoid indexed by an arbitrary finite set), and on the right is the natural number read in as the additive multiple , that is, the value at of the canonical embedding (The canonical natural of a field, In a field, the additive multiple is the canonical natural : the additive power of the group-power definition and the canonical natural are the same function, both being the unique one given by the recursion , ).
Facts & Assumptions
Given: A natural number , integers , the complex number , the partial sums for , and .
means , that is, for some integer ; the relation is an equivalence relation and is defined for every integer modulus, including (Congruence modulo an integer: when , including the moduli and , Congruence modulo every integer is an equivalence relation on ).
For complex : exactly when , and exactly when (, and exactly when , The complex exponential by its power series).
for all complex (, and the complex exponential extends the real exponential).
A finite sum in a commutative monoid is computed from any enumeration of its finite index set and does not depend on it; it is unchanged by reindexing along a bijection, additive over disjoint splittings, and subject to the finite Fubini rule (A finite sum in a commutative monoid indexed by an arbitrary finite set, Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule).
Powers in : and for every (Integer powers in the complex field), and for all naturals (Laws of integer exponents, claim 1). Induction is available (The principle of mathematical induction).
Additive natural powers: in the additive group of , the element defined by and equals the image of the natural number under the canonical embedding (Powers : natural exponents in a monoid and integer exponents in a group, with read additively, In a field, the additive multiple is the canonical natural : the additive power of the group-power definition and the canonical natural are the same function, both being the unique one given by the recursion , ).
Field laws of : multiplication is associative and commutative and distributes over addition, every nonzero element has an inverse, and ( is a field, every element is uniquely , and every nonzero element has inverse ).
Proof
The summands are the powers of : for every . Indeed, for both sides are by [F2] (as ) and [L3]; and if the identity holds at , then the addition law [L1] and the power recursion [L3] give , so induction [L3] proves it for every . Consequently by [L2], since the finite sum depends only on the listed values.
The geometric identity: for every . For the sum is empty, hence by [L2], and by [L3]. If the identity holds at , then by the recursion clause of [L2], so distributivity [L5] gives , using the hypothesis, distributivity, associativity and the power recursion [L3]. Induction [L3] gives the identity at every .
The two alternatives for : exactly when , and always. For the first, [F2] gives by [F1]; for the second, by [F2] because , and step 1.1 identifies with .
Case : then for some integer by [F1], so every exponent lies in and every summand equals by step 1.1 and [F2]. The sum therefore consists of copies of , and the recursion clause of [L2] computes it as the additive natural power of [L4]. In particular at , where every pair is congruent, the sum is the single term , the image of the natural number under the canonical embedding.
Case : then and by step 2.1, so the geometric identity of step 1.2 at gives . Since , the field laws [L5] give .
The alternatives of [F1] are exhaustive and mutually exclusive, so steps 2.2 and 3.1 cover every pair : the sum equals the natural number read in in the congruent case and otherwise, which is the stated formula.
Remarks
-
The case is exactly the case split used by Taylor. In Taylor's proof of Proposition 11.2 the sum of the powers of satisfies , so it vanishes whenever ; the coincident case is separated first. Here the split is made on and the noncoincident case is settled by the geometric identity, which is the same computation in explicit finite-sum form.
-
No dependence on the representation-theoretic orthogonality. The published orthogonality lemma for finite abelian groups and the real-variable factorisation lemma for are stated outside the complex-sum setting used here, so this lemma proves the complex geometric identity directly from the recursion instead of importing them. They are independent cross-checks, not prerequisites.
is reflection and is the identity
Statement
Let and . Define the reflection by for . Then and , the identity map of ; consequently is an involution and . At and the reflection is the identity, so there. No convergence or regularity hypothesis is involved: the transform is a finite sum (The unitary discrete Fourier transform on ).
Facts & Assumptions
Given: A natural number , a function , classes , and the reflection .
for every and every integer , and is -periodic in (The unitary discrete Fourier transform on ); every class has a unique standard representative in (For , every class in has one representative with , so ; while is in bijection with ).
For all integers , when and otherwise (Orthogonality of the characters on ).
Finite sums over are computed from any enumeration, are unchanged by reindexing along a bijection, split over disjoint unions, and satisfy the finite Fubini rule (A finite sum in a commutative monoid indexed by an arbitrary finite set, Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule). In particular a sum whose every term has as a factor is , and a sum over a one-element index set is the single listed value.
for all complex , and exactly when (, and the complex exponential extends the real exponential, , and exactly when ).
Classes of : exactly when (The congruence class and the quotient set ); the group is abelian, so and is the group operation (For every natural , is an abelian group, multiplication is a commutative monoid operation, and both distributive laws hold).
Field laws of ( is a field, every element is uniquely , and every nonzero element has inverse ), and two functions in are equal exactly when they agree at every class (The vector space of all functions with pointwise operations, and as the case ).
If a function has a two-sided inverse it is unique and written ( is a bijection if and only if there is a function with and ; such a is unique, equals the inverse relation , and is itself a bijection).
Proof
Fix a class and let be its unique standard representative by [F1]; evaluating the second transform at and expanding twice by [F1], the addition law [L1] gives : indeed by [L1], and by the exponent laws (Laws of rational exponents, claim 2). The double sum is the finite sum over the product index set and the interchange of the two sums is the finite Fubini rule [F3].
Evaluation of the inner sum: for , when and otherwise. Apply [F2] with , and dummy summation index ; then is exactly by [L2].
Collapsing a sum supported at one class: if is any function and , then . Split the finite index set into the singleton and its complement by [F3]; every term of the complement sum has as a factor, hence the complement contributes , while the single term over is the listed value .
The reflection is an involution: . For every class , by [L2], so the two functions agree at every class [L3].
Combining steps 1.1, 1.2 and 1.3, for every class one has ; the list contains exactly one representative of each class by [F1]. Hence as functions on [L3].
Fourth power and inverse: from step 2.1, , and step 1.4 gives ; so , whence (that is, is an involution) and both and ; by [L4] the two-sided inverse of is unique and equals , so . This proves the statement.
Remarks
-
The two involution cases. At the group has one element, so and the reflection is the identity. At the element satisfies , so and ; the reflection is the identity there too and , consistent with the fact that the matrix is its own inverse. Both claims use only the group law of For every natural , is an abelian group, multiplication is a commutative monoid operation, and both distributive laws hold.
-
What this identity is not. It is a statement about the finite transform and its exponent bookkeeping only. In particular it does not assert that has order four in general, and it does not identify the reflection with the identity for : for the reflection exchanges the classes and and is not the identity, while it still satisfies .
The DFT turns cyclic convolution into a scaled pointwise product
Statement
Let and . Then for every
where is the unnormalised cyclic convolution of The unnormalised cyclic convolution on and is the rational power of Rational powers of a positive base. The factor is the price of leaving the convolution unnormalised; it is not an artefact of the proof, and the same factor appears for every pair .
Facts & Assumptions
Given: A natural number , functions , an integer , and classes .
for every (The unitary discrete Fourier transform on ).
, a single complex number for each class ; the value depends on classes only (The unnormalised cyclic convolution on ).
Finite sums over are computed from any enumeration, are unchanged by reindexing along a bijection, split over disjoint unions and satisfy the finite Fubini rule; scalar factors move through them (A finite sum in a commutative monoid indexed by an arbitrary finite set, Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule).
for all complex (, and the complex exponential extends the real exponential).
Rational powers of the positive real : and the exponent laws hold (Rational powers of a positive base, Laws of rational exponents, claims 1 and 2).
For fixed , the map is a bijection of onto itself with inverse (For every natural , is an abelian group, multiplication is a commutative monoid operation, and both distributive laws hold); classes are the objects of (The congruence class and the quotient set ).
Field laws of , in particular associativity and distributivity ( is a field, every element is uniquely , and every nonzero element has inverse ).
Proof
Substitute [F2] into [F1] and interchange the two finite sums by the finite Fubini rule [F3]: for the given , .
Reindex the inner sum and separate the exponentials: for fixed the substitution is the bijection of [L3], so , and by the addition law [L1] this equals , the last step by [F1] and [L4].
Inserting step 1.2 into step 1.1 and recognising the remaining sum by [F1], ; by [L2] the scalar is , so as claimed.
Remarks
-
Comparison with Taylor's convention. Put , so carries the forward factor of Taylor's (11.1). The proved identity gives for the unnormalised convolution here. Taylor's (11.30) instead uses , so by linearity. Both the transform and the convolution normalisations matter.
-
Cyclic, not linear. The identity computes the cyclic convolution of [F2]. It does not compute the linear convolution of two coefficient sequences unless the length is large enough that no coefficient wraps; the companion page shows the wrap explicitly for two sequences of length two, where the linear coefficient of reappears in degree .
Finite Fourier inversion for the unitary transform on
Statement
Let and . Then for every
the right-hand side being independent of the chosen integer representative of the class . Consequently is bijective with inverse the positive-sign transform
and there is no convergence, regularity or support hypothesis anywhere.
Facts & Assumptions
Given: A natural number , a function , classes , and integers .
for every and integer (The unitary discrete Fourier transform on ).
For all integers , if and otherwise (Orthogonality of the characters on ).
Finite sums over : computed from any enumeration, invariant under reindexing along a bijection, additive over disjoint unions, Fubini, and scalars move through them (A finite sum in a commutative monoid indexed by an arbitrary finite set, Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule); the classes enumerate without repetition (For , every class in has one representative with , so ; while is in bijection with ).
, and exactly when (, and the complex exponential extends the real exponential, , and exactly when ).
Classes: exactly when (The congruence class and the quotient set ), and with in the abelian group (For every natural , is an abelian group, multiplication is a commutative monoid operation, and both distributive laws hold).
Rational powers: and (Rational powers of a positive base, Laws of rational exponents).
Field laws of ( is a field, every element is uniquely , and every nonzero element has inverse ); two functions in are equal exactly when they agree at every class (The vector space of all functions with pointwise operations, and as the case ).
A function with a two-sided inverse is a bijection and its two-sided inverse is unique, written ( is a bijection if and only if there is a function with and ; such a is unique, equals the inverse relation , and is itself a bijection).
Proof
Fix a class and let be its unique standard representative from [F3]. Substituting [F1] and using the product rule for exponentials [L1], the candidate right-hand side evaluated at equals , where by [L3] and the interchange of the two finite sums is the Fubini rule [F3].
The inner sum over is when and otherwise: apply [F2] with , and summation index ; the condition is exactly by [L2].
Collapsing a sum supported at one class: for any and class , . Split the finite index set into and its complement by [F3]; the complement contributes because every term there has the factor , and the single term over is the listed value.
The right-hand side depends only on the class of : replacing its standard representative by any representative changes the exponent to , and by [L1] because ; so every summand, and hence the whole sum, is unchanged.
Therefore, for every class , the right-hand side of the statement equals , by steps 1.1, 1.2 and 1.3, the list containing one representative of every class by [F3]. This proves the inversion formula, and by step 1.4 the formula is a statement about the class .
The transform of the statement is well defined by the same periodicity argument as step 1.4 (with the sign of the exponent reversed, which does not affect ), and the computation of steps 1.1-2.1 with replaced throughout by gives for every class ; that is, , while step 2.1 with is .
Since and , the transform has a two-sided inverse, namely ; by [L5] is bijective and , which is the statement.
Remarks
-
The exchange of signs is not a second theorem. The two compositions in step 3.1 are the same finite computation with the roles of and exchanged: both reduce to the orthogonality sum of [F2]. Both are verified because [L5] is stated for a two-sided inverse; no dimension argument and no countability or convergence argument is used.
-
Nothing here is a limit. All sums are finite, and the only scalar identity used beyond the orthogonality lemma is . In particular the inversion formula is exact for every function in , including the zero function, and at it reads , since .
Finite Parseval and Plancherel identity for the unitary DFT
Statement
Let and . Then
where both pairings are the counting inner products of The counting inner product on . In particular
so preserves the counting inner product; invertibility of is not asserted here.
Facts & Assumptions
Given: A natural number , functions , and classes .
(The unitary discrete Fourier transform on ); is the counting inner product (The counting inner product on ).
when and otherwise (Orthogonality of the characters on ).
Finite sums over are computed from any enumeration, are invariant under reindexing along a bijection, split over disjoint unions, satisfy the finite Fubini rule, and carry scalar factors (A finite sum in a commutative monoid indexed by an arbitrary finite set, Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule); the classes enumerate the group (For , every class in has one representative with , so ; while is in bijection with ).
and exactly for (, and the complex exponential extends the real exponential, , and exactly when ).
Conjugation and modulus: , , , (Conjugation is an involutive real-field automorphism, , and modulus is definite, multiplicative, and subadditive); (, , and ).
Rational powers: and (Rational powers of a positive base, Laws of rational exponents); the field laws of ( is a field, every element is uniquely , and every nonzero element has inverse ).
Proof
Conjugation of the second factor: for each class , . Indeed, conjugation is additive and multiplicative and fixes the real scalar (Conjugation is an involutive real-field automorphism, , and modulus is definite, multiplicative, and subadditive, Laws of rational exponents); and , because for with one has by [L2] and hence .
The orthogonality sum: when and otherwise, by [F2] with the integers and in the roles of the two congruence parameters.
Collapsing a sum supported at one class: for any and class , ; split the index set into and its complement by [F3], the complement contributing because every term there has the factor .
Expanding the pairing: substituting [F1] for both transforms, step 1.1 for the conjugate factor, and interchanging the finite sums by [F3] gives , where the exponentials combine by the addition law [L1] and the scalar is by [L3].
Evaluating the inner sum by step 1.2 and then collapsing the outer sum by step 1.3 gives by [L3] and the standard-representative form of the counting inner product [F1]. Taking and using from [L2], the same computation gives ; both assertions are proved.
Remarks
-
Isometry versus unitary isomorphism. The identity proved here says that preserves the counting inner product; it does not by itself assert that is bijective, and none of its steps uses inversion. Invertibility is the separate content of the inversion theorem on this page, and [L2] alone does not supply it.
-
Both sides use the same weight. There is no factor on either side of the displayed identity, and the cancellation of the two factors against the orthogonality value is the only place where the normalisation is used. In Taylor's convention the same computation reads as the unitarity of between the -weighted space on and the counting-measure space on (11.5).
The unnormalised engineering DFT and its conversion to the unitary transform
Definition
Let and . The unnormalised (engineering) discrete Fourier transform of is the function defined by
the sum being the finite sum of A finite sum in a commutative monoid indexed by an arbitrary finite set over the representatives of the classes of (The congruence class and the quotient set ), with the complex exponential of The complex exponential by its power series. Comparing with The unitary discrete Fourier transform on ,
where is the rational power of Rational powers of a positive base and the two conversions are inverse to each other by (Laws of rational exponents). So the two transforms determine each other, and the only difference between them is the constant .
The transform is defined on classes and is -periodic. If then for some integer and , so the summands depend only on classes; and for every integer , both identities following from the addition law and (, and the complex exponential extends the real exponential, , and exactly when ). Hence factors through and depends on only through its class.
Inverse formulas. The inversion theorem in its unitary form is the identity of Finite Fourier inversion for the unitary transform on ; substituting and collecting (Laws of rational exponents) gives the engineering form
This is the convention in which the radix-two algorithm computes its output. The unitary transform is recovered by the single rescaling at length . The correctness and complexity theorems refer to this unnormalised output; the convolution lemma is stated in the unitary convention.
Remarks
-
No factor in the forward direction. The normalisation sits in the inverse formula. MIT's heading 3 uses the positive-sign unnormalised forward transform; replacing its primitive root by its inverse gives the sign here. Taylor's negative-sign finite sum (12.1), multiplied by and identified by , agrees with . His printed recursive twiddle has a sign inconsistency, explained in the radix-two factorisation lemma; no printed recursion identity is needed for the conversion above.
-
What is not asserted. Nothing here claims that is an isometry for the counting inner product — with this normalisation rescales norms by — and nothing here claims an evaluation of for arbitrary ; the algorithmic statements are proved later on this page and are restricted to the lengths stated there.
The radix-two even/odd factorisation of the DFT
Statement
Let , and . Define the even and odd parts by
where and denote the classes in of the corresponding integers; the maps and from to are well defined and injective with disjoint images, which together exhaust . Let , , be the unnormalised transforms of The unnormalised engineering DFT and its conversion to the unitary transform, the latter two extended periodically to . Then for every
Thus an -point transform is computed from the two -point transforms of its even and odd parts together with the twiddle factors ; this is the radix-two (decimation-in-time) step of the fast Fourier transform, and it holds for every input class list, with no hypothesis beyond .
Facts & Assumptions
Given: Natural numbers and , a function , and integers ; the classes are those of The congruence class and the quotient set .
for a function on , and depends on only modulo (The unnormalised engineering DFT and its conversion to the unitary transform).
exactly when (The congruence class and the quotient set , Divisibility in : when for some integer ); if then and , and conversely forces by cancellation in (The integers have no zero divisors; multiplicative cancellation). The divisors of in are exactly and , and , in the ordered ring ( is a commutative monoid whose group of units is ; equivalently holds exactly for and , The integers form a totally ordered ring).
Division with remainder: for every integer and the positive divisor there are unique integers with and , hence (Division with remainder in : for and there are unique with and ); and the classes enumerate without repetition (For , every class in has one representative with , so ; while is in bijection with ).
Finite sums over : computed from any enumeration, invariant under reindexing along a bijection, and additive over disjoint splittings (A finite sum in a commutative monoid indexed by an arbitrary finite set, Finite commutative-monoid sums are invariant under bijective reindexing, split over disjoint unions, and satisfy the finite Fubini rule).
, exactly when , and , so because (, and the complex exponential extends the real exponential, , and exactly when , , , and , The complex exponential by its power series).
Since with , division in the embedded real field gives and . The frequency differs from by the period of each shorter transform in [F1].
Proof
The index maps are well defined with the stated images. If , then and [F2] gives and , so and are well-defined functions on . If , then , that is , so by cancellation [F2], hence in : the doubling map is injective, and likewise . If then , say , so and ; by [F2] this forces , contradicting and . Hence the two images are disjoint. Finally, every class of is for a unique [F3]; writing with [F3] gives or , and forces (if then ), so the class is in one of the two images; the images therefore exhaust .
Splitting the defining sum: with running over , the list is the disjoint union of the even numbers and the odd numbers , ; hence by the splitting and reindexing rules [F4] .
Evaluating the two pieces: by and the addition law [L1], ; and , where the exponents combine by [L1] using .
Adding the two evaluations of step 1.3 gives for every , which is the first displayed identity.
For the second identity, replace by in step 2.1: and because the transforms of the -point functions depend on only modulo [F1], while by [L1]; hence .
Remarks
-
This is the declared decimation-in-time form; Taylor's Proposition 12.1 and the MIT lecture's heading 4 are its mirror. Taylor splits the input into the halves and reads off the output parities, and the MIT lecture's heading 4 likewise splits the coefficient list into its two halves and combines them with a twiddle; both are the decimation-in-frequency description of the same pair of identities, the transposed statement of the even/odd-coefficient form proved here. No second independent result is being recorded.
-
Sign caveat in Taylor. Formula (12.1) uses , but (12.9) prints in the odd-frequency branch. With , the negative-sign odd-frequency sum instead factors as . Thus that branch needs , consistent with Taylor's four-point factor in (12.6). The local proof above derives its signs directly rather than importing the inconsistent printed general twiddle.
-
The twiddle factor is the price of the odd subproblem. The even half reuses the -point transform unchanged; the odd half carries the factor , and at that factor changes sign, which is exactly what produces the second displayed identity. Both identities are used in the recursion definition later on this page.
The recursive radix-two fast Fourier transform
Definition
Let and . The radix-two fast Fourier transform is defined by recursion on as follows. At the group is and . For , given with even and odd parts (The radix-two even/odd factorisation of the DFT), and given and , extend and from to by -periodicity and set
Then for every , because and are -periodic and (, and the complex exponential extends the real exponential, , and exactly when ); hence factors through and is a well-defined map .
The recursion is legitimate. Put for each , and use the tagged state set . For a state and , let be the even and odd parts supplied by The radix-two even/odd factorisation of the DFT, and define by for . This is well defined on : replacing by leaves the recursive values unchanged modulo and multiplies the twiddle by (, and the complex exponential extends the real exponential, , and exactly when ). Thus is a total map , and defined by is a total step function. Starting from , the recursion theorem The recursion theorem gives a unique with and . By induction (The principle of mathematical induction, The natural numbers (von Neumann)) the first coordinate of is ; writing gives and exactly the base and combine clauses above. Termination is immediate from recursion on : each recursive call uses level , and the base case returns the input. The exponent arithmetic uses and, for the rescaling below, (Laws of integer exponents, Rational powers of a positive base, Laws of rational exponents).
What the algorithm computes. Correctness is proved separately later on this page: for every input, where is the unnormalised transform of The unnormalised engineering DFT and its conversion to the unitary transform; the unitary transform of this page is recovered from the output by the single rescaling at length . The operation count is likewise the subject of a later item. At level the recursion forms the even and odd parts of a length- list and performs one combine per output value, reading and at their classes and multiplying by the twiddle factors .
Remarks
-
The base case is a genuine case, not a convention. contains (The natural numbers (von Neumann)), so is defined by the same recursion that defines all the other levels, and the length-one transform is the identity. Nothing in the definition excludes , and the recursion is total on .
-
The two conventions, once more. The recursion outputs the unnormalised transform: the definition of contains no factor , and the combine uses the twiddle factors with the same sign as of The unnormalised engineering DFT and its conversion to the unitary transform. Dividing the output by yields the unitary transform, and no other rescaling is needed.
The radix-two FFT uses complex arithmetic operations
Statement
Let be the number of complex-number multiplications and additions performed by the recursion of The recursive radix-two fast Fourier transform on an input of length , counted as the operations of the two recursive subproblems of length plus, at the top level, the twiddle multiplications and the additions needed to form all output values, and with no other operations counted. Then , for , and
In particular there is the explicit constant with for every , so at length the algorithm uses at most complex arithmetic operations, whereas independent direct evaluation of all coefficients uses additions and multiplications. The count is of arithmetic operations only: integer index arithmetic, twiddle evaluation, memory access and bit complexity are not counted, and no numerical-stability claim is made.
Facts & Assumptions
Given: Natural numbers and the operation counts of the radix-two recursion on inputs of length .
is defined by recursion on , with and, for , two recursive calls on the even and odd parts followed by the combine for each of the output values (The recursive radix-two fast Fourier transform).
The operation model of the Statement: counts exactly the complex multiplications and additions of the two subproblems and of the twiddle multiplications and combine additions at the top level, and nothing else. In particular and for the counted operations, so the upper bound holds for .
Powers: , , and for (Laws of integer exponents, The natural numbers (von Neumann)); .
The logarithm and real powers: for , , is injective, and (Real powers for positive bases, with the zero-base positive-exponent convention, The natural logarithm as the inverse of the exponential function, Order, continuity, range, and the product, quotient, and reciprocal laws for the natural logarithm, The exponential definition of real powers agrees with the existing rational powers); hence (The logarithm to a positive base other than one).
Induction: a property holding at and inherited by successors holds at every natural (The principle of mathematical induction).
Local asymptotic notation: for nonnegative sequences with for all sufficiently large , means that there are constants and such that for every .
Proof
The counted recurrence: , since the base case returns the input without performing a complex multiplication or addition, and for , because the recursion performs the two subproblem computations and then, at the top level, one twiddle multiplication and one addition for each of the output values [F2]; no other operation is counted.
Dividing by the level size: put , a real number. Dividing the inequality of step 1.1 by and using gives for , and .
The unrolled bound: for every . At this reads ; and if , then by step 2.1, so induction [L3] gives the bound at every natural.
Consequently for every , by [L1] and step 3.1.
Constant form and the logarithmic reading: the bound of step 4.1 is for every with the explicit constant , so [L4] gives . Since and by [L2], this is and the explicit bound is at every power-of-two length; this proves the claimed complexity and completes the proof.
Remarks
-
The direct-evaluation baseline. For the unnormalised transform of The unnormalised engineering DFT and its conversion to the unitary transform evaluates each of the coefficients as a sum of terms, needing additions and (if each term is formed separately) multiplications per coefficient, hence additions and multiplications in total; this is the baseline of Taylor §12 and the reason the bound of step 4.1 is an improvement for large . The comparison concerns the counted operation model only: the two bounds ignore different constants and neither says anything about rounding error.
-
What is not counted, and why that matters. Twiddle-factor evaluation, index arithmetic, memory traffic, bit complexity and numerical stability are all outside the model fixed in the Statement; the theorem is a statement about the number of complex multiplications and additions in the recursion as defined, not a machine-level running-time or accuracy claim. The bounded model is stated explicitly so that no later use silently strengthens it.
-
Asymptotic reading. By the local convention [L4], the explicit constant-form estimate gives , hence at length . The explicit constant and bound remain the load-bearing quantitative result.
Correctness of the recursive radix-two FFT
Statement
Let , and . Then
where is the unnormalised -point discrete Fourier transform of The unnormalised engineering DFT and its conversion to the unitary transform. Equivalently for the unitary transform of The unitary discrete Fourier transform on ; consequently the algorithm returns the unitary transform after the single rescaling , and it does so for every input of length . Correctness is separate from speed: the operation count is the subject of a different theorem, and no floating-point or stability claim is made here.
Facts & Assumptions
Given: The family of The recursive radix-two fast Fourier transform, the unnormalised transform and the unitary transform , and the statement : for every and every , .
Definition of the recursion: on , and for , with , and even/odd parts , one has for every , the subproblem outputs being extended -periodically (The recursive radix-two fast Fourier transform).
Radix-two factorisation: with , in place of , and even/odd parts of , and for every (The radix-two even/odd factorisation of the DFT).
The unnormalised transform at length is and satisfies ; at , because (The unnormalised engineering DFT and its conversion to the unitary transform, The unitary discrete Fourier transform on ).
Induction: a property holding at and inherited by successors holds at every natural (The principle of mathematical induction); and for (Laws of integer exponents, The natural numbers (von Neumann)).
Rational powers: , and (Rational powers of a positive base, Laws of rational exponents, claims 1, 2 and 5).
Proof
Base case : the group has the single class , , and while for every integer because the length-one transform is -periodic; hence for every .
Inductive hypothesis: fix and assume , that is for every and every integer .
Successor data: for the induction step from to , put and , and let have even and odd parts , so and .
Successor case: by [F1], ; the induction hypothesis of step 1.2 applies to and every integer , giving and . Substituting these equalities and applying the first radix-two factorisation [F2] with yields for every , which is .
By induction [L1], holds for every , which is the first display. For the equivalent form, [F3] gives since by [L2]; hence , and multiplying both sides by recovers the unitary transform from the output, so the rescaling is the only normalisation step needed.
Remarks
-
Use of the induction hypothesis. In the step from to , the hypothesis is applied at level to the even and odd parts. The combine is the radix-two factorisation, and the base case is the identity transform at length .
-
Correctness and the operation model are independent. Nothing in this proof counts operations or inspects the resources used by the recursion; conversely the complexity theorem does not reprove the identity. The two statements share only the definition of the algorithm and the factorisation lemma.
5 · Examples, counterexamples and false statements
None yet.
Sources
- Michael E. Taylor, Fourier Analysis, Distributions, and Constant-Coefficient Linear PDE (author PDF)
- Manfred Einsiedler and Thomas Ward, Ergodic Theory with a View Towards Number Theory, Appendix C (course-hosted full text)
- MIT 18.310 lecture 23, The Finite Fourier Transform and the Fast Fourier Transform Algorithm (course page)