Alphabeta Math
TheoremStatement: AI-adaptedProof: AI-adaptedPipeline-generated
How statement and proof provenance work

The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.

  • Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
  • AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
  • AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.

These labels describe origin, not correctness: citations and verification chips remain separate evidence.

S4 convolution-filter arithmetic and numerical cost

Statement

Let N,r,L≥1, let r be fixed, and let A=Λ−PQ∗ with diagonal Λ∈CN×N, P,Q∈CN×r, and B,C∈CN, where ∗ denotes conjugate transpose. Let Δ>0, assume I−ΔA/2 is invertible, and choose M to be the least power of two with M≥L. For the length-M filter procedure, take the transformed output vector C~M=(I−AˉM)∗C as supplied input, where Aˉ=(I−ΔA/2)−1(I+ΔA/2). Assume that every root-grid diagonal resolvent and low-rank correction used by the procedure is invertible. In the exact complex arithmetic model, each scalar addition, multiplication, division, and zero test has unit cost. The length-L filter is KL=(C∗AˉjBˉ)j=0L−1. The procedure returns the first L coefficients of this filter using at most (r+1)2 roots-of-unity Cauchy products, O((N+L)log⁡2(2+N+L)) operations, and O(N+L) working space. The operation count is for filter evaluation from C~M; it does not include forming that vector from C. This bound applies in particular when the fixed matrices GS,GT,GL of the HiPPO low-rank theorem are used as time-independent state matrices, in their specified equivalent DPLR coordinates and subject to the same invertibility hypotheses. For LegS this means using the constant coefficient matrix GS; it does not assert a convolution representation for the original time-dependent LegS dynamics with coefficient GS/t.

For numerical evaluation, put a=2/Δ, β(z)=(1+z)/2, and D(z)=2R(z)/(1+z) at roots z≠−1, where R(z)=(a(1−z)/(1+z)I−Λ)−1. Define the scaled blocks x=C~M∗DB, u=C~M∗DP, v=Q∗DB, T=Q∗DP, and W=Ir+βT. Matrix infinity norm means maximum absolute row sum; for a column it is maximum absolute entry. Suppose certified constants b,w,s≥1 bound, over these roots, ∣x∣,∥u∥∞,∥v∥∞,∥T∥∞ by b, and ∥W−1∥∞ by w. For each scalar scaled-block Cauchy sum, require a certified pole/root separation d>0 and a weight bound A≥∑j∣aj∣ with A/d≤s; the finite constant contributions from λj=−a and the direct value at −1 are formed separately. Empty sums need no separation certificate. Set κ=64rw2(b+1)2s.

For 0<ε≤1/2, a numerical implementation returns K^L with ∥K^L−KL∥∞≤ε using O((N+L)log⁡(2+N+L)log⁡(κ/ε)) scalar operations and O(N+L) scalar words. On families with bounded κ, this is O((N+L)log⁡(2+N+L)log⁡(1/ε)). The numerical model uses variable-precision scalar operations, unrestricted exponent range and supplied certified input/root approximations; each operation and word access has unit cost. Word lengths and sufficient precision depend on separation, correction conditioning, intermediate magnitudes and accuracy. The finite circuit precision certificate in the proof is required; these counts exclude bit cost, computing certificates, and forming C~M. They imply no complete training-cost or long-context-accuracy bound.

The numerical procedure also receives the exact index partition {j:λj=−a} and {j:λj≠−a}, where a=2/Δ, so it can select the exceptional constant terms without a finite-precision equality test.

Facts & Assumptions

Given: The finite DPLR parameters, fixed rank, L≥1, M the least power of two at least L, the supplied transformed output vector, and the bilinear and root-grid invertibility hypotheses and, for the numerical procedure, the supplied exact partition of diagonal entries equal to −2/Δ and those unequal to it.

[F1]

S4 state-space recurrence and convolution procedure: with supplied C~M, the filter procedure evaluates the truncated generating function at the Mth roots, handles z=−1 by its finite value, applies the inverse radix-two transform, and returns the first L coefficients.

[F2]

DPLR SSM filter values reduce to Cauchy products: each root value is given by the DPLR resolvent formula, the z=−1 value is (Δ/2)C~M∗B, and the four matrix-vector families reduce to (r+1)2 scalar Cauchy products.

[F3]

Exact roots-of-unity Cauchy matvec has quasi-linear arithmetic cost: for n≥1 poles and an M-root grid with no collisions, the exact Cauchy product costs O((n+M)log⁡2(2+n+M)) operations and O(n+M) space.

[F4]

Roots-of-unity orthogonality and radix-two FFT cost: the radix-two DFT and inverse cost O(Mlog⁡(2+M)) operations and O(M) space, and inverse transformation recovers the polynomial coefficients exactly.

[F5]

HiPPO LegS, LegT, and LagT matrices have normal-plus-low-rank form after specified similarities: the fixed LegS coefficient matrix and the LegT and LagT generators, after the specified state-coordinate changes, admit DPLR form with rank at most two. The original LegS coefficient ODE has the additional time-dependent factor 1/t.

[F6]

Numerical Cauchy products on a root grid with explicit accuracy scale: a root-grid Cauchy sum with certified scale s has absolute error δ in O((N+M)log⁡(2+M)log⁡(s/δ)) scalar operations and linear word space. Its arc-tree truncation and variable-precision circuit estimates are proved locally, including root/input approximation errors and certified routing.

Proof

1.1givenF1F2F5

By [F5], each fixed matrix GS,GT,GL admits equivalent DPLR coordinates of bounded rank. When such a matrix is used as a constant state matrix and satisfies the stated invertibility hypotheses, it is an admissible input here. This does not identify the original time-dependent LegS ODE with a constant-matrix model. The operation argument applies to any supplied DPLR matrices of the same dimensions. By [F2], each required root value has the stated Cauchy-product expression, including the direct value at −1. Under the noncollision and correction-invertibility assumptions, the filter procedure in [F1] therefore computes all M generating values exactly.

1.2givenF2F6algebra

For z≠−1, R=βD. Substitution in [F2] gives HM(z)=x−βu(Ir+βT)−1v and W=Ir+βT. Also ∣β∣≤1. The pole mapping in [F2] expresses each entry of D as −2/(a+λj)(z−μj)−1 for λj≠−a, and as the constant Δ/2 otherwise. Thus the weights in [F6] are exactly −2fj‾gj/(a+λj) for the applicable vector pair f,g. Their preparation and the exceptional constant sums cost O(N) for fixed r. At −1, retain the direct value (Δ/2)C~M∗B from [F2], without a resolvent division.

2.1givenF2F3step 1.1algebra

Each scalar product has at most N poles and is evaluated on M roots. If it has at least one pole, [F3] bounds its cost by O((N+M)log⁡2(2+N+M)) operations and O(N+M) space; if it has no poles, its constant value is formed by a single finite sum in O(N+M) operations and space. There are at most (r+1)2 such products by [F2], a constant number because r is fixed. The per-root correction matrix products and inversions cost O(M(r+1)3) operations by finite-dimensional elimination, which is O(M) for fixed r.

2.2F1F4step 1.1algebra

The generating values are the DFT of the M coefficients C∗AˉjBˉ for 0≤j<M. By [F4], the inverse radix-two transform recovers these coefficients exactly; [F1] then returns their first L entries, which are precisely the length-L filter.

2.3givenstep 1.2algebra

Let δ=ε/[32rw2(b+1)2] and first consider exact arithmetic on truncated Cauchy sums having scalar entry errors at most δ, with finite constant sums exact. Denote the resulting blocks by x^,u^,v^,T^. Each of their infinity-norm errors is at most e=rδ, since each row has at most r entries and r≥1. Hence ∥W^−W∥∞≤e, we<1/2 and e≤1. Writing E=W−1(W^−W), the geometric series ∑j≥0(−E)j converges in infinity norm because ∥E∥∞≤we<1/2, is the inverse of I+E by finite geometric identities and passage to the norm limit, and has norm at most 2. Therefore ∥W^−1∥∞≤2w. The identity W^−1−W−1=−W−1(W^−W)W^−1 gives ∥W^−1−W−1∥∞≤2w2e.

3.1givenF1F2F3F4step 2.1step 2.2algebra

Since M is the least power of two at least L, M<2L for every integer L≥1. Combining the Cauchy products, per-root corrections, and inverse transform gives O((N+L)log⁡2(2+N+L)) exact complex arithmetic operations. Processing the Cauchy products sequentially uses O(N) product-tree workspace; their (r+1)2 root-value arrays, the correction matrices, and the inverse transform use O(M(r+1)2) additional space. Fixed r and M<2L give total O(N+L) working space. The proof counts the supplied C~M as input and does not count its formation from C.

3.2givenF4step 1.2step 2.3algebra

Expanding the difference of the two triple products as (u^−u)W^−1v^+u(W^−1−W−1)v^+uW−1(v^−v) and using step 2.3 bounds its modulus by 2we(b+1)+2bw2e(b+1)+bwe. Adding the error in x and using ∣β∣≤1 bounds each generating-value error by e[1+2w(b+1)+2bw2(b+1)+bw]≤9w2(b+1)2e≤9ε/32. The direct −1 value has no truncation error. The exact inverse DFT averages M unit-modulus multiples in each output coordinate, so its infinity operator norm is at most one; consequently the exact inverse transform of these approximations has coefficient error at most 9ε/32.

4.1givenF2F4F6step 3.1step 2.3algebra

Apply [F6] with absolute tolerance δ to each scalar sum; its exact truncated circuit has error at most δ, as required above. Although [F6] is stated on ζj=e2πij/M, the filter grid is zk=e−2πik/M=ζ(−k mod M); run each numerical Cauchy product on the positive grid and permute its outputs to the filter order, in O(M) operations and words, preserving the maximum error and pole/root separation bounds. It uses p=O(log⁡(s/δ))=O(log⁡(κ/ε)) terms. There are at most (r+1)2 sums, processed sequentially; their arrays and the fixed-size blocks use O(N+M) words. The per-root inverses can be computed by the adjugate/determinant formula, which is constant work for fixed r and has nonzero determinants by step 2.3. Add the radix-two inverse transform and finite sums: the scalar count is O((N+M)log⁡(2+N+M)log⁡(κ/ε)). The replacement M<2L gives the stated count and space.

5.1givenF6step 2.3step 3.2step 4.1algebra∎

To include every rounding error, regard the entire selected computation, from supplied DPLR parameters, transformed vector and root/arc constants through weight formation, Cauchy sums, finite constants, adjugate inverses and inverse FFT, as one finite rational circuit. Include conjugations as exact sign changes. Require certified T0,V0,D0 with T0 an upper bound on its gates, V0≥1 an upper bound on exact intermediate moduli, and 0<D0≤1 a lower bound on every exact divisor modulus. Such bounds exist for each input because step 2.3 proves all truncated correction inverses exist and all other divisions are nonzero by the hypotheses. Put K0=64(V0+1)2/D02 and select input and gate accuracy u≤min⁡(1,D0/2,ε/2)/(2K0T0+1), also sufficient for the certified overlapping routing tests of [F6]. The gate recurrence proved in [F6] then gives final additional error at most ε/2, including errors in supplied parameters, roots, weights, β, correction inverses and twiddle factors. Together with step 3.2 this is less than ε. No precision selection changes the scalar count or scalar-word count, although their bit cost can grow. Bounded κ gives log⁡(κ/ε)=O(log⁡(1/ε)); arbitrary conditioning retains the explicit κ term.

Remarks

S4 Appendix C.3, Proposition 5 reports O((N+L)log⁡(N+L)log⁡(1/ε)) numerical operations and linear space, without specifying the accuracy norm, word length or conditioning margins. The theorem above preserves that numerical asymptotic on explicitly bounded-conditioning families and gives an absolute-error bound with the conditioning factor exposed for general certified inputs. It does not assert a uniform fixed-precision or bit-complexity interpretation of the reported claim. Arbitrarily near pole/root collisions require growing input precision; nearly singular Woodbury corrections amplify block errors. Neither qualification concerns training or empirical long-context performance.

Depends on

Used by

Dependency tree · two levels

12 results within two dependency steps of this one, each drawn at its shortest distance from it. An arrow runs from a result to what uses it, so the chart reads left to right and ends at this result, which carries a heavier outline. Every node is a link to that result. Click elsewhere on the chart to enlarge it.

Sources