How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Parallel in time parareal and mgrit
1 · Prerequisites
- Absolute and Conditional Convergence; Rearrangement; Products
- Binary Operations, Monoids, Groups and Subgroups
- Compactness in Metric Spaces
- Completeness, Completion, and Uniform Continuity
- Construction of the Natural Numbers
- Construction of the Real Numbers via Cauchy Sequences
- Construction of the Real Numbers via Dedekind Cuts
- Continuity, IVT, EVT, and Uniform Continuity
- Countability and Uncountability
- Filters and Ultrafilters
- Finite Counting, Factorials and Binomial Coefficients
- Finite Probability and the Probabilistic Method
- Foundations of the Real Numbers for Analysis
- Implicit stiff time stepping and algebraic error
- Limits of Real Functions
- limsup, liminf, and Subsequential Limits
- Linear Independence, Bases and Dimension
- Linear Transformations, Rank-Nullity and Quotient Spaces
- Metric Spaces
- Monotone Functions, Discontinuities, and Continuity Sets
- Monotone Sequences, Bolzano-Weierstrass, and Cauchy Completeness
- One-step ODE Consistency and Local Error
- Order, Zorn's Lemma, and the Axiom of Choice
- Picard-Lindelöf and First-Order Ordinary Differential Equations
- Power Series and Real-Analytic Functions
- Properties of the Integral and the Working FTC
- Relations, Functions, and Quotients
- Rings, Subrings, Integral Domains and Fields
- Rⁿ as a Normed Space; Vector-Valued Functions
- Roots, Rational Powers, and Classical Inequalities
- Runge–Kutta Methods and Order
- Sequences and Limits
- Sequences and Series of Functions; Uniform Convergence
- Series: Convergence and the Nonnegative Tests
- Suprema and Infima
- The Derivative and the Mean Value Theorems
- The Exponential Function
- The Riemann Integral: Definition and Integrability
- The ZFC Axioms and the Basic Set Constructions
- Topology of ℝ
- Vector Spaces, Linear Subspaces, Span and Direct Sums
2 · Summary
Summary
Parareal corrects a serial coarse trajectory with parallel fine propagations. The canonical ODE instantiation uses explicit Runge–Kutta microsteps for the fine map and a selected successful backward Euler endpoint for the coarse map. Its exact-arithmetic recurrence reproduces the first fine nodes after sweeps. Under common-set Lipschitz bounds it has a binomial error estimate; any inexact propagation or correction contributes an explicit update defect. The target is the sequential fine-method trajectory. A separate fine-method estimate is required to compare that trajectory with an exact ODE solution.
MGRIT writes a linear time recurrence as an all-at-once bidiagonal system, eliminates F-points to identify the exact coarse Schur operator, and defines a practical two-level coarse correction with F or FCF relaxation. A two-grid cycle contracts only when its actual error matrix has norm below one in the declared block norm; residual/error comparison also assumes finite induced norms for the fine operator and its inverse. The local scalar heat calculation is not a general rate, and the two-grid theorem does not establish multilevel convergence. Work and span depend on propagator costs, processor count, communication, cycle count, and all visited levels.
3 · Logical flowchart
4 · Definitions, theorems and proofs
Fine and coarse propagators on a common macro grid
Definition
Let , let , and fix macro times . A fine/coarse propagator pair is a pair of deterministic maps and , for each , where are their admitted input sets. Both maps advance a state across the same interval . The labels fine and coarse identify the two roles chosen by the user; they assert no accuracy, stability, cost, or convergence property.
For an initial state , whenever every call succeeds, the sequential fine trajectory is the finite sequence , and the sequential coarse trajectory is defined by replacing each with . A partially defined map is unavailable outside its admitted set; a failed stage evaluation or an unavailable implicit branch is a propagation failure, not a numerical value.
A canonical ODE instantiation uses the explicit Runge–Kutta stage map of Explicit Runge–Kutta tableaus, stage maps, and failure status for fine substeps of size , composed in order to form . A coarse backward Euler value is an endpoint satisfying the equation in Backward Euler step equation and algebraic residual over the full macro interval. Its branch selector is part of the input and must select exactly one admissible root for each admitted start state; if no such selected root exists, the coarse map is unavailable. The backward Euler definition alone asserts neither root existence nor uniqueness.
This definition distinguishes the sequential fine trajectory from samples of an exact ODE solution. Any estimate of the fine method's error relative to that exact solution is a separate obligation.
Finite-budget Parareal correction sweeps
Definition
Input: an admissible propagator pair from Fine and coarse propagators on a common macro grid, initial state , number of macro intervals , integer sweep budget , and optionally a wall-clock budget and certificate data . Here is a supplied certificate, is a declared predicate on completed rows, and is a supplied deterministic verifier that terminates with a Boolean for every completed row and satisfies . Without certificate data, take to return false. Every map call is required to terminate with a state or declared failure. Each map call either returns one state or a declared failure status. The output contains every fully completed row of the table for , the last completed endpoint when one exists, and a status. If initialization never completes, return an empty completed-row table and no endpoint.
Initialize and, in increasing order of , set . Store the values . For each , set . Evaluate independently for all ; the stored values are reused from the preceding row. Then, in increasing order of , compute and set The fine calls in a sweep can run in parallel, while the corrected row is computed sequentially.
If a map call fails, return the last fully completed row and status propagation-failure; a prefix of the failed row may be reported separately but is not a completed iterate. If the time budget expires at a call boundary, return the last fully completed row and status budget-exhausted. When initialization and all requested sweeps finish, call on the final row and (or use false when no certificate was supplied). Return status converged if this returns true, certifying the declared predicate ; otherwise return status budget-exhausted. Completion of the finite budget alone is not a convergence certificate.
For the exact-arithmetic recurrence, an update computed with inexact fine/coarse values or an inexact correction solve can be written as the displayed right-hand side plus a combined defect . A residual tolerance alone does not bound that defect in forward error.
The all-at-once bidiagonal time operator and C/F points
Definition
Let , let for , and let be fixed. The linear part of a fine propagator in Fine and coarse propagators on a common macro grid is represented by . For forcing vectors , write the fine recurrence as . On the unknown vector , define by and for . With and for , the recurrence is exactly .
For a coarsening factor dividing , the coarse indices are . Among unknowns, let and . Reordering the unknown vector as gives A practical coarse propagator on each interval is the linear subcase of the coarse maps in Fine and coarse propagators on a common macro grid; the exact coarse operator is determined by eliminating F-points and is not generally the same as this practical choice. This definition asserts no stability or convergence property.
Parareal reproduces the first k fine-grid nodes after k sweeps
Statement
For the exact-arithmetic recurrence in Finite-budget Parareal correction sweeps, let be the initial state and its sequential fine trajectory. For every completed sweep and every , . Consequently, if the requested sweep budget is fully completed, the returned table contains the complete sequential fine trajectory in row .
Facts & Assumptions
Given: The exact-arithmetic recurrence is defined on the rows considered; each row called completed is formed from successful evaluations.
Fine and coarse propagators on a common macro grid: the sequential fine trajectory is from .
Finite-budget Parareal correction sweeps: for every sweep, the initial row is coarse-propagated, and each correction is . The algorithm returns every fully completed row and may stop early after a propagation failure or time-budget expiry.
Proof
At sweep , the only claimed node is , and by initialization and the definition of the fine trajectory [F1].
Suppose the claim holds at sweep . At sweep , by [F2]. Induct on from to ; if , then also gives , so [F2] yields by [F1]. Thus the claim holds through node .
Induction on proves the first assertion. If the requested rows all complete and , applying it at gives for every ; by [F2], row is in the returned table.
A conditional binomial error bound for Parareal
Statement
Let be the sequential fine trajectory and let be the exact-arithmetic table from Finite-budget Parareal correction sweeps. Let contain every and every iterate used in the requested sweeps. Suppose constants satisfy, for every and , and for all . Use for the number of -element subsets of an -element set, set it to for , and put . Then for every node and completed sweep , with . The hypotheses include all comparison points; invariance of under alone does not ensure that corrected iterates stay in .
For a fixed horizon , suppose , for constants and integer , and one works uniformly as varies. Then, for each fixed , Thus the exact-solve error is at each fixed iteration under these uniform assumptions. Neither estimate includes finite-solver error; that effect requires a separate update-defect analysis.
Facts & Assumptions
Given: The exact Parareal recurrence, its sequential fine trajectory, a common comparison set, and the stated Lipschitz and initial-error bounds.
Fine and coarse propagators on a common macro grid: the sequential fine trajectory is from .
for every real , hence : for every real , .
The exponential addition formula : for real .
The real exponential function and the number by a power series: for every real , is defined by the convergent series .
All fine and coarse evaluations are exact and defined, all comparison points lie in , the two Lipschitz inequalities hold on , and the coarse initial-row errors are at most .
In the fixed-horizon branch, , , , , , and the envelope is independent of .
Proof
Put . Subtract from the recurrence in [F2] and add and subtract ; this gives . By [A1] and the triangle inequality in [F3], , where .
At node , for every by [F2]. At sweep , [A1] gives . These are the initial cases for induction on the node, simultaneously over all completed sweeps.
Assume the bound holds at node . For the level-zero row at node , [A1] gives . For each , [step 1.1] gives . The last inequality uses and . Partitioning the -element subsets of an -element set according to whether they contain its final element gives , including the zero convention. Thus the bound holds at node , and induction proves the first estimate.
In the fixed-horizon branch, by [A2], [F4], and the definition of in [F6]. Repeated use of [F5] gives . Each -element subset of an -element set has a unique increasing -tuple, so . Substituting these bounds and into the first estimate gives . For fixed and uniform , this is .
Eliminating F-points gives the exact coarse time operator
Statement
Use The all-at-once bidiagonal time operator and C/F points with , , and its F/C partition. Both and are invertible. Eliminating the F unknowns from gives the coarse system with Schur complement On coarse interval , its recurrence is where with an empty product defined to be the identity. If for every fine step, the exact coarse propagator is .
Facts & Assumptions
Given: The finite fine recurrence, its all-at-once block matrix, and the C/F partition.
The all-at-once bidiagonal time operator and C/F points: the fine equations are with identity diagonal blocks, and .
Proof
For any right-hand side, solve the fine equations in increasing index: the first unknown is determined by its identity diagonal block, and each later unknown is uniquely . This proves is invertible. Holding all C-values fixed, the F-equations in each interval between consecutive C-points have the same forward-substitution form with identity diagonal blocks, so they uniquely determine the F-values; hence is invertible.
In the reordered block system, the F rows give . Substituting this expression in the C rows gives . Conversely, any solution of this coarse system, together with the displayed formula for , satisfies both the F and C rows. Thus elimination preserves exactly the solution set.
Repeated substitution in , for , gives . For the product is empty and equals . This is exactly the coarse recurrence in the Statement; the coefficient product reduces to when every .
An additive error ledger for inexact Parareal sweeps
Statement
Use the notation and Lipschitz hypotheses of A conditional binomial error bound for Parareal, with . Let computed iterates satisfy , , and, for each requested correction, for a constant . Define and a nonnegative forcing array by , , and Then for every completed node and sweep.
The base envelope includes coarse-initialization error relative to the fine trajectory. The per-update defect must bound the actual combined effect of fine/coarse evaluation errors and correction-solve error; a residual tolerance alone supplies no forward-error bound.
Facts & Assumptions
Given: The Parareal Lipschitz hypotheses, the stated computed recurrence defect, and the definitions of and .
A conditional binomial error bound for Parareal: with , the exact-arithmetic error is bounded by .
Every computed comparison point lies in the common set on which the two Lipschitz bounds hold, and the combined update defect has norm at most .
Proof
Set . Subtracting from the computed recurrence, splitting off the update defect, and applying the two Lipschitz inequalities gives .
At node , , for , and ; at , the base coarse-error assumption gives .
Assume at node for every completed sweep. For , step 1.1 gives . The terms satisfy because and Pascal's identity holds. The remaining terms equal by definition. Therefore the bound holds at node ; induction proves it for all nodes and sweeps.
A declared two-level MGRIT coarse-correction cycle
Definition
Input: a linear fine-grid system with fine intervals as in The all-at-once bidiagonal time operator and C/F points, a coarsening factor dividing and its C/F partition as in Eliminating F-points gives the exact coarse time operator, practical coarse propagators for , an initial fine-grid iterate , pre- and post-relaxation choices from , a real-valued norm on the fine-grid residual space as in A norm on a real vector space, the induced metric, and the dictionary with the metric axioms, a nonnegative integer cycle budget , and a residual tolerance . The symbol is the number of permitted cycles; the coarse-interval count is (the letter in Eliminating F-points gives the exact coarse time operator denotes that lemma's coarse-interval count). The output is the last iterate, its residual norm, the number of completed cycles, and status converged or budget-exhausted.
In F/C ordering define ideal interpolation and restriction by
The exact coarse operator is the Schur complement from Eliminating F-points gives the exact coarse time operator. The practical correction matrix has identity diagonal blocks and subdiagonal blocks for ; its first row corresponds to the fixed zero initial correction . For any right-hand side , forward substitution uniquely solves by setting and, in increasing order for , setting . Thus is invertible even when an individual is singular.
Define the relaxations on as follows. An F-relaxation holds every C-value fixed and, for each coarse interval , updates its F-indices in increasing order: set if , and otherwise set . Different coarse intervals have independent F-updates and may be processed in parallel. A C-relaxation holds every F-value fixed and, for in increasing order, sets ; these C-updates are independent because and each predecessor is an F-index. An FCF-relaxation applies F-relaxation, then C-relaxation, then F-relaxation. Each relaxation is a finite linear update; write and for the error maps of the selected pre- and post-relaxations.
For one cycle from a current iterate , apply the selected pre-relaxation; form and ; solve by the forward substitution above; correct ; then apply the selected post-relaxation. The exact error-propagation matrix of this fixed cycle is
Initialize and compute . If this is at most , return , zero completed cycles, and status converged. Otherwise, for , perform one cycle, call the resulting iterate , and compute . If this norm is at most , return that iterate, completed cycles, and status converged; if not, continue. If all cycles finish without this condition (including when ), return the last iterate, its residual norm, and status budget-exhausted. The matrix describes exact arithmetic and exact coarse solves; inexact solves contribute an update defect that needs its own bound.
Separate Parareal iteration error from fine-method error
Statement
Let solve a first-order initial-value problem as in First-order systems, initial value problems, and solutions on intervals, and let be the sequential fine trajectory from Fine and coarse propagators on a common macro grid on a grid . Suppose the inexact Parareal ledger gives , and suppose a separately established fine-method estimate gives for some and every node. Then The quantity must come from an independent analysis of the selected fine method and its hypotheses; this corollary does not prove a local defect, stability, or continuous-time error estimate.
Facts & Assumptions
Given: A continuous reference solution, the sequential fine trajectory, the Parareal update-defect ledger, and a separate uniform bound for the fine trajectory.
First-order systems, initial value problems, and solutions on intervals: an ODE solution is defined on an interval, stays in its open time-state domain, and satisfies the differential equation there.
Fine and coarse propagators on a common macro grid: the sequential fine trajectory is from .
The separate fine-method estimate is for every grid node.
Proof
By [F2], is the sequential fine node; since , [F1] gives the solution value . Insert and subtract and apply the norm triangle inequality: .
Substitute the two given bounds from [A1] and [F3]. This gives the displayed conclusion, while leaving as a separate fine-method obligation.
A verified MGRIT error-matrix contraction controls error and residual
Statement
Let be the fine-grid system from The all-at-once bidiagonal time operator and C/F points. By Eliminating F-points gives the exact coarse time operator, is invertible. Let be the exact error matrix for one fixed two-level cycle in A declared two-level MGRIT coarse-correction cycle. Choose a real-valued norm on and define its induced operator norm by . Assume and are finite for this norm. If a direct calculation or other proof establishes , then after cycles the error satisfies , with the convention . The residual obeys , and for every error/residual pair,
The contraction hypothesis is a property to prove for the declared operators, norm, and cycle. The MGRIT name alone supplies no such bound, and this theorem makes no multilevel convergence claim.
Facts & Assumptions
Given: A finite linear time system, the declared exact two-level cycle and a chosen product-space norm.
A declared two-level MGRIT coarse-correction cycle: one cycle has error matrix .
Eliminating F-points gives the exact coarse time operator: the fine-grid operator is invertible.
A norm on a real vector space, the induced metric, and the dictionary with the metric axioms: the chosen vector norm separates zero: if and only if .
The directly calculated or proved induced norm satisfies .
The induced norms and are finite for the chosen product-space norm.
Proof
By [F1], one cycle sends the current error to .
At the claimed inequality is equality. If the bound holds at and , [F3] gives and the next bound follows. If , the induced-norm definition in the Statement and [A1] give . Induction proves the error bound for every .
Since , subtraction gives . If , [F3] gives . Otherwise the induced-norm definition in the Statement and [A2] give , and step 2.1 yields the displayed residual estimate.
For any error/residual pair, and [F2] gives . If , then and [F3] gives both inequalities. If , invertibility forces , so the induced-norm definition in the Statement and [A2] give both and .
Recursive multilevel MGRIT cycles
Definition
Input: levels with ; fine-grid systems of the form in The all-at-once bidiagonal time operator and C/F points; coarsening factors dividing with ; transfers from the F/C construction in A declared two-level MGRIT coarse-correction cycle; and pre/post-relaxations selected from its F- and FCF-relaxations. At each level , form the practical coarse matrix with identity diagonal blocks and subdiagonal blocks as in A declared two-level MGRIT coarse-correction cycle. Each noncoarsest level has a positive integer recursive visit count . Also supply an initial fine-level iterate, a chosen norm on the fine-level residual space as in A norm on a real vector space, the induced metric, and the dictionary with the metric axioms, outer cycle budget , and residual tolerance . The hierarchy must provide a nonsingular coarse system at every level and an exact solve on level . V-cycles use and W-cycles use . This algorithm gives no existence or convergence claim for a hierarchy that fails these input conditions.
For a recursive call at level , perform the following operations on an initial guess :
- If , solve exactly by forward substitution and return.
- Apply the selected pre-relaxation to ; compute and restrict it to .
- Set the coarse correction . Repeat times: form ; recursively apply the level cycle to from zero initial correction; then set .
- Correct and apply the selected post-relaxation.
Return the updated fine-level vector when the call completes. At level , check the residual before the first outer cycle and after every completed cycle; return status converged only when the residual tolerance is met. After cycles without a verified residual certificate, return the last iterate with status budget-exhausted. Inexact level solves contribute explicit update defects; no such defect is hidden in the exact-arithmetic cycle.
No two-grid contraction is transferred to this recursive cycle; convergence requires a bound for its actual full recursive error operator.
Work and idealized span of completed Parareal sweeps
Statement
Suppose initialization and all sweeps of Finite-budget Parareal correction sweeps complete successfully. They make fine calls and coarse calls. In an accounting model with constant nonnegative call costs , processors for a positive integer , fine calls scheduled without idle time in batches of except possibly the last, serial coarse calls, and additive synchronization cost per sweep, their modeled work and span are respectively This model excludes vector arithmetic, storage, certificate verification and any overhead other than the declared synchronization cost. It gives no measured speedup guarantee.
Facts & Assumptions
Given: Successful completion and the accounting model in the Statement; and are integers.
Finite-budget Parareal correction sweeps initializes one serial coarse row, then evaluates all fine calls and new coarse calls per sweep, reusing the preceding row's stored coarse values.
Proof
Initialization makes coarse calls. Each of the sweeps in [F1] makes fine calls and new coarse calls, so the totals are and . Multiplying by the stipulated costs and adding synchronization charges gives .
Each fine phase has independent equal-cost calls. Filling each batch except possibly the last gives batches, taking without idle time. Initialization takes , and each sweep has this fine phase followed by serial coarse calls and one synchronization charge. Adding these sequential phases gives , including and zero call costs.
Propagator call counts for the two-level MGRIT cycle
Statement
For the literal operations of A declared two-level MGRIT coarse-correction cycle, put and . One F-relaxation uses fine-propagator calls; one C-relaxation uses ; and one FCF-relaxation uses . The specified coarse forward substitution uses practical coarse-propagator applications, including the evaluation at . These counts concern completed operations without eliminating calls at zero inputs.
In an additive accounting model with nonnegative call costs , the modeled work is , where count all executed calls and accounts for all remaining work. Residuals, restriction, interpolation and stopping checks must contribute their actual calls and overhead; cached values incur no new call. A parallel schedule must respect the serial order within each F-interval and in the coarse solve, and its communication and synchronization. No measured speedup is asserted.
Facts & Assumptions
Given: The declared literal implementation, dividing , completed operations and the additive accounting convention of the Statement.
A declared two-level MGRIT coarse-correction cycle updates every F-index, using without a propagator; each other F-update and each C-update applies one fine propagator. FCF means F, then C, then F. The coarse solve computes for .
Proof
There are C-indices among unknowns, leaving F-indices. Exactly the boundary assignment in [F1] omits a fine call, giving calls. Each of the C-updates makes one call. Adding two F counts and one C count gives the stated FCF count, including , where the F count is zero.
The coarse loop in [F1] has iterations and executes one application per iteration, including . Summing the stipulated charge for every executed call and remaining operation gives the work formula. Each F-index uses the preceding index in its interval, and the coarse loop uses ; any execution schedule must preserve these dependencies and account for its other costs.
Finite recursion and work accounting for multilevel MGRIT
Statement
For one top-level call of Recursive multilevel MGRIT cycles on a finite admissible hierarchy with terminating primitive operations, the recursion terminates. Its visit counts satisfy and for .
Suppose every visit to noncoarsest level has the same local call counts , excluding its recursive children. In an additive accounting model with nonnegative call costs , remaining local work , and work per coarsest solve, its modeled work is Each local F-, C- or FCF-relaxation has the literal fine-call counts , or respectively. Residual formation, repeated coarse residuals, restriction, interpolation and correction contribute all their actual calls and overhead; caching incurs no new call. If counts or costs vary by visit, replace each product by the sum of the corresponding visit charges. Outer stopping checks have additional costs.
Parallel execution must respect the order within each F-interval, between the successive recursive visits that update the same correction, and within each exact coarse forward solve, including communication and synchronization. The accounting model implies no measured speedup or multilevel contraction.
Facts & Assumptions
Given: A finite admissible hierarchy, finite positive integer visit counts, terminating primitives and the accounting model in the Statement.
Recursive multilevel MGRIT cycles solves exactly on level ; on level it invokes the level cycle exactly times in sequence, recomputing each residual from the updated correction.
Propagator call counts for the two-level MGRIT cycle gives the literal F, C and FCF call counts for a grid whose initial state is absorbed into its first right-hand-side block.
Proof
A call on level terminates by the stipulated finite exact forward solve. If calls on level terminate, [F1] makes a finite number of them and otherwise executes only finite local operations, so a level call terminates. Downward induction proves termination on level . There is one root call and every level visit has exactly children, giving the stated visit recurrence.
Each noncoarsest visit has its stated local work charge, and every coarsest visit costs . Partition all operations by their unique executing visit and sum the charges to obtain . At level the inherited relaxation has and , so [F2] supplies its three call counts, including the boundary assignment without a call. The data dependencies in [F1] and in each relaxation/forward solve require the stated scheduling order. Summing actual visit charges also covers unequal costs, and outer checks are outside the recursive call.
5 · Examples, counterexamples and false statements
None yet.
Sources
- R. D. Falgout, S. Friedhoff, Tz. V. Kolev, S. P. MacLachlan, and J. B. Schroder, Parallel Time Integration with Multigrid
- Martin J. Gander, 50 Years of Time Parallel Time Integration
- Martin J. Gander, Time Parallel Time Integration, Chapter 2: Methods Based on Multiple Shooting
- Martin J. Gander, Time Parallel Time Integration, Chapter 4: Space-Time Multigrid Methods
- Martin J. Gander, 50 Years of Time Parallel Time Integration, in Multiple Shooting and Time Domain Decomposition Methods
- Ben S. Southworth, Necessary Conditions and Tight Two-Level Convergence Bounds for Parareal and Multigrid Reduction in Time
- V. A. Dobrev, Tz. Kolev, N. A. Petersson, and J. B. Schroder, Two-Level Convergence Theory for Multigrid Reduction in Time
- R. D. Falgout et al., Parallel Time Integration with Multigrid