How statement and proof provenance work
The first chip identifies the source of the statement or construction; the second identifies the source of its local proof or verification.
- Literature-sourced: the exact statement appears in a cited source; only wording and notation differ.
- AI-adapted: a semantically identical restatement of literature-sourced material, modulo indexing, notation, and boundary cases adopted by the library.
- AI-generated: a genuinely novel statement formulated by AI, with no source for the claim itself.
These labels describe origin, not correctness: citations and verification chips remain separate evidence.
Reproducibility and transparent reporting — Examples
1 · Prerequisites
2 · Summary
The example uses small synthetic datasets to distinguish re-running a fixed calculation on the same data, changing a documented grouping rule, and conducting a separate study with its own new data. It makes only descriptive arithmetic claims and does not certify whether the two study estimates are consistent.
3 · Logical flowchart
4 · Definitions, theorems and proofs
None yet.
5 · Examples, counterexamples and false statements
A documented grouping change and a new-data study
Example
All observations below are synthetic. The descriptive question is how the mean outcome differs between the older and younger age groups. In Study 1, the pre-specified rule assigns ages at most 20 to the younger group and ages above 20 to the older group. The reported contrast is older-group mean minus younger-group mean.
| Study 1 record | Age | Outcome |
|---|---|---|
| A | 18 | 10 |
| B | 19 | 11 |
| C | 21 | 13 |
| D | 22 | 14 |
An exploratory reanalysis of the same four rows instead uses a cut point of 18: ages at most 18 are younger, and ages above 18 are older. This changes the grouping rule and therefore the descriptive contrast being computed.
A separate Study 2 collects new observations while addressing the same pre-specified age-group question and using the original cut point of 20.
| Study 2 record | Age | Outcome |
|---|---|---|
| E | 17 | 9 |
| F | 20 | 10 |
| G | 21 | 12 |
| H | 24 | 14 |
A transparent account states both cut points, that the second Study 1 analysis was exploratory and chosen after inspecting the first table, and that no rows were excluded. It gives the data and arithmetic below, marks the values as synthetic, and makes no population, causal, or inferential claim. No software is needed for these calculations; a computational report using software would also identify relevant software and environment details. The Study 2 estimate alone does not decide whether the studies' results are consistent: no uncertainty assessment or consistency criterion is supplied here.
Facts & Assumptions
Given: For a nonempty finite group of records with real outcomes , let , where is the number of records; the mean of an empty group is undefined. Let be the older- group mean minus the younger-group mean, with the age cut points and the two tables as specified in the Example.
Computational reproducibility, replicability, and transparent reporting: computational reproducibility keeps the input data, computational steps, methods and code, and analysis conditions the same.
Computational reproducibility, replicability, and transparent reporting: replicability compares studies answering the same scientific question using each study's own newly obtained data.
The two tables are constructed solely for this example; all four rows in each study are used, group means are unweighted arithmetic means, and no uncertainty model or consistency threshold is assumed.
Verification
Under Study 1's pre-specified cut point of 20, the younger outcomes are and the older outcomes are . Their means are and , respectively, so .
Under the alternate cut point of 18, the younger mean is and the older mean is , so the contrast is . The raw rows are unchanged from step 1.1, but the grouping rule and resulting contrast differ.
Reapplying the Study 1 pre-specified grouping and the same mean calculation to the same rows returns . The table, cut point, formula, row set, and manual arithmetic are unchanged, so this illustrates the same-input computation comparison in [F1]; it concerns reproduction of the calculation, not whether the grouping or conclusion is correct.
Study 2 has its own new rows. Under the same cut point of 20, the younger mean is and the older mean is , giving . It is a replication attempt under [F2], but these point estimates alone cannot determine consistency without uncertainty and a stated comparison criterion.
Sources
- National Academies of Sciences, Engineering, and Medicine, Reproducibility and Replicability in Science (2019), Chapter 3: Understanding Reproducibility and Replicability
- Greg Wilson, Jennifer Bryan, Karen Cranston, Justin Kitzes, Lex Nederbragt, and Tracy K. Teal, Good enough practices in scientific computing, PLoS Computational Biology 13(6):e1005510 (2017)