9  Repetition and consistency methods ✎ Outline

9.1 Between documents, eg Preregistration vs. paper

• Does the prereg match the paper? regcheck.app

9.2 Within document

9.2.1 Abstract vs. results

• Does the result in the abstract match the results section?
• Does the abstract label the preregistered analysis/primary outcome?

9.2.2 Within text or tables or figures

E.g., whether sample sizes are consistent within a PRISMA flow chart. e.g., this pubpeer comment.

9.2.3 Tables vs. text

• Do the tables match the text?

9.2.4 Introduction vs. analysis

• Does the explanans/explanandum switch between intro and analysis?

9.3 Overly consistent

• Over-representation of reported round or repeated difference scores, mean/SD/quartiles between groups, etc.
• Carlisle method, plus extension to allocation per arm between articles.