One statistical analysis must not rule them all

Abstract

In the 2020 Neuroimaging Analysis Replication and Prediction Study2, 70 teams used the same functional magnetic resonance imaging (MRI) data to test 9 hypotheses about brain activity in a risky-decision task. Here again, the coordinators concluded that differences in findings were due not to errors, but to the wide range of alternative plausible analysis decisions and statistical models. [...]journals could invite teams to contribute their own analyses in the form of comments on a recently accepted article. [...]multi-analyst projects usually excel in data sharing, transparent reporting and theory-driven research.