Replicability, robustness, and reproducibility in psychological science

BA Nosek, TE Hardwicke, H Moshontz… - Annual review of …, 2022 - annualreviews.org
Replication—an important, uncommon, and misunderstood practice—is gaining
appreciation in psychology. Achieving replicability is important for making research …

Nonreplicable publications are cited more than replicable ones

M Serra-Garcia, U Gneezy - Science advances, 2021 - science.org
We use publicly available data to show that published papers in top psychology, economics,
and general interest journals that fail to replicate are cited more than those that replicate …

Epidemiological characteristics and prevalence rates of research reproducibility across disciplines: a scoping review of articles published in 2018-2019

KD Cobey, CA Fehlmann, M Christ Franco, AP Ayala… - Elife, 2023 - elifesciences.org
Introduction: Reproducibility is a central tenant of research. We aimed to synthesize the
literature on reproducibility and describe its epidemiological characteristics, including how …

Predicting replicability—Analysis of survey and prediction market data from large-scale forecasting projects

M Gordon, D Viganola, A Dreber, M Johannesson… - Plos one, 2021 - journals.plos.org
The reproducibility of published research has become an important topic in science policy. A
number of large-scale replication projects have been conducted to gauge the overall …

How large should the next study be? Predictive power and sample size requirements for replication studies

EW van Zwet, SN Goodman - Statistics in Medicine, 2022 - Wiley Online Library
We use information derived from over 40K trials in the Cochrane Collaboration database of
systematic reviews (CDSR) to compute the replication probability, or predictive power of an …

Increase in power by obtaining 10 or more controls per case when type-1 error is small in large-scale association studies

HA Katki, SI Berndt, MJ Machiela, DR Stewart… - BMC Medical Research …, 2023 - Springer
Background The rule of thumb that there is little gain in statistical power by obtaining more
than 4 controls per case, is based on type-1 error α= 0.05. However, association studies that …

Systematizing confidence in open research and evidence (score)

N Alipourfard, B Arendt, DM Benjamin… - …, 2021 - digitalcommons.odu.edu
Assessing the credibility of research claims is a central, continuous, and laborious part of the
scientific process. Credibility assessment strategies range from expert judgment to …

The assessment of replicability using the sum of p-values

L Held, S Pawel, C Micheloud - Royal Society Open …, 2024 - royalsocietypublishing.org
Statistical significance of both the original and the replication study is a commonly used
criterion to assess replication attempts, also known as the two-trials rule in drug …

The assessment of replication success based on relative effect size

L Held, C Micheloud, S Pawel - The Annals of Applied Statistics, 2022 - projecteuclid.org
Replication studies are increasingly conducted in order to confirm original findings.
However, there is no established standard how to assess replication success, and, in …

Food on the move: The impact of implied motion in pictures on food perceptions through anticipated pleasure of consumption

L Mulier, E Meersseman, I Vermeir, H Slabbinck - Foods, 2021 - mdpi.com
To tackle obesity, upgrading the image of healthy food is increasingly relevant. Rather than
focusing on long-term benefits, an effective way to promote healthy food consumption …