Teaching replication

MC Frank, R Saxe - Perspectives on Psychological Science, 2012 - journals.sagepub.com
Replication is held as the gold standard for ensuring the reliability of published scientific
literature. But conducting direct replications is expensive, time-consuming, and unrewarded …

Sample sizes and effect sizes are negatively correlated in meta-analyses: Evidence and implications of a publication bias against nonsignificant findings

TR Levine, KJ Asada, C Carpenter - Communication Monographs, 2009 - Taylor & Francis
Meta-analysis involves cumulating effects across studies in order to qualitatively summarize
existing literatures. A recent finding suggests that the effect sizes reported in meta-analyses …

Correcting for bias in psychology: A comparison of meta-analytic methods

EC Carter, FD Schönbrodt… - … in Methods and …, 2019 - journals.sagepub.com
Publication bias and questionable research practices in primary research can lead to badly
overestimated effects in meta-analysis. Methodologists have proposed a variety of statistical …

Too true to be bad: When sets of studies with significant and nonsignificant findings are probably true

D Lakens, AJ Etz - Social Psychological and Personality …, 2017 - journals.sagepub.com
Psychology journals rarely publish nonsignificant results. At the same time, it is often very
unlikely (or “too good to be true”) that a set of studies yields exclusively significant results …

Meta-analysis using effect size distributions of only statistically significant studies.

MALM Van Assen, R van Aert… - Psychological …, 2015 - psycnet.apa.org
Publication bias threatens the validity of meta-analytic results and leads to overestimation of
the effect size in traditional meta-analysis. This particularly applies to meta-analyses that …

Small telescopes: Detectability and the evaluation of replication results

U Simonsohn - Psychological science, 2015 - journals.sagepub.com
This article introduces a new approach for evaluating replication results. It combines effect-
size estimation with hypothesis testing, assessing the extent to which the replication results …

Reproducibility of individual effect sizes in meta-analyses in psychology

E Maassen, MALM Van Assen, MB Nuijten… - PloS one, 2020 - journals.plos.org
To determine the reproducibility of psychological meta-analyses, we investigated whether
we could reproduce 500 primary study effect sizes drawn from 33 published meta-analyses …

Publication bias against null results

R Hubbard, JS Armstrong - Psychological reports, 1997 - journals.sagepub.com
Publication Bias against Null Results Page 1 Psychological Reports, 1997,80,337-338. O
Psychological Reports 1997 PUBLICATION BIAS AGAINST NULL RESULTS ' RAYMOND …

The power of statistical tests in meta-analysis.

LV Hedges, TD Pigott - Psychological methods, 2001 - psycnet.apa.org
Calculations of the power of statistical tests are important in planning research studies
(including meta-analyses) and in interpreting situations in which a result has not proven to …

Replication and researchers' understanding of confidence intervals and standard error bars

G Cumming, J Williams, F Fidler - Understanding statistics, 2004 - Taylor & Francis
Confidence intervals (CIs) and standard error bars give information about replication, but do
researchers have an accurate appreciation of that information? Authors of journal articles in …