Choosing prediction over explanation in psychology: Lessons from machine learning

T Yarkoni, J Westfall - Perspectives on Psychological …, 2017 - journals.sagepub.com
Psychology has historically been concerned, first and foremost, with explaining the causal
mechanisms that give rise to behavior. Randomized, tightly controlled experiments are …

How big is “big”? Interpreting effect sizes in L2 research

L Plonsky, FL Oswald - Language learning, 2014 - Wiley Online Library
The calculation and use of effect sizes—such as d for mean differences and r for correlations—
has increased dramatically in second language (L2) research in the last decade …

The prior can often only be understood in the context of the likelihood

A Gelman, D Simpson, M Betancourt - Entropy, 2017 - mdpi.com
A key sticking point of Bayesian analysis is the choice of prior distribution, and there is a vast
literature on potential defaults including uniform priors, Jeffreys' priors, reference priors …

The relation between statistical power and inference in fMRI

HR Cremers, TD Wager, T Yarkoni - PloS one, 2017 - journals.plos.org
Statistically underpowered studies can result in experimental failure even when all other
experimental considerations have been addressed impeccably. In fMRI the combination of a …

Beyond power calculations: Assessing type S (sign) and type M (magnitude) errors

A Gelman, J Carlin - Perspectives on psychological science, 2014 - journals.sagepub.com
Statistical power analysis provides the conventional approach to assess error rates when
designing a research study. However, power analysis is flawed in that a narrow emphasis …

Detecting and avoiding likely false‐positive findings–a practical guide

W Forstmeier, EJ Wagenmakers… - Biological Reviews, 2017 - Wiley Online Library
Recently there has been a growing concern that many published research findings do not
hold up in attempts to replicate them. We argue that this problem may originate from a …

Single-paper meta-analysis: Benefits for study summary, theory testing, and replicability

BB McShane, U Böckenholt - Journal of Consumer Research, 2017 - academic.oup.com
A typical behavioral research paper features multiple studies of a common phenomenon that
are analyzed solely in isolation. Because the studies are of a common phenomenon, this …

[PDF][PDF] The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis …

A Gelman, E Loken - Department of Statistics, Columbia …, 2013 - stat.columbia.edu
Researcher degrees of freedom can lead to a multiple comparisons problem, even in
settings where researchers perform only a single analysis on their data. The problem is …

Mass univariate analysis of event‐related brain potentials/fields I: A critical tutorial review

DM Groppe, TP Urbach, M Kutas - Psychophysiology, 2011 - Wiley Online Library
Event‐related potentials (ERPs) and magnetic fields (ERFs) are typically analyzed via
ANOVAs on mean activity in a priori windows. Advances in computing power and statistics …

Does the gender composition of scientific committees matter?

M Bagues, M Sylos-Labini, N Zinovyeva - American Economic Review, 2017 - aeaweb.org
We analyze how a larger presence of female evaluators affects committee decision-making
using information on 100,000 applications to associate and full professorships in Italy and …