Choosing prediction over explanation in psychology: Lessons from machine learning
T Yarkoni, J Westfall - Perspectives on Psychological …, 2017 - journals.sagepub.com
Psychology has historically been concerned, first and foremost, with explaining the causal
mechanisms that give rise to behavior. Randomized, tightly controlled experiments are …
mechanisms that give rise to behavior. Randomized, tightly controlled experiments are …
How big is “big”? Interpreting effect sizes in L2 research
The calculation and use of effect sizes—such as d for mean differences and r for correlations—
has increased dramatically in second language (L2) research in the last decade …
has increased dramatically in second language (L2) research in the last decade …
The prior can often only be understood in the context of the likelihood
A key sticking point of Bayesian analysis is the choice of prior distribution, and there is a vast
literature on potential defaults including uniform priors, Jeffreys' priors, reference priors …
literature on potential defaults including uniform priors, Jeffreys' priors, reference priors …
The relation between statistical power and inference in fMRI
Statistically underpowered studies can result in experimental failure even when all other
experimental considerations have been addressed impeccably. In fMRI the combination of a …
experimental considerations have been addressed impeccably. In fMRI the combination of a …
Beyond power calculations: Assessing type S (sign) and type M (magnitude) errors
Statistical power analysis provides the conventional approach to assess error rates when
designing a research study. However, power analysis is flawed in that a narrow emphasis …
designing a research study. However, power analysis is flawed in that a narrow emphasis …
Detecting and avoiding likely false‐positive findings–a practical guide
W Forstmeier, EJ Wagenmakers… - Biological Reviews, 2017 - Wiley Online Library
Recently there has been a growing concern that many published research findings do not
hold up in attempts to replicate them. We argue that this problem may originate from a …
hold up in attempts to replicate them. We argue that this problem may originate from a …
Single-paper meta-analysis: Benefits for study summary, theory testing, and replicability
BB McShane, U Böckenholt - Journal of Consumer Research, 2017 - academic.oup.com
A typical behavioral research paper features multiple studies of a common phenomenon that
are analyzed solely in isolation. Because the studies are of a common phenomenon, this …
are analyzed solely in isolation. Because the studies are of a common phenomenon, this …
[PDF][PDF] The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis …
Researcher degrees of freedom can lead to a multiple comparisons problem, even in
settings where researchers perform only a single analysis on their data. The problem is …
settings where researchers perform only a single analysis on their data. The problem is …
Mass univariate analysis of event‐related brain potentials/fields I: A critical tutorial review
Event‐related potentials (ERPs) and magnetic fields (ERFs) are typically analyzed via
ANOVAs on mean activity in a priori windows. Advances in computing power and statistics …
ANOVAs on mean activity in a priori windows. Advances in computing power and statistics …
Does the gender composition of scientific committees matter?
We analyze how a larger presence of female evaluators affects committee decision-making
using information on 100,000 applications to associate and full professorships in Italy and …
using information on 100,000 applications to associate and full professorships in Italy and …