Heterogeneity in effect size estimates
A typical empirical study involves choosing a sample, a research design, and an analysis
path. Variation in such choices across studies leads to heterogeneity in results that introduce …
path. Variation in such choices across studies leads to heterogeneity in results that introduce …
A framework for evaluating reproducibility and replicability in economics
A Dreber, M Johannesson - Economic Inquiry, 2024 - Wiley Online Library
We propose a framework for evaluating reproducibility and replicability in economics.
Reproducibility is defined as testing if the results of an original study can be reproduced …
Reproducibility is defined as testing if the results of an original study can be reproduced …
How do data analysts respond to ai assistance? a wizard-of-oz study
Data analysis is challenging as analysts must navigate nuanced decisions that may yield
divergent conclusions. AI assistants have the potential to support analysts in planning their …
divergent conclusions. AI assistants have the potential to support analysts in planning their …
Do anomalies really predict market returns? New data and new evidence
Using new data from US and global markets, we revisit market risk premium predictability by
equity anomalies. We apply a repertoire of machine-learning methods to forty-two countries …
equity anomalies. We apply a repertoire of machine-learning methods to forty-two countries …
Reproducibility in Management Science
With the help of more than 700 reviewers, we assess the reproducibility of nearly 500
articles published in the journal Management Science before and after the introduction of a …
articles published in the journal Management Science before and after the introduction of a …
[HTML][HTML] Experimenting with financial professionals
As key players in financial markets and the broader industry, financial professionals are
increasingly used as experimental research participants. We review over 50 studies …
increasingly used as experimental research participants. We review over 50 studies …
Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty
This study explores how researchers' analytical choices affect the reliability of scientific
findings. Most discussions of reliability problems in science focus on systematic biases. We …
findings. Most discussions of reliability problems in science focus on systematic biases. We …
[HTML][HTML] Non-standard errors in asset pricing: Mind your sorts
Non-standard errors capture variation due to differences in research design choices. We
document large variation in design choices in the context of asset pricing factor models and …
document large variation in design choices in the context of asset pricing factor models and …
Toward a more credible assessment of the credibility of science by many-analyst studies
We discuss a relatively new meta-scientific research design: many-analyst studies that
attempt to assess the replicability and credibility of research based on large-scale …
attempt to assess the replicability and credibility of research based on large-scale …
Subjective evidence evaluation survey for many-analysts studies
A Sarafoglou, S Hoogeveen… - Royal Society …, 2024 - royalsocietypublishing.org
Many-analysts studies explore how well an empirical claim withstands plausible alternative
analyses of the same dataset by multiple, independent analysis teams. Conclusions from …
analyses of the same dataset by multiple, independent analysis teams. Conclusions from …