The emergence of large-scale replication projects yielding successful rates substantially
lower than expected caused the behavioural, cognitive, and social sciences to experience a …

We examine the opportunities and challenges of expert judgment in the social sciences,
scrutinizing the way social scientists make predictions. While social scientists show above …

Assessing the credibility of research claims is a central, continuous, and laborious part of the
scientific process. Credibility assessment strategies range from expert judgment to …

Structured protocols offer a transparent and systematic way to elicit and combine/aggregate,
probabilistic predictions from multiple experts. These judgements can be aggregated …

Journal peer review regulates the flow of ideas through an academic discipline and thus has
the power to shape what a research community knows, actively investigates, and …

Septic tank systems (STS) in rural catchments represent a potential source of microbial
pollution to watercourses; however, data concerning the risk of faecal indicator organism …

This paper explores judgements about the replicability of social and behavioural sciences
research and what drives those judgements. Using a mixed methods approach, it draws on …

We tested whether large language models (LLMs) can help predict results from a complex
behavioural science experiment. In study 1, we investigated the performance of the widely …

Previous research shows that variation in coherence (ie, degrees of respect for axioms of
probability calculus), when used as a basis for performance-weighted aggregation, can …

Authentic assessment allows students to demonstrate knowledge and skills in real-world
tasks. In research, peer review is one such task that researchers learn by doing, as they …