Compiler error messages considered unhelpful: The landscape of text-based programming error message research

BA Becker, P Denny, R Pettit, D Bouchard… - Proceedings of the …, 2019 - dl.acm.org
Diagnostic messages generated by compilers and interpreters such as syntax error
messages have been researched for over half of a century. Unfortunately, these messages …

The REPRISE project: protocol for an evaluation of REProducibility and Replicability In Syntheses of Evidence

MJ Page, D Moher, FM Fidler, JPT Higgins… - Systematic …, 2021 - Springer
Background Investigations of transparency, reproducibility and replicability in science have
been directed largely at individual studies. It is just as critical to explore these issues in …

The role of replication studies in ecology

H Fraser, A Barnett, TH Parker… - Ecology and Evolution, 2020 - Wiley Online Library
Recent large‐scale projects in other disciplines have shown that results often fail to replicate
when studies are repeated. The conditions contributing to this problem are also present in …

Are replication studies infrequent because of negative attitudes?: Insights from a survey of attitudes and practices in second language research

K McManus - Studies in Second Language Acquisition, 2022 - cambridge.org
Replication is a research methodology designed to verify, consolidate, and generalize
knowledge and understanding within empirical fields of study. In second language studies …

Bob or Bot: Exploring ChatGPT's Answers to University Computer Science Assessment

M Richards, K Waugh, M Slaymaker, M Petre… - ACM Transactions on …, 2024 - dl.acm.org
Cheating has been a long-standing issue in university assessments. However, the release
of ChatGPT and other free-to-use generative AI tools has provided a new and distinct …

Development and use of domain-specific learning theories, models, and instruments in computing education

L Malmi, J Sheard, P Kinnunen, Simon… - ACM Transactions on …, 2022 - dl.acm.org
Use of theory within a field of research provides the foundation for designing effective
research programs and establishing a deeper understanding of the results obtained. This …

A systematic investigation of replications in computing education research

Q Hao, DH Smith IV, N Iriumi, M Tsikerdekis… - ACM Transactions on …, 2019 - dl.acm.org
As the societal demands for application and knowledge in computer science (CS) increase,
CS student enrollment keeps growing rapidly around the world. By continuously improving …

A systematic literature review of empiricism and norms of reporting in computing education research literature

S Heckman, JC Carver, M Sherriff… - ACM Transactions on …, 2021 - dl.acm.org
Context. Computing Education Research (CER) is critical to help the computing education
community and policy makers support the increasing population of students who need to …

Empirical evaluation of deep learning models for knowledge tracing: Of hyperparameters and metrics on performance and replicability

S Sarsa, J Leinonen, A Hellas - arXiv preprint arXiv:2112.15072, 2021 - arxiv.org
We review and evaluate a body of deep learning knowledge tracing (DLKT) models with
openly available and widely-used data sets, and with a novel data set of students learning to …

iSnap: Evolution and evaluation of a data-driven hint system for block-based programming

S Marwan, TW Price - IEEE Transactions on Learning …, 2022 - ieeexplore.ieee.org
Novice programmers often struggle on assignments, and timely help, such as a hint on what
to do next, can help students continue to progress and learn, rather than giving up. However …