Mutation testing advances: an analysis and survey

M Papadakis, M Kintis, J Zhang, Y Jia, Y Le Traon… - Advances in …, 2019 - Elsevier
Mutation testing realizes the idea of using artificial defects to support testing activities.
Mutation is typically used as a way to evaluate the adequacy of test suites, to guide the …

Deepmutation: Mutation testing of deep learning systems

L Ma, F Zhang, J Sun, M Xue, B Li… - 2018 IEEE 29th …, 2018 - ieeexplore.ieee.org
Deep learning (DL) defines a new data-driven programming paradigm where the internal
system logic is largely shaped by the training data. The standard way of evaluating DL …

Toga: A neural method for test oracle generation

E Dinella, G Ryan, T Mytkowicz, SK Lahiri - Proceedings of the 44th …, 2022 - dl.acm.org
Testing is widely recognized as an important stage of the software development lifecycle.
Effective software testing can provide benefits such as bug finding, preventing regressions …

Explainable automated debugging via large language model-driven scientific debugging

S Kang, B Chen, S Yoo, JG Lou - Empirical Software Engineering, 2025 - Springer
Automated debugging techniques have the potential to reduce developer effort in
debugging. However, while developers want rationales for the provided automatic …

Predictive mutation testing

J Zhang, Z Wang, L Zhang, D Hao, L Zang… - Proceedings of the 25th …, 2016 - dl.acm.org
Mutation testing is a powerful methodology for evaluating test suite quality. In mutation
testing, a large number of mutants are generated and executed against the test suite to …

An empirical study of flaky tests in python

M Gruber, S Lukasczyk, F Kroiß… - 2021 14th IEEE …, 2021 - ieeexplore.ieee.org
Tests that cause spurious failures without any code changes, ie, flaky tests, hamper
regression testing, increase maintenance costs, may shadow real bugs, and decrease trust …

Are mutation scores correlated with real fault detection? a large scale empirical study on the relationship between mutants and real faults

M Papadakis, D Shin, S Yoo, DH Bae - Proceedings of the 40th …, 2018 - dl.acm.org
Empirical validation of software testing studies is increasingly relying on mutants. This
practice is motivated by the strong correlation between mutant scores and real fault …

[PDF][PDF] Unifying the perspectives of nlp and software engineering: A survey on language models for code

Z Zhang, C Chen, B Liu, C Liao, Z Gong… - arXiv preprint arXiv …, 2023 - simg.baai.ac.cn
In this work we systematically review the recent advancements in code processing with
language models, covering 50+ models, 30+ evaluation tasks, 170+ datasets, and 700 …

On the effectiveness of manual and automatic unit test generation: ten years later

D Serra, G Grano, F Palomba, F Ferrucci… - 2019 IEEE/ACM 16th …, 2019 - ieeexplore.ieee.org
Good unit tests play a paramount role when it comes to foster and evaluate software quality.
However, writing effective tests is an extremely costly and time consuming practice. To …

Learning to construct better mutation faults

Z Tian, J Chen, Q Zhu, J Yang, L Zhang - Proceedings of the 37th IEEE …, 2022 - dl.acm.org
Mutation faults are the core of mutation testing and have been widely used in many other
software testing and debugging tasks. Hence, constructing high-quality mutation faults is …