A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

Context-aware patch generation for better automated program repair

M Wen, J Chen, R Wu, D Hao, SC Cheung - Proceedings of the 40th …, 2018 - dl.acm.org
The effectiveness of search-based automated program repair is limited in the number of
correct patches that can be successfully generated. There are two causes of such limitation …

Deepfl: Integrating multiple fault diagnosis dimensions for deep fault localization

X Li, W Li, Y Zhang, L Zhang - Proceedings of the 28th ACM SIGSOFT …, 2019 - dl.acm.org
Learning-based fault localization has been intensively studied recently. Prior studies have
shown that traditional Learning-to-Rank techniques can help precisely diagnose fault …

Toga: A neural method for test oracle generation

E Dinella, G Ryan, T Mytkowicz, SK Lahiri - Proceedings of the 44th …, 2022 - dl.acm.org
Testing is widely recognized as an important stage of the software development lifecycle.
Effective software testing can provide benefits such as bug finding, preventing regressions …

Automated patch correctness assessment: How far are we?

S Wang, M Wen, B Lin, H Wu, Y Qin, D Zou… - Proceedings of the 35th …, 2020 - dl.acm.org
Test-based automated program repair (APR) has attracted huge attention from both industry
and academia. Despite the significant progress made in recent studies, the overfitting …

Automatic repair of real bugs in java: A large-scale experiment on the defects4j dataset

M Martinez, T Durieux, R Sommerard, J Xuan… - Empirical Software …, 2017 - Springer
Defects4J is a large, peer-reviewed, structured dataset of real-world Java bugs. Each bug in
Defects4J comes with a test suite and at least one failing test case that triggers the bug. In …

Can large language models write good property-based tests?

V Vikram, C Lemieux, J Sunshine, R Padhye - arXiv preprint arXiv …, 2023 - arxiv.org
Property-based testing (PBT), while an established technique in the software testing
research community, is still relatively underused in real-world software. Pain points in writing …

An industrial evaluation of unit test generation: Finding real faults in a financial application

MM Almasi, H Hemmati, G Fraser… - 2017 IEEE/ACM 39th …, 2017 - ieeexplore.ieee.org
Automated unit test generation has been extensively studied in the literature in recent years.
Previous studies on open source systems have shown that test generation tools are quite …

Boosting spectrum-based fault localization using pagerank

M Zhang, X Li, L Zhang, S Khurshid - Proceedings of the 26th ACM …, 2017 - dl.acm.org
Manual debugging is notoriously tedious and time consuming. Therefore, various automated
fault localization techniques have been proposed to help with manual debugging. Among …

How many of all bugs do we find? a study of static bug detectors

A Habib, M Pradel - Proceedings of the 33rd ACM/IEEE International …, 2018 - dl.acm.org
Static bug detectors are becoming increasingly popular and are widely used by professional
software developers. While most work on bug detectors focuses on whether they find bugs at …