Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

The adoption of agile approaches has put an increased emphasis on testing, resulting in
extensive test suites. These suites include a large number of tests, in which developers …

A code generation model generates code by taking a prompt from a code comment, existing
code, or a combination of both. Although code generation models (eg, GitHub Copilot) are …

Regression testing is increasingly important with the wide use of continuous integration. A
desirable requirement for regression testing is that a test failure reliably indicates a problem …

A flaky test is a test case whose outcome changes without modification to the code of the test
case or the program under test. These tests disrupt continuous integration, cause a loss of …

When identifying the origin of software bugs, many studies assume that “a bug was
introduced by the lines of code that were modified to fix it”. However, this assumption does …

One of the main challenges that developers face when testing their systems lies in
engineering test cases that are good enough to reveal bugs. And while our body of …

We study the evolution and impact of bloated dependencies in a single software ecosystem:
Java/Maven. Bloated dependencies are third-party libraries that are packaged in the …

Mutation testing is widely used in research as a metric for evaluating the quality of test
suites. Mutation testing runs the test suite on generated mutants (variants of the code under …

Automatic unit test generation that explores the input space and produces effective test
cases for given programs have been studied for decades. Many unit test generation tools …