Pre-trained large language models (LLMs) have recently emerged as a breakthrough
technology in natural language processing and artificial intelligence, with the ability to …

The rapid development of Artificial Intelligence (AI) technology has enabled the deployment
of various systems based on it. However, many current AI systems are found vulnerable to …

This paper provides a survey of the emerging area of Large Language Models (LLMs) for
Software Engineering (SE). It also sets out open research challenges for the application of …

This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Unit testing is essential in detecting bugs in functionally-discrete program units. Manually
writing high-quality unit tests is time-consuming and laborious. Although traditional …

Many automated test generation techniques have been developed to aid developers with
writing tests. To facilitate full automation, most existing techniques aim to either increase …

Scarce and niche in the literature just a few years ago, the blockchain topic is now the main
subject in conference papers and books. However, the hype generated by the technology …

Mutation testing realizes the idea of using artificial defects to support testing activities.
Mutation is typically used as a way to evaluate the adequacy of test suites, to guide the …

Metamorphic testing is an approach to both test case generation and test result verification.
A central element is a set of metamorphic relations, which are necessary properties of the …

Debugging software failures is still a painful, time consuming, and expensive process. For
instance, recent studies showed that debugging activities often account for about 50% of the …