Software testing with large language models: Survey, landscape, and vision

J Wang, Y Huang, C Chen, Z Liu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Pre-trained large language models (LLMs) have recently emerged as a breakthrough
technology in natural language processing and artificial intelligence, with the ability to …

An empirical evaluation of using large language models for automated unit test generation

M Schäfer, S Nadi, A Eghbali… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Unit tests play a key role in ensuring the correctness of software. However, manually
creating unit tests is a laborious task, motivating the need for automation. Large Language …

Breaking the silence: the threats of using llms in software engineering

J Sallou, T Durieux, A Panichella - Proceedings of the 2024 ACM/IEEE …, 2024 - dl.acm.org
Large Language Models (LLMs) have gained considerable traction within the Software
Engineering (SE) community, impacting various SE tasks from code completion to test …

Llm for test script generation and migration: Challenges, capabilities, and opportunities

S Yu, C Fang, Y Ling, C Wu… - 2023 IEEE 23rd …, 2023 - ieeexplore.ieee.org
This paper investigates the application of large language models (LLM) in the domain of
mobile application test script generation. Test script generation is a vital component of …

Chatgpt vs sbst: A comparative assessment of unit test suite generation

Y Tang, Z Liu, Z Zhou, X Luo - IEEE Transactions on Software …, 2024 - ieeexplore.ieee.org
Recent advancements in large language models (LLMs) have demonstrated exceptional
success in a wide range of general domain tasks, such as question answering and following …

Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have significantly impacted numerous domains, notably
including Software Engineering (SE). Nevertheless, a well-rounded understanding of the …

Software vulnerability detection using large language models

MD Purba, A Ghosh, BJ Radford… - 2023 IEEE 34th …, 2023 - ieeexplore.ieee.org
Software development is among the first demonstrations of using Large Language Models
(LLMs) to enhance human productivity. Such a co-pilot paradigm envisions LLM working …

Effective test generation using pre-trained large language models and mutation testing

AM Dakhel, A Nikanjam, V Majdinasab… - Information and …, 2024 - Elsevier
Context: One of the critical phases in the software development life cycle is software testing.
Testing helps with identifying potential bugs and reducing maintenance costs. The goal of …

Towards autonomous testing agents via conversational large language models

R Feldt, S Kang, J Yoon, S Yoo - 2023 38th IEEE/ACM …, 2023 - ieeexplore.ieee.org
Software testing is an important part of the development cycle, yet it requires specialized
expertise and substantial developer effort to adequately test software. Recent discoveries of …

A survey on large language models for software engineering

Q Zhang, C Fang, Y Xie, Y Zhang, Y Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
Software Engineering (SE) is the systematic design, development, and maintenance of
software applications, underpinning the digital infrastructure of our modern mainworld. Very …