Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - ACM Transactions on …, 2023 - dl.acm.org
Large Language Models (LLMs) have significantly impacted numerous domains, including
Software Engineering (SE). Many recent publications have explored LLMs applied to …

Software testing with large language models: Survey, landscape, and vision

J Wang, Y Huang, C Chen, Z Liu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Pre-trained large language models (LLMs) have recently emerged as a breakthrough
technology in natural language processing and artificial intelligence, with the ability to …

spade: Synthesizing Data Quality Assertions for Large Language Model Pipelines

S Shankar, H Li, P Asawa, M Hulsebos, Y Lin… - Proceedings of the …, 2024 - dl.acm.org
Large language models (LLMs) are being increasingly deployed as part of pipelines that
repeatedly process or generate data of some sort. However, a common barrier to …

Livecodebench: Holistic and contamination free evaluation of large language models for code

N Jain, K Han, A Gu, WD Li, F Yan, T Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
Large Language Models (LLMs) applied to code-related applications have emerged as a
prominent field, attracting significant interest from both academia and industry. However, as …

Spade: Synthesizing assertions for large language model pipelines

S Shankar, H Li, P Asawa, M Hulsebos, Y Lin… - arXiv preprint arXiv …, 2024 - arxiv.org
Operationalizing large language models (LLMs) for custom, repetitive data pipelines is
challenging, particularly due to their unpredictable and potentially catastrophic failures …

Reasoning and Planning with Large Language Models in Code Development

H Ding, Z Fan, I Guehring, G Gupta, W Ha… - Proceedings of the 30th …, 2024 - dl.acm.org
Large Language Models (LLMs) are revolutionizing the field of code development by
leveraging their deep understanding of code patterns, syntax, and semantics to assist …

Natural symbolic execution-based testing for big data analytics

Y Wu, A Humayun, MA Gulzar, M Kim - Proceedings of the ACM on …, 2024 - dl.acm.org
Symbolic execution is an automated test input generation technique that models individual
program paths as logical constraints. However, the realism of concrete test inputs generated …

Leveraging large language models for enhancing the understandability of generated unit tests

A Deljouyi, R Koohestani, M Izadi… - arXiv preprint arXiv …, 2024 - arxiv.org
Automated unit test generators, particularly search-based software testing tools like
EvoSuite, are capable of generating tests with high coverage. Although these generators …

The Current Challenges of Software Engineering in the Era of Large Language Models

C Gao, X Hu, S Gao, X Xia, Z Jin - arXiv preprint arXiv:2412.14554, 2024 - arxiv.org
With the advent of large language models (LLMs) in the artificial intelligence (AI) area, the
field of software engineering (SE) has also witnessed a paradigm shift. These models, by …

TESTEVAL: Benchmarking Large Language Models for Test Case Generation

W Wang, C Yang, Z Wang, Y Huang, Z Chu… - arXiv preprint arXiv …, 2024 - arxiv.org
Testing plays a crucial role in the software development cycle, enabling the detection of
bugs, vulnerabilities, and other undesirable behaviors. To perform software testing, testers …