Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - ACM Transactions on …, 2023 - dl.acm.org
Large Language Models (LLMs) have significantly impacted numerous domains, including
Software Engineering (SE). Many recent publications have explored LLMs applied to …

A systematic literature review on large language models for automated program repair

Q Zhang, C Fang, Y Xie, YX Ma, W Sun, Y Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Automated Program Repair (APR) attempts to patch software bugs and reduce manual
debugging efforts. Very recently, with the advances in Large Language Models (LLMs), an …

A new era in software security: Towards self-healing software via large language models and formal verification

N Tihanyi, R Jain, Y Charalambous, MA Ferrag… - arXiv preprint arXiv …, 2023 - arxiv.org
This paper introduces an innovative approach that combines Large Language Models
(LLMs) with Formal Verification strategies for automatic software vulnerability repair. Initially …

Infinite-llm: Efficient llm service for long context with distattention and distributed kvcache

B Lin, C Zhang, T Peng, H Zhao, W Xiao, M Sun… - arXiv preprint arXiv …, 2024 - arxiv.org
The rapid proliferation of Large Language Models (LLMs) has been a driving force in the
growth of cloud-based LLM services, which are now integral to advancing AI applications …

Rlcoder: Reinforcement learning for repository-level code completion

Y Wang, Y Wang, D Guo, J Chen, R Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
Repository-level code completion aims to generate code for unfinished code snippets within
the context of a specified repository. Existing approaches mainly rely on retrieval-augmented …

From llms to llm-based agents for software engineering: A survey of current, challenges and future

H Jin, L Huang, H Cai, J Yan, B Li, H Chen - arXiv preprint arXiv …, 2024 - arxiv.org
With the rise of large language models (LLMs), researchers are increasingly exploring their
applications in var ious vertical domains, such as software engineering. LLMs have …

Q*: Improving multi-step reasoning for llms with deliberative planning

C Wang, Y Deng, Z Lyu, L Zeng, J He, S Yan… - arXiv preprint arXiv …, 2024 - arxiv.org
Large Language Models (LLMs) have demonstrated impressive capability in many natural
language tasks. However, the auto-regressive generation process makes LLMs prone to …

Effibench: Benchmarking the efficiency of automatically generated code

D Huang, Y Qing, W Shang, H Cui… - arXiv preprint arXiv …, 2024 - arxiv.org
Code generation models have increasingly become integral to aiding software
development. Although current research has thoroughly examined the correctness of the …

Recursive introspection: Teaching language model agents how to self-improve

Y Qu, T Zhang, N Garg, A Kumar - arXiv preprint arXiv:2407.18219, 2024 - arxiv.org
A central piece in enabling intelligent agentic behavior in foundation models is to make them
capable of introspecting upon their behavior, reasoning, and correcting their mistakes as …

Llm agents can autonomously exploit one-day vulnerabilities

R Fang, R Bindu, A Gupta, D Kang - arXiv preprint arXiv:2404.08144, 2024 - arxiv.org
LLMs have becoming increasingly powerful, both in their benign and malicious uses. With
the increase in capabilities, researchers have been increasingly interested in their ability to …