The power of generative ai: A review of requirements, models, input–output formats, evaluation metrics, and challenges

A Bandi, PVSR Adapa, YEVPK Kuchi - Future Internet, 2023 - mdpi.com
Generative artificial intelligence (AI) has emerged as a powerful technology with numerous
applications in various domains. There is a need to identify the requirements and evaluation …

A critical review of large language model on software engineering: An example from chatgpt and automated program repair

Q Zhang, T Zhang, J Zhai, C Fang, B Yu, W Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have been gaining increasing attention and demonstrated
promising performance across a variety of Software Engineering (SE) tasks, such as …

Codet5+: Open code large language models for code understanding and generation

Y Wang, H Le, AD Gotmare, NDQ Bui, J Li… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) pretrained on vast source code have achieved prominent
progress in code intelligence. However, existing code LLMs have two main limitations in …

Repocoder: Repository-level code completion through iterative retrieval and generation

F Zhang, B Chen, Y Zhang, J Keung, J Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
The task of repository-level code completion is to continue writing the unfinished code based
on a broader context of the repository. While for automated code completion tools, it is …

Retrieval-based prompt selection for code-related few-shot learning

N Nashid, M Sintaha, A Mesbah - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Large language models trained on massive code corpora can generalize to new tasks
without the need for task-specific fine-tuning. In few-shot learning, these models take as …

Self-planning Code Generation with Large Language Models

X Jiang, Y Dong, L Wang, F Zheng, Q Shang… - ACM Transactions on …, 2023 - dl.acm.org
Although large language models (LLMs) have demonstrated impressive ability in code
generation, they are still struggling to address the complicated intent provided by humans. It …

Improving chatgpt prompt for code generation

C Liu, X Bao, H Zhang, N Zhang, H Hu, X Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Automated code generation can be a powerful technique for software development,
significantly reducing developers' efforts and time required to create new code by generating …

Crosscodeeval: A diverse and multilingual benchmark for cross-file code completion

Y Ding, Z Wang, W Ahmad, H Ding… - Advances in …, 2024 - proceedings.neurips.cc
Code completion models have made significant progress in recent years, yet current popular
evaluation datasets, such as HumanEval and MBPP, predominantly focus on code …

Automating code review activities by large-scale pre-training

Z Li, S Lu, D Guo, N Duan, S Jannu, G Jenks… - Proceedings of the 30th …, 2022 - dl.acm.org
Code review is an essential part to software development lifecycle since it aims at
guaranteeing the quality of codes. Modern code review activities necessitate developers …

Reacc: A retrieval-augmented code completion framework

S Lu, N Duan, H Han, D Guo, S Hwang… - arXiv preprint arXiv …, 2022 - arxiv.org
Code completion, which aims to predict the following code token (s) according to the code
context, can improve the productivity of software development. Recent work has proved that …