Robustness, security, privacy, explainability, efficiency, and usability of large language models for code

Z Yang, Z Sun, TZ Yue, P Devanbu, D Lo - arXiv preprint arXiv:2403.07506, 2024 - arxiv.org
Large language models for code (LLM4Code), which demonstrate strong performance (eg,
high accuracy) in processing source code, have significantly transformed software …

Inspect: Intrinsic and systematic probing evaluation for code transformers

A Karmakar, R Robbes - IEEE Transactions on Software …, 2023 - ieeexplore.ieee.org
Pre-trained models of source code have recently been successfully applied to a wide variety
of Software Engineering tasks; they have also seen some practical adoption in practice, eg …

Do Machines and Humans Focus on Similar Code? Exploring Explainability of Large Language Models in Code Summarization

J Li, Y Zhang, Z Karas, C McMillan, K Leach… - Proceedings of the …, 2024 - dl.acm.org
Recent language models have demonstrated proficiency in summarizing source code.
However, as in many other domains of machine learning, language models of code lack …

Where to look when repairing code? comparing the attention of neural models and developers

D Huber, M Paltenghi, M Pradel - arXiv preprint arXiv:2305.07287, 2023 - arxiv.org
Neural network-based techniques for automated program repair are becoming increasingly
effective. Despite their success, little is known about why they succeed or fail, and how their …

Do Language Models Learn Semantics of Code? A Case Study in Vulnerability Detection

B Steenhoek, MM Rahman, S Sharmin… - arXiv preprint arXiv …, 2023 - arxiv.org
Recently, pretrained language models have shown state-of-the-art performance on the
vulnerability detection task. These models are pretrained on a large corpus of source code …

[PDF][PDF] On the Intrinsic and Extrinsic Evaluation of Source Code Models

A Karmakar - 2023 - bia.unibz.it
Abstract Machine learning techniques have been increasingly applied to source code in
recent years, leading to numerous advances in the field of Software Engineering (SE). The …