A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …

Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have significantly impacted numerous domains, notably
including Software Engineering (SE). Nevertheless, a well-rounded understanding of the …

[HTML][HTML] A survey of safety and trustworthiness of large language models through the lens of verification and validation

X Huang, W Ruan, W Huang, G Jin, Y Dong… - Artificial Intelligence …, 2024 - Springer
Large language models (LLMs) have exploded a new heatwave of AI for their ability to
engage end-users in human-level conversations with detailed and articulate answers across …

Verigen: A large language model for verilog code generation

S Thakur, B Ahmad, H Pearce, B Tan… - ACM Transactions on …, 2024 - dl.acm.org
In this study, we explore the capability of Large Language Models (LLMs) to automate
hardware design by automatically completing partial Verilog code, a common language for …

Chip-chat: Challenges and opportunities in conversational hardware design

J Blocklove, S Garg, R Karri… - 2023 ACM/IEEE 5th …, 2023 - ieeexplore.ieee.org
Modern hardware design starts with specifications provided in natural language. These are
then translated by hardware engineers into appropriate Hardware Description Languages …

A survey of large language models for code: Evolution, benchmarking, and future trends

Z Zheng, K Ning, Y Wang, J Zhang, D Zheng… - arXiv preprint arXiv …, 2023 - arxiv.org
General large language models (LLMs), represented by ChatGPT, have demonstrated
significant potential in tasks such as code generation in software engineering. This has led …

Verilogeval: Evaluating large language models for verilog code generation

M Liu, N Pinckney, B Khailany… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
The increasing popularity of large language models (LLMs) has paved the way for their
application in diverse domains. This paper proposes a benchmarking framework tailored …

Fixing hardware security bugs with large language models

B Ahmad, S Thakur, B Tan, R Karri… - arXiv preprint arXiv …, 2023 - arxiv.org
Novel AI-based code-writing Large Language Models (LLMs) such as OpenAI's Codex have
demonstrated capabilities in many coding-adjacent domains. In this work we consider how …

Gpt4aigchip: Towards next-generation ai accelerator design automation via large language models

Y Fu, Y Zhang, Z Yu, S Li, Z Ye, C Li… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
The remarkable capabilities and intricate nature of Artificial Intelligence (AI) have
dramatically escalated the imperative for specialized AI accelerators. Nonetheless …

On hardware security bug code fixes by prompting large language models

B Ahmad, S Thakur, B Tan, R Karri… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Novel AI-based code-writing Large Language Models (LLMs) such as OpenAI's Codex have
demonstrated capabilities in many coding-adjacent domains. In this work, we consider how …