A brief overview of ChatGPT: The history, status quo and potential future development

T Wu, S He, J Liu, S Sun, K Liu… - IEEE/CAA Journal of …, 2023 - ieeexplore.ieee.org
ChatGPT, an artificial intelligence generated content (AIGC) model developed by OpenAI,
has attracted world-wide attention for its capability of dealing with challenging language …

A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …

[HTML][HTML] Pre-trained language models and their applications

H Wang, J Li, H Wu, E Hovy, Y Sun - Engineering, 2023 - Elsevier
Pre-trained language models have achieved striking success in natural language
processing (NLP), leading to a paradigm shift from supervised learning to pre-training …

Convit: Improving vision transformers with soft convolutional inductive biases

S d'Ascoli, H Touvron, ML Leavitt… - International …, 2021 - proceedings.mlr.press
Convolutional architectures have proven extremely successful for vision tasks. Their hard
inductive biases enable sample-efficient learning, but come at the cost of a potentially lower …

Asleep at the keyboard? assessing the security of github copilot's code contributions

H Pearce, B Ahmad, B Tan… - … IEEE Symposium on …, 2022 - ieeexplore.ieee.org
There is burgeoning interest in designing AI-based systems to assist humans in designing
computing systems, including tools that automatically generate computer code. The most …

Generative adversarial networks: A survey toward private and secure applications

Z Cai, Z Xiong, H Xu, P Wang, W Li, Y Pan - ACM Computing Surveys …, 2021 - dl.acm.org
Generative Adversarial Networks (GANs) have promoted a variety of applications in
computer vision and natural language processing, among others, due to its generative …

Transformer models for text-based emotion detection: a review of BERT-based approaches

FA Acheampong, H Nunoo-Mensah… - Artificial Intelligence …, 2021 - Springer
We cannot overemphasize the essence of contextual information in most natural language
processing (NLP) applications. The extraction of context yields significant improvements in …

Application of artificial intelligence in geotechnical engineering: A state-of-the-art review

A Baghbani, T Choudhury, S Costa, J Reiner - Earth-Science Reviews, 2022 - Elsevier
Geotechnical engineering deals with soils and rocks and their use in engineering
constructions. By their nature, soils and rocks exhibit complex behaviours and a high level of …

Read like humans: Autonomous, bidirectional and iterative language modeling for scene text recognition

S Fang, H Xie, Y Wang, Z Mao… - Proceedings of the …, 2021 - openaccess.thecvf.com
Linguistic knowledge is of great benefit to scene text recognition. However, how to effectively
model linguistic rules in end-to-end deep networks remains a research challenge. In this …

A review of convolutional neural network architectures and their optimizations

S Cong, Y Zhou - Artificial Intelligence Review, 2023 - Springer
The research advances concerning the typical architectures of convolutional neural
networks (CNNs) as well as their optimizations are analyzed and elaborated in detail in this …