A brief overview of ChatGPT: The history, status quo and potential future development
ChatGPT, an artificial intelligence generated content (AIGC) model developed by OpenAI,
has attracted world-wide attention for its capability of dealing with challenging language …
has attracted world-wide attention for its capability of dealing with challenging language …
A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …
[HTML][HTML] Pre-trained language models and their applications
Pre-trained language models have achieved striking success in natural language
processing (NLP), leading to a paradigm shift from supervised learning to pre-training …
processing (NLP), leading to a paradigm shift from supervised learning to pre-training …
Convit: Improving vision transformers with soft convolutional inductive biases
Convolutional architectures have proven extremely successful for vision tasks. Their hard
inductive biases enable sample-efficient learning, but come at the cost of a potentially lower …
inductive biases enable sample-efficient learning, but come at the cost of a potentially lower …
Asleep at the keyboard? assessing the security of github copilot's code contributions
There is burgeoning interest in designing AI-based systems to assist humans in designing
computing systems, including tools that automatically generate computer code. The most …
computing systems, including tools that automatically generate computer code. The most …
Generative adversarial networks: A survey toward private and secure applications
Generative Adversarial Networks (GANs) have promoted a variety of applications in
computer vision and natural language processing, among others, due to its generative …
computer vision and natural language processing, among others, due to its generative …
Transformer models for text-based emotion detection: a review of BERT-based approaches
FA Acheampong, H Nunoo-Mensah… - Artificial Intelligence …, 2021 - Springer
We cannot overemphasize the essence of contextual information in most natural language
processing (NLP) applications. The extraction of context yields significant improvements in …
processing (NLP) applications. The extraction of context yields significant improvements in …
Application of artificial intelligence in geotechnical engineering: A state-of-the-art review
Geotechnical engineering deals with soils and rocks and their use in engineering
constructions. By their nature, soils and rocks exhibit complex behaviours and a high level of …
constructions. By their nature, soils and rocks exhibit complex behaviours and a high level of …
Read like humans: Autonomous, bidirectional and iterative language modeling for scene text recognition
Linguistic knowledge is of great benefit to scene text recognition. However, how to effectively
model linguistic rules in end-to-end deep networks remains a research challenge. In this …
model linguistic rules in end-to-end deep networks remains a research challenge. In this …
A review of convolutional neural network architectures and their optimizations
The research advances concerning the typical architectures of convolutional neural
networks (CNNs) as well as their optimizations are analyzed and elaborated in detail in this …
networks (CNNs) as well as their optimizations are analyzed and elaborated in detail in this …