A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

A survey on deep learning for named entity recognition

J Li, A Sun, J Han, C Li - IEEE transactions on knowledge and …, 2020 - ieeexplore.ieee.org
Named entity recognition (NER) is the task to identify mentions of rigid designators from text
belonging to predefined semantic types such as person, location, organization etc. NER …

Unified named entity recognition as word-word relation classification

J Li, H Fei, J Liu, S Wu, M Zhang, C Teng… - proceedings of the AAAI …, 2022 - ojs.aaai.org
So far, named entity recognition (NER) has been involved with three major types, including
flat, overlapped (aka. nested), and discontinuous NER, which have mostly been studied …

A unified MRC framework for named entity recognition

X Li, J Feng, Y Meng, Q Han, F Wu, J Li - arXiv preprint arXiv:1910.11476, 2019 - arxiv.org
The task of named entity recognition (NER) is normally divided into nested NER and flat
NER depending on whether named entities are nested or not. Models are usually separately …

FLAT: Chinese NER using flat-lattice transformer

X Li, H Yan, X Qiu, X Huang - arXiv preprint arXiv:2004.11795, 2020 - arxiv.org
Recently, the character-word lattice structure has been proved to be effective for Chinese
named entity recognition (NER) by incorporating the word information. However, since the …

On the explainability of natural language processing deep models

JE Zini, M Awad - ACM Computing Surveys, 2022 - dl.acm.org
Despite their success, deep networks are used as black-box models with outputs that are not
easily explainable during the learning and the prediction phases. This lack of interpretability …

[HTML][HTML] Chinese named entity recognition: The state of the art

P Liu, Y Guo, F Wang, G Li - Neurocomputing, 2022 - Elsevier
Abstract Named Entity Recognition (NER), one of the most fundamental problems in natural
language processing, seeks to identify the boundaries and types of entities with specific …

Lexicon enhanced Chinese sequence labeling using BERT adapter

W Liu, X Fu, Y Zhang, W Xiao - arXiv preprint arXiv:2105.07148, 2021 - arxiv.org
Lexicon information and pre-trained models, such as BERT, have been combined to explore
Chinese sequence labelling tasks due to their respective strengths. However, existing …

Simplify the usage of lexicon in Chinese NER

R Ma, M Peng, Q Zhang, X Huang - arXiv preprint arXiv:1908.05969, 2019 - arxiv.org
Recently, many works have tried to augment the performance of Chinese named entity
recognition (NER) using word lexicons. As a representative, Lattice-LSTM (Zhang and Yang …

Boundary smoothing for named entity recognition

E Zhu, J Li - arXiv preprint arXiv:2204.12031, 2022 - arxiv.org
Neural named entity recognition (NER) models may easily encounter the over-confidence
issue, which degrades the performance and calibration. Inspired by label smoothing and …