A survey of knowledge enhanced pre-trained language models

L Hu, Z Liu, Z Zhao, L Hou, L Nie… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Pre-trained Language Models (PLMs) which are trained on large text corpus via self-
supervised learning method, have yielded promising performance on various tasks in …

A survey on non-autoregressive generation for neural machine translation and beyond

Y Xiao, L Wu, J Guo, J Li, M Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Non-autoregressive (NAR) generation, which is first proposed in neural machine translation
(NMT) to speed up inference, has attracted much attention in both machine learning and …

Spanproto: A two-stage span-based prototypical network for few-shot named entity recognition

J Wang, C Han, C Wang, C Tan, M Qiu… - arXiv preprint arXiv …, 2022 - arxiv.org
Few-shot Named Entity Recognition (NER) aims to identify named entities with very little
annotated data. Previous methods solve this problem based on token-wise classification …

Gotta: Generative Few-shot Question Answering by Prompt-based Cloze Data Augmentation

X Chen, Y Zhang, J Deng, JY Jiang, W Wang - Proceedings of the 2023 SIAM …, 2023 - SIAM
Few-shot question answering (QA) aims at precisely discovering answers to a set of
questions from context passages while only a few training samples are available. Although …

Killing Two Birds with One Stone: Cross-modal Reinforced Prompting for Graph and Language Tasks

W Jiang, W Wu, L Zhang, Z Yuan, J Xiang… - Proceedings of the 30th …, 2024 - dl.acm.org
In recent years, Graph Neural Networks (GNNs) and Large Language Models (LLMs) have
exhibited remarkable capability in addressing different graph learning and natural language …

A survey of extractive question answering

L Wang, K Zheng, L Qian, S Li - 2022 International Conference …, 2022 - ieeexplore.ieee.org
Extractive question answering is one of the most important tasks in natural language
processing (NLP) which has high research value. In order to sort out its development …

TPKE-QA: A gapless few-shot extractive question answering approach via task-aware post-training and knowledge enhancement

Q Xiao, R Li, J Yang, Y Chen, S Jiang… - Expert Systems with …, 2024 - Elsevier
Few-shot extractive question answering (EQA) is a challenging task in natural language
processing, whose current methods are mainly based on pretrained language models …

Multi-hierarchical error-aware contrastive learning for event argument extraction

S He, W Du, X Peng, Z Wei, X Li - Knowledge-Based Systems, 2024 - Elsevier
Event argument extraction (EAE) aims to identify the spans and roles of arguments for the
given event type. Deep learning-based EAE methods, especially generation-based …

MRC-PASCL: A Few-shot Machine Reading Comprehension Approach via Post-training and Answer Span-oriented Contrastive Learning

R Li, Q Xiao, J Yang, L Zhang… - IEEE/ACM Transactions …, 2024 - ieeexplore.ieee.org
The rapid development of pre-trained language models (PLMs) has significantly enhanced
the performance of machine reading comprehension (MRC). Nevertheless, the traditional …

Contrastive Distant Supervision for Debiased and Denoised Machine Reading Comprehension

N Bian, H Lin, X Han, B He, L Sun - Findings of the Association for …, 2023 - aclanthology.org
Distant Supervision (DS) is a promising learning approach for MRC by leveraging easily-
obtained question-answer pairs. Unfortunately, the heuristically annotated dataset will …