On the opportunities and risks of foundation models

R Bommasani, DA Hudson, E Adeli, R Altman… - arXiv preprint arXiv …, 2021 - arxiv.org
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …

A self-supervised language model selection strategy for biomedical question answering

N Arabzadeh, E Bagheri - Journal of Biomedical Informatics, 2023 - Elsevier
Large neural-based Pre-trained Language Models (PLM) have recently gained much
attention due to their noteworthy performance in many downstream Information Retrieval …

MLEC-QA: A Chinese multi-choice biomedical question answering dataset

J Li, S Zhong, K Chen - Proceedings of the 2021 Conference on …, 2021 - aclanthology.org
Question Answering (QA) has been successfully applied in scenarios of human-computer
interaction such as chatbots and search engines. However, for the specific biomedical …

Building chinese biomedical language models via multi-level text discrimination

Q Wang, S Dai, B Xu, Y Lyu, Y Zhu, H Wu… - arXiv preprint arXiv …, 2021 - arxiv.org
Pre-trained language models (PLMs), such as BERT and GPT, have revolutionized the field
of NLP, not only in the general domain but also in the biomedical domain. Most prior efforts …

Survey on the Biomedical Text Summarization Techniques with an Emphasis on Databases, Techniques, Semantic Approaches, Classification Techniques, and …

D Pawar, S Phansalkar, A Sharma, GK Sahu, CK Ang… - Sustainability, 2023 - mdpi.com
Biomedical text summarization (BTS) is proving to be an emerging area of work and
research with the need for sustainable healthcare applications such as evidence-based …

An accurate unsupervised method for joint entity alignment and dangling entity detection

S Luo, S Yu - arXiv preprint arXiv:2203.05147, 2022 - arxiv.org
Knowledge graph integration typically suffers from the widely existing dangling entities that
cannot find alignment cross knowledge graphs (KGs). The dangling entity set is unavailable …

Datlmedqa: A data augmentation and transfer learning based solution for medical question answering

S Zhou, Y Zhang - Applied Sciences, 2021 - mdpi.com
With the outbreak of COVID-19 that has prompted an increased focus on self-care, more and
more people hope to obtain disease knowledge from the Internet. In response to this …

damo_nlp at MEDIQA 2021: knowledge-based preprocessing and coverage-oriented reranking for medical question summarization

Y He, M Chen, S Huang - Proceedings of the 20th Workshop on …, 2021 - aclanthology.org
Medical question summarization is an important but difficult task, where the input is often
complex and erroneous while annotated data is expensive to acquire. We report our …

Label refinement via contrastive learning for distantly-supervised named entity recognition

H Ying, S Luo, T Dang, S Yu - Findings of the Association for …, 2022 - aclanthology.org
Distantly-supervised named entity recognition (NER) locates and classifies entities using
only knowledge bases and unlabeled corpus to mitigate the reliance on human-annotated …

SentiMedQAer: a transfer learning-based sentiment-aware model for biomedical question answering

X Zhu, Y Chen, Y Gu, Z Xiao - Frontiers in Neurorobotics, 2022 - frontiersin.org
Recent advances have witnessed a trending application of transfer learning in a broad
spectrum of natural language processing (NLP) tasks, including question answering (QA) …