Pre-trained language models in biomedical domain: A systematic survey

B Wang, Q Xie, J Pei, Z Chen, P Tiwari, Z Li… - ACM Computing …, 2023 - dl.acm.org
Pre-trained language models (PLMs) have been the de facto paradigm for most natural
language processing tasks. This also benefits the biomedical domain: researchers from …

[HTML][HTML] AMMU: a survey of transformer-based biomedical pretrained language models

KS Kalyan, A Rajasekharan, S Sangeetha - Journal of biomedical …, 2022 - Elsevier
Transformer-based pretrained language models (PLMs) have started a new era in modern
natural language processing (NLP). These models combine the power of transformers …

A survey of large language models for healthcare: from data, technology, and applications to accountability and ethics

K He, R Mao, Q Lin, Y Ruan, X Lan, M Feng… - arXiv preprint arXiv …, 2023 - arxiv.org
The utilization of large language models (LLMs) in the Healthcare domain has generated
both excitement and concern due to their ability to effectively respond to freetext queries with …

[HTML][HTML] BERT based clinical knowledge extraction for biomedical knowledge graph construction and analysis

A Harnoune, M Rhanoui, M Mikram, S Yousfi… - Computer Methods and …, 2021 - Elsevier
Background: Knowledge is evolving over time, often as a result of new discoveries or
changes in the adopted methods of reasoning. Also, new facts or evidence may become …

[HTML][HTML] Chemu 2020: Natural language processing methods are effective for information extraction from chemical patents

J He, DQ Nguyen, SA Akhondi… - Frontiers in Research …, 2021 - frontiersin.org
Chemical patents represent a valuable source of information about new chemical
compounds, which is critical to the drug discovery process. Automated information extraction …

[HTML][HTML] Localizing in-domain adaptation of transformer-based biomedical language models

TM Buonocore, C Crema, A Redolfi, R Bellazzi… - Journal of Biomedical …, 2023 - Elsevier
In the era of digital healthcare, the huge volumes of textual information generated every day
in hospitals constitute an essential but underused asset that could be exploited with task …

Camembert-bio: a tasty french language model better for your health

R Touchent, L Romary, E de La Clergerie - arXiv preprint arXiv …, 2023 - arxiv.org
Clinical data in hospitals are increasingly accessible for research through clinical data
warehouses, however these documents are unstructured. It is therefore necessary to extract …

[HTML][HTML] Exploring the latest highlights in medical natural language processing across multiple languages: A survey

A Shaitarova, J Zaghir, A Lavelli… - Yearbook of medical …, 2023 - thieme-connect.com
Objectives: This survey aims to provide an overview of the current state of biomedical and
clinical Natural Language Processing (NLP) research and practice in Languages other than …

Présentation de la campagne d'évaluation DEFT 2020: similarité textuelle en domaine ouvert et extraction d'information précise dans des cas cliniques

R Cardon, N Grabar, C Grouin, T Hamon - DEFT 2020, 2020 - hal.science
L'édition 2020 du défi fouille de texte (DEFT) a proposé deux tâches autour de la similarité
textuelle et une tâche d'extraction d'information. La première tâche vise à identifier le degré …

AliBERT: A pretrained language model for French biomedical text

A Berhe, G Draznieks, V Martenot, V Masdeu, L Davy… - 2023 - hal.science
Over the past few years, domain specific pretrained language models have been
investigated and have shown remarkable achievements in different downstream tasks …