A survey on recent advances in named entity recognition from deep learning models

V Yadav, S Bethard - arXiv preprint arXiv:1910.11470, 2019 - arxiv.org
Named Entity Recognition (NER) is a key component in NLP systems for question
answering, information retrieval, relation extraction, etc. NER systems have been studied …

[HTML][HTML] AMMU: a survey of transformer-based biomedical pretrained language models

KS Kalyan, A Rajasekharan, S Sangeetha - Journal of biomedical …, 2022 - Elsevier
Transformer-based pretrained language models (PLMs) have started a new era in modern
natural language processing (NLP). These models combine the power of transformers …

Don't stop pretraining: Adapt language models to domains and tasks

S Gururangan, A Marasović, S Swayamdipta… - arXiv preprint arXiv …, 2020 - arxiv.org
Language models pretrained on text from a wide variety of sources form the foundation of
today's NLP. In light of the success of these broad-coverage models, we investigate whether …

BioBERT: a pre-trained biomedical language representation model for biomedical text mining

J Lee, W Yoon, S Kim, D Kim, S Kim, CH So… - …, 2020 - academic.oup.com
Motivation Biomedical text mining is becoming increasingly important as the number of
biomedical documents rapidly grows. With the progress in natural language processing …

[PDF][PDF] Quantifying the advantage of domain-specific pre-training on named entity recognition tasks in materials science

A Trewartha, N Walker, H Huo, S Lee, K Cruse… - Patterns, 2022 - cell.com
A bottleneck in efficiently connecting new materials discoveries to established literature has
arisen due to an increase in publications. This problem may be addressed by using named …

PubTator central: automated concept annotation for biomedical full text articles

CH Wei, A Allot, R Leaman, Z Lu - Nucleic acids research, 2019 - academic.oup.com
Abstract PubTator Central (https://www. ncbi. nlm. nih. gov/research/pubtator/) is a web
service for viewing and retrieving bioconcept annotations in full text biomedical articles …

Deep learning with word embeddings improves biomedical named entity recognition

M Habibi, L Weber, M Neves, DL Wiegandt… - …, 2017 - academic.oup.com
Motivation Text mining has become an important tool for biomedical research. The most
fundamental text-mining task is the recognition of biomedical named entities (NER), such as …

[HTML][HTML] BioCreative V CDR task corpus: a resource for chemical disease relation extraction

J Li, Y Sun, RJ Johnson, D Sciaky, CH Wei… - Database, 2016 - academic.oup.com
Community-run, formal evaluations and manually annotated text corpora are critically
important for advancing biomedical text-mining research. Recently in BioCreative V, a new …

[HTML][HTML] Building a PubMed knowledge graph

J Xu, S Kim, M Song, M Jeong, D Kim, J Kang… - Scientific data, 2020 - nature.com
PubMed® is an essential resource for the medical domain, but useful concepts are either
difficult to extract or are ambiguous, which has significantly hindered knowledge discovery …

ChemDataExtractor: a toolkit for automated extraction of chemical information from the scientific literature

MC Swain, JM Cole - Journal of chemical information and …, 2016 - ACS Publications
The emergence of “big data” initiatives has led to the need for tools that can automatically
extract valuable chemical information from large volumes of unstructured data, such as the …