Transformers in healthcare: A survey
With Artificial Intelligence (AI) increasingly permeating various aspects of society, including
healthcare, the adoption of the Transformers neural network architecture is rapidly changing …
healthcare, the adoption of the Transformers neural network architecture is rapidly changing …
Bioreader: a retrieval-enhanced text-to-text transformer for biomedical literature
The latest batch of research has equipped language models with the ability to attend over
relevant and factual information from non-parametric external sources, drawing a …
relevant and factual information from non-parametric external sources, drawing a …
OpticalBERT and OpticalTable-SQA: text-and table-based language models for the optical-materials domain
Text mining in the optical-materials domain is becoming increasingly important as the
number of scientific publications in this area grows rapidly. Language models such as …
number of scientific publications in this area grows rapidly. Language models such as …
Extracting structured seed-mediated gold nanorod growth procedures from scientific text with LLMs
Although gold nanorods have been the subject of much research, the pathways for
controlling their shape and thereby their optical properties remain largely heuristically …
controlling their shape and thereby their optical properties remain largely heuristically …
NLM-Chem, a new resource for chemical entity recognition in PubMed full text literature
Automatically identifying chemical and drug names in scientific publications advances
information access for this important class of entities in a variety of biomedical disciplines by …
information access for this important class of entities in a variety of biomedical disciplines by …
Similarity of precursors in solid-state synthesis as text-mined from scientific literature
Collecting and analyzing the vast amount of information available in the solid-state
chemistry literature may accelerate our understanding of materials synthesis. However, one …
chemistry literature may accelerate our understanding of materials synthesis. However, one …
Bioalbert: A simple and effective pre-trained language model for biomedical named entity recognition
In recent years, with the growing amount of biomedical documents, coupled with
advancement in natural language processing algorithms, the research on biomedical …
advancement in natural language processing algorithms, the research on biomedical …
On the effectiveness of compact biomedical transformers
Motivation Language models pre-trained on biomedical corpora, such as BioBERT, have
recently shown promising results on downstream biomedical tasks. Many existing pre …
recently shown promising results on downstream biomedical tasks. Many existing pre …
Hierarchical shared transfer learning for biomedical named entity recognition
Z Chai, H Jin, S Shi, S Zhan, L Zhuo, Y Yang - BMC bioinformatics, 2022 - Springer
Background Biomedical named entity recognition (BioNER) is a basic and important medical
information extraction task to extract medical entities with special meaning from medical …
information extraction task to extract medical entities with special meaning from medical …
Marginal likelihood training of BiLSTM-CRF for biomedical named entity recognition from disjoint label sets
Extracting typed entity mentions from text is a fundamental component to language
understanding and reasoning. While there exist substantial labeled text datasets for multiple …
understanding and reasoning. While there exist substantial labeled text datasets for multiple …