Transformers in healthcare: A survey

S Nerella, S Bandyopadhyay, J Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
With Artificial Intelligence (AI) increasingly permeating various aspects of society, including
healthcare, the adoption of the Transformers neural network architecture is rapidly changing …

Bioreader: a retrieval-enhanced text-to-text transformer for biomedical literature

G Frisoni, M Mizutani, G Moro… - Proceedings of the 2022 …, 2022 - aclanthology.org
The latest batch of research has equipped language models with the ability to attend over
relevant and factual information from non-parametric external sources, drawing a …

OpticalBERT and OpticalTable-SQA: text-and table-based language models for the optical-materials domain

J Zhao, S Huang, JM Cole - Journal of Chemical Information and …, 2023 - ACS Publications
Text mining in the optical-materials domain is becoming increasingly important as the
number of scientific publications in this area grows rapidly. Language models such as …

Extracting structured seed-mediated gold nanorod growth procedures from scientific text with LLMs

N Walker, S Lee, J Dagdelen, K Cruse, S Gleason… - Digital …, 2023 - pubs.rsc.org
Although gold nanorods have been the subject of much research, the pathways for
controlling their shape and thereby their optical properties remain largely heuristically …

NLM-Chem, a new resource for chemical entity recognition in PubMed full text literature

R Islamaj, R Leaman, S Kim, D Kwon, CH Wei… - Scientific data, 2021 - nature.com
Automatically identifying chemical and drug names in scientific publications advances
information access for this important class of entities in a variety of biomedical disciplines by …

Similarity of precursors in solid-state synthesis as text-mined from scientific literature

T He, W Sun, H Huo, O Kononova, Z Rong… - Chemistry of …, 2020 - ACS Publications
Collecting and analyzing the vast amount of information available in the solid-state
chemistry literature may accelerate our understanding of materials synthesis. However, one …

Bioalbert: A simple and effective pre-trained language model for biomedical named entity recognition

U Naseem, M Khushi, V Reddy… - … Joint Conference on …, 2021 - ieeexplore.ieee.org
In recent years, with the growing amount of biomedical documents, coupled with
advancement in natural language processing algorithms, the research on biomedical …

On the effectiveness of compact biomedical transformers

O Rohanian, M Nouriborji, S Kouchaki… - Bioinformatics, 2023 - academic.oup.com
Motivation Language models pre-trained on biomedical corpora, such as BioBERT, have
recently shown promising results on downstream biomedical tasks. Many existing pre …

Hierarchical shared transfer learning for biomedical named entity recognition

Z Chai, H Jin, S Shi, S Zhan, L Zhuo, Y Yang - BMC bioinformatics, 2022 - Springer
Background Biomedical named entity recognition (BioNER) is a basic and important medical
information extraction task to extract medical entities with special meaning from medical …

Marginal likelihood training of BiLSTM-CRF for biomedical named entity recognition from disjoint label sets

N Greenberg, T Bansal, P Verga… - Proceedings of the 2018 …, 2018 - aclanthology.org
Extracting typed entity mentions from text is a fundamental component to language
understanding and reasoning. While there exist substantial labeled text datasets for multiple …