Evaluation and mitigation of the limitations of large language models in clinical decision-making

P Hager, F Jungmann, R Holland, K Bhagat… - Nature medicine, 2024 - nature.com
Clinical decision-making is one of the most impactful parts of a physician's responsibilities
and stands to benefit greatly from artificial intelligence solutions and large language models …

Chatpose: Chatting about 3d human pose

Y Feng, J Lin, SK Dwivedi, Y Sun… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce ChatPose a framework employing Large Language Models (LLMs) to
understand and reason about 3D human poses from images or textual descriptions. Our …

Snip: Bridging mathematical symbolic and numeric realms with unified pre-training

K Meidani, P Shojaee, CK Reddy… - arXiv preprint arXiv …, 2023 - arxiv.org
In an era where symbolic mathematical equations are indispensable for modeling complex
natural phenomena, scientific inquiry often involves collecting observations and translating …

Transformers Can Do Arithmetic with the Right Embeddings

S McLeish, A Bansal, A Stein, N Jain… - arXiv preprint arXiv …, 2024 - arxiv.org
The poor performance of transformers on arithmetic tasks seems to stem in large part from
their inability to keep track of the exact position of each digit inside of a large span of digits …

Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data

DR Bellamy, B Kumar, C Wang, A Beam - arXiv preprint arXiv:2312.11502, 2023 - arxiv.org
In this work we introduce Labrador, a pre-trained Transformer model for laboratory data.
Labrador and BERT were pre-trained on a corpus of 100 million lab test results from …

Large Language Models in Drug Discovery and Development: From Disease Mechanisms to Clinical Trials

Y Zheng, HY Koh, M Yang, L Li, LT May… - arXiv preprint arXiv …, 2024 - arxiv.org
The integration of Large Language Models (LLMs) into the drug discovery and development
field marks a significant paradigm shift, offering novel methodologies for understanding …

MatText: Do Language Models Need More than Text & Scale for Materials Modeling?

N Alampara, S Miret, KM Jablonka - arXiv preprint arXiv:2406.17295, 2024 - arxiv.org
Effectively representing materials as text has the potential to leverage the vast
advancements of large language models (LLMs) for discovering new materials. While LLMs …

Zero-Shot Tokenizer Transfer

B Minixhofer, EM Ponti, I Vulić - arXiv preprint arXiv:2405.07883, 2024 - arxiv.org
Language models (LMs) are bound to their tokenizer, which maps raw text to a sequence of
vocabulary items (tokens). This restricts their flexibility: for example, LMs trained primarily on …

SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems

P Emami, Z Li, S Sinha, T Nguyen - arXiv preprint arXiv:2405.19653, 2024 - arxiv.org
Data-driven simulation surrogates help computational scientists study complex systems.
They can also help inform impactful policy decisions. We introduce a learning framework for …

Alice's Adventures in a Differentiable Wonderland--Volume I, A Tour of the Land

S Scardapane - arXiv preprint arXiv:2404.17625, 2024 - arxiv.org
This book is a self-contained introduction to the design of modern (deep) neural networks.
Because the term" neural" comes with a lot of historical baggage, I prefer the simpler term" …