Large language models in mental health care: a scoping review

Y Hua, F Liu, K Yang, Z Li, H Na, Y Sheu… - arXiv preprint arXiv …, 2024 - arxiv.org
The integration of large language models (LLMs) in mental health care is an emerging field.
There is a need to systematically review the application outcomes and delineate the …

Clinical text datasets for medical artificial intelligence and large language models—a systematic review

J Wu, X Liu, M Li, W Li, Z Su, S Lin, L Garay, Z Zhang… - NEJM AI, 2024 - ai.nejm.org
Privacy and ethical considerations limit access to large-scale clinical datasets, particularly
clinical text data, which contain extensive and diverse information and serve as the …

Benchmarking large language models on cmexam-a comprehensive chinese medical exam dataset

J Liu, P Zhou, Y Hua, D Chong, Z Tian… - Advances in …, 2024 - proceedings.neurips.cc
Recent advancements in large language models (LLMs) have transformed the field of
question answering (QA). However, evaluating LLMs in the medical field is challenging due …

Qilin-med: Multi-stage knowledge injection advanced medical large language model

Q Ye, J Liu, D Chong, P Zhou, Y Hua, F Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
Integrating large language models (LLMs) into healthcare holds great potential but faces
challenges. Pre-training LLMs from scratch for domains like medicine is resource-heavy and …

Qilin-med-vl: Towards chinese large vision-language model for general healthcare

J Liu, Z Wang, Q Ye, D Chong, P Zhou… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have introduced a new era of proficiency in comprehending
complex healthcare and biomedical topics. However, there is a noticeable lack of models in …

CARE-MI: chinese benchmark for misinformation evaluation in maternity and infant care

T Xiang, L Li, W Li, M Bai, L Wei… - Advances in Neural …, 2023 - proceedings.neurips.cc
The recent advances in natural language processing (NLP), have led to a new trend of
applying large language models (LLMs) to real-world scenarios. While the latest LLMs are …

Streamlining social media information retrieval for public health research with deep learning

Y Hua, J Wu, S Lin, M Li, Y Zhang… - Journal of the …, 2024 - academic.oup.com
Objective Social media-based public health research is crucial for epidemic surveillance, but
most studies identify relevant corpora with keyword-matching. This study develops a system …

Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages

CM Downey, T Blevins, N Goldfine… - arXiv preprint arXiv …, 2023 - arxiv.org
Pre-trained multilingual language models underpin a large portion of modern NLP tools
outside of English. A strong baseline for specializing these models for specific languages is …

Impact of Tokenization on LLaMa Russian Adaptation

M Tikhomirov, D Chernyshev - 2023 Ivannikov Ispras Open …, 2023 - ieeexplore.ieee.org
Latest instruction-tuned large language models (LLM) show great results on various tasks,
however, they often face performance degradation for non-English input. There is evidence …

Continuous Training and Fine-tuning for Domain-Specific Language Models in Medical Question Answering

Z Guo, Y Hua - arXiv preprint arXiv:2311.00204, 2023 - arxiv.org
Large language models exhibit promising general capabilities but often lack specialized
knowledge for domain-specific tasks. Developing domain experts from a base model …