[HTML][HTML] Review of large vision models and visual prompt engineering

J Wang, Z Liu, L Zhao, Z Wu, C Ma, S Yu, H Dai… - Meta-Radiology, 2023 - Elsevier
Visual prompt engineering is a fundamental methodology in the field of visual and image
artificial general intelligence. As the development of large vision models progresses, the …

Large language models for robotics: Opportunities, challenges, and perspectives

J Wang, Z Wu, Y Li, H Jiang, P Shu, E Shi, H Hu… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) have undergone significant expansion and have been
increasingly integrated across various domains. Notably, in the realm of robot task planning …

Radiology-llama2: Best-in-class large language model for radiology

Z Liu, Y Li, P Shu, A Zhong, L Yang, C Ju, Z Wu… - arXiv preprint arXiv …, 2023 - arxiv.org
This paper introduces Radiology-Llama2, a large language model specialized for radiology
through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 …

Pharmacygpt: The ai pharmacist

Z Liu, Z Wu, M Hu, B Zhao, L Zhao, T Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
In this study, we introduce PharmacyGPT, a novel framework to assess the capabilities of
large language models (LLMs) such as ChatGPT and GPT-4 in emulating the role of clinical …

Evaluating large language models for radiology natural language processing

Z Liu, T Zhong, Y Li, Y Zhang, Y Pan, Z Zhao… - arXiv preprint arXiv …, 2023 - arxiv.org
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural
language processing (NLP). LLMs have revolutionized a multitude of domains, and they …

Artificial general intelligence for radiation oncology

C Liu, Z Liu, J Holmes, L Zhang, L Zhang, Y Ding… - Meta-radiology, 2023 - Elsevier
The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As
prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can …

Hierarchical semantic tree concept whitening for interpretable image classification

H Dai, L Zhang, L Zhao, Z Wu, Z Liu, D Liu, X Yu… - arXiv preprint arXiv …, 2023 - arxiv.org
With the popularity of deep neural networks (DNNs), model interpretability is becoming a
critical concern. Many approaches have been developed to tackle the problem through post …

Holistic evaluation of gpt-4v for biomedical imaging

Z Liu, H Jiang, T Zhong, Z Wu, C Ma, Y Li, X Yu… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and
limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial …

Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 report

J Holmes, L Zhang, Y Ding, H Feng, Z Liu, T Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
Purpose: To introduce the concept of using large language models (LLMs) to re-label
structure names in accordance with the American Association of Physicists in Medicine …

Benchmarking a Foundation Large Language Model on its Ability to Relabel Structure Names in Accordance With the American Association of Physicists in Medicine …

J Holmes, L Zhang, Y Ding, H Feng, Z Liu, T Liu… - Practical Radiation …, 2024 - Elsevier
Purpose To introduce the concept of using large language models (LLMs) to relabel
structure names in accordance with the American Association of Physicists in Medicine Task …