Llama 2: Open foundation and fine-tuned chat models

H Touvron, L Martin, K Stone, P Albert… - arXiv preprint arXiv …, 2023 - arxiv.org
… large language models (LLMs) ranging in scale from 7 … fine-tuned LLMs, called Llama
2-Chat, are optimized for dialogue use cases. Our models outperform open-source chat models on …

[PDF][PDF] Llama 2: Open foundation and fine-tuned chat models

M GenAI - arXiv preprint arXiv:2307.09288, 2023 - openreview.net
… large language models (LLMs) ranging in scale from 7 … fine-tuned LLMs, called Llama
2-Chat, are optimized for dialogue use cases. Our models outperform open-source chat models on …

Me llama: Foundation large language models for medical applications

Q Xie, Q Chen, A Chen, C Peng, Y Hu, F Lin… - arXiv preprint arXiv …, 2024 - arxiv.org
LLaMA 13B-chat and Me LLaMA 70B-chat are developed by further instruction tuning our Me
LLaMA 13B/70B foundation models … samples, we fine-tuned the models for 5 epochs, while …

Fine-tuning llama 2 large language models for detecting online sexual predatory chats and abusive texts

TT Nguyen, C Wilson, J Dalins - arXiv preprint arXiv:2308.14683, 2023 - arxiv.org
… In this paper, we have fine-tuned the pretrained Llama 2 7B… in detecting online sexual predatory
chat logs and abusive texts. … al., “Llama 2: Open foundation and fine-tuned chat models,” …

Code llama: Open foundation models for code

B Roziere, J Gehring, F Gloeckle, S Sootla, I Gat… - arXiv preprint arXiv …, 2023 - arxiv.org
… We provide zero-shot results of our instruction fine-tuned models on APPS in Table 15 with
… coding ability We evaluate Code Llama - Instruct and compare it to Llama 2-Chat for coding …

Openchat: Advancing open-source language models with mixed-quality data

G Wang, S Cheng, X Zhan, X Li, S Song… - arXiv preprint arXiv …, 2023 - arxiv.org
… The open-source language model llama-2-chat-70b, which employs both SFT and RLHF, is
… the base model llama-2-13b and the corresponding fine-tuned models, as depicted in Fig. 2(…

Llamafactory: Unified efficient fine-tuning of 100+ language models

Y Zheng, R Zhang, J Zhang, Y Ye, Z Luo… - arXiv preprint arXiv …, 2024 - arxiv.org
2023), we compute it as the ratio of the maximum input … Therefore, we provide dozens
of chat templates that can be auto… users to measure the abilities of the fine-tuned models. …

LLaMA-adapter: Efficient fine-tuning of large language models with zero-initialized attention

R Zhang, J Han, C Liu, A Zhou, P Lu… - The Twelfth …, 2024 - openreview.net
… -following models, eg, ChatGPT. To this end, we present … comparable to the fully fine-tuned
Alpaca, including question … 2023), and is also fine-tuned by a collection of 665K instruction-…

[PDF][PDF] Code Llama: Open Foundation Models for Code

WX Grattafiori, A Défossez, J Copet… - arXiv preprint arXiv …, 2023 - openreview.net
… We provide zero-shot results of our instruction fine-tuned models on APPS in Table 15 with
… coding ability We evaluate Code Llama - Instruct and compare it to Llama 2-Chat for coding …

[PDF][PDF] Fine-Grained Languagebased Reliability Detection in Spanish New with Fine-Tuned Llama-3 Model

M Ibrahim - In Proceedings of the Iberian Languages Evaluation …, 2024 - ceur-ws.org
… parameter Llama 3 model recently launched by Meta GenAI. In the IberLEF 2024 - Flares
subtask … bert model and evaluation data, arXiv preprint arXiv:2308.02976 (2023). [14] H. Liu, W. …