Retrieval-augmented mixture of lora experts for uploadable machine learning

Z Zhao, L Gan, G Wang, Y Hu, T Shen, H Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Low-Rank Adaptation (LoRA) offers an efficient way to fine-tune large language models
(LLMs). Its modular and plug-and-play nature allows the integration of various domain …