Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning

[PDF] arxiv.org

A survey on lora of large language models

Y Mao, Y Ge, Y Fan, W Xu, Y Mi, Z Hu… - arXiv preprint arXiv …, 2024 - arxiv.org
Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with
pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning …
被引用次数：3 相关文章 所有 2 个版本
[PDF] arxiv.org

SVFit: Parameter-Efficient Fine-Tuning of Large Pre-Trained Models Using Singular Values

C Sun, J Wei, Y Wu, Y Shi, S He, Z Ma, N Xie… - arXiv preprint arXiv …, 2024 - arxiv.org
Large pre-trained models (LPMs) have demonstrated exceptional performance in diverse
natural language processing and computer vision tasks. However, fully fine-tuning these …
相关文章 所有 2 个版本