Retrieval-augmented mixture of lora experts for uploadable machine learning
Low-Rank Adaptation (LoRA) offers an efficient way to fine-tune large language models
(LLMs). Its modular and plug-and-play nature allows the integration of various domain …
(LLMs). Its modular and plug-and-play nature allows the integration of various domain …
Towards modular llms by building and reusing a library of loras
The growing number of parameter-efficient adaptations of a base large language model
(LLM) calls for studying whether we can reuse such trained adapters to improve …
(LLM) calls for studying whether we can reuse such trained adapters to improve …
Mixture of Experts Using Tensor Products
In multi-task learning, the conventional approach involves training a model on multiple tasks
simultaneously. However, the training signals from different tasks can interfere with one …
simultaneously. However, the training signals from different tasks can interfere with one …
[PDF][PDF] Information Propagation in Modular Language Modeling and Web Tracking
Z Su - 2024 - di.ku.dk
Abstract Information propagation is the process through which data are transmitted within a
system. The growth of large-scale web datasets has led to explosive growth in information …
system. The growth of large-scale web datasets has led to explosive growth in information …