Progress and opportunities of foundation models in bioinformatics

Q Li, Z Hu, Y Wang, L Li, Y Fan, I King… - Briefings in …, 2024 - academic.oup.com
Bioinformatics has undergone a paradigm shift in artificial intelligence (AI), particularly
through foundation models (FMs), which address longstanding challenges in bioinformatics …

Condensing Multilingual Knowledge with Lightweight Language-Specific Modules

H Xu, W Tan, SS Li, Y Chen, B Van Durme… - arXiv preprint arXiv …, 2023 - arxiv.org
Incorporating language-specific (LS) modules is a proven method to boost performance in
multilingual machine translation. This approach bears similarity to Mixture-of-Experts (MoE) …