Model merging in llms, mllms, and beyond: Methods, theories, applications and opportunities

E Yang, L Shen, G Guo, X Wang, X Cao… - arXiv preprint arXiv …, 2024 - arxiv.org
Model merging is an efficient empowerment technique in the machine learning community
that does not require the collection of raw training data and does not require expensive …

A survey of backdoor attacks and defenses on large language models: Implications for security measures

S Zhao, M Jia, Z Guo, L Gan, X Xu, X Wu, J Fu… - arXiv preprint arXiv …, 2024 - arxiv.org
Large Language Models (LLMs), which bridge the gap between human language
understanding and complex problem-solving, achieve state-of-the-art performance on …

EmMark: Robust watermarks for IP protection of embedded quantized large language models

R Zhang, F Koushanfar - Proceedings of the 61st ACM/IEEE Design …, 2024 - dl.acm.org
This paper introduces EmMark, a novel watermarking framework for protecting intellectual
property (IP) of embedded large language models deployed on resource-constrained edge …

Watermarking Large Language Models and the Generated Content: Opportunities and Challenges

R Zhang, F Koushanfar - arXiv preprint arXiv:2410.19096, 2024 - arxiv.org
The widely adopted and powerful generative large language models (LLMs) have raised
concerns about intellectual property rights violations and the spread of machine-generated …

Oml: Open, monetizable, and loyal ai

Z Cheng, E Contente, B Finch, O Golev… - arXiv preprint arXiv …, 2024 - arxiv.org
Artificial Intelligence (AI) has steadily improved across a wide range of tasks. However, the
development and deployment of AI are almost entirely controlled by a few powerful …

Have you merged my model? on the robustness of large language model ip protection methods against model merging

T Cong, D Ran, Z Liu, X He, J Liu, Y Gong, Q Li… - Proceedings of the 1st …, 2023 - dl.acm.org
Model merging is a promising lightweight model empowerment technique that does not rely
on expensive computing devices (eg, GPUs) or require the collection of specific training …

Pedagogical Alignment of Large Language Models (LLM) for Personalized Learning: A Survey, Trends and Challenges

MA Razafinirina, WG Dimbisoa, T Mahatody - Journal of Intelligent …, 2024 - scirp.org
This survey paper investigates how personalized learning offered by Large Language
Models (LLMs) could transform educational experiences. We explore Knowledge Editing …

Watermarking Techniques for Large Language Models: A Survey

Y Liang, J Xiao, W Gan, PS Yu - arXiv preprint arXiv:2409.00089, 2024 - arxiv.org
With the rapid advancement and extensive application of artificial intelligence technology,
large language models (LLMs) are extensively used to enhance production, creativity …

MergePrint: Robust Fingerprinting against Merging Large Language Models

S Yamabe, T Takahashi, F Waseda… - arXiv preprint arXiv …, 2024 - arxiv.org
As the cost of training large language models (LLMs) rises, protecting their intellectual
property has become increasingly critical. Model merging, which integrates multiple expert …

Signal Watermark on Large Language Models

Z Xu, VS Sheng - arXiv preprint arXiv:2410.06545, 2024 - arxiv.org
As Large Language Models (LLMs) become increasingly sophisticated, they raise significant
security concerns, including the creation of fake news and academic misuse. Most detectors …