Orthogonal adaptation for modular customization of diffusion models

R Po, G Yang, K Aberman… - Proceedings of the …, 2024 - openaccess.thecvf.com
Customization techniques for text-to-image models have paved the way for a wide range of
previously unattainable applications enabling the generation of specific concepts across …

IDAdapter: Learning Mixed Features for Tuning-Free Personalization of Text-to-Image Models

S Cui, J Guo, X An, J Deng, Y Zhao… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Leveraging Stable Diffusion for the generation of personalized portraits has
emerged as a powerful and noteworthy tool enabling users to create high-fidelity custom …

X-adapter: Adding universal compatibility of plugins for upgraded diffusion model

L Ran, X Cun, JW Liu, R Zhao, S Zijie… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce X-Adapter a universal upgrader to enable the pretrained plug-and-play
modules (eg ControlNet LoRA) to work directly with the upgraded text-to-image diffusion …

DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representations

T Qi, S Fang, Y Wu, H Xie, J Liu… - Proceedings of the …, 2024 - openaccess.thecvf.com
The diffusion-based text-to-image model harbors immense potential in transferring reference
style. However current encoder-based approaches significantly impair the text controllability …

U-VAP: User-specified Visual Appearance Personalization via Decoupled Self Augmentation

Y Wu, K Liu, X Mi, F Tang, J Cao… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Concept personalization methods enable large text-to-image models to learn
specific subjects (eg objects/poses/3D models) and synthesize renditions in new contexts …

A Survey on Personalized Content Synthesis with Diffusion Models

X Zhang, XY Wei, W Zhang, J Wu, Z Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent advancements in generative models have significantly impacted content creation,
leading to the emergence of Personalized Content Synthesis (PCS). With a small set of user …

A Survey on LoRA of Large Language Models

Y Mao, Y Ge, Y Fan, W Xu, Y Mi, Z Hu… - arXiv preprint arXiv …, 2024 - arxiv.org
Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with
pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning …

FSViewFusion: Few-Shots View Generation of Novel Objects

R Hussain, HXG Lim, B Chen, M Shah… - arXiv preprint arXiv …, 2024 - arxiv.org
Novel view synthesis has observed tremendous developments since the arrival of NeRFs.
However, Nerf models overfit on a single scene, lacking generalization to out of distribution …

InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generation

H Wang, P Xing, R Huang, H Ai, Q Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Style transfer is an inventive process designed to create an image that maintains the
essence of the original while embracing the visual style of another. Although diffusion …