A survey on lora of large language models
Y Mao, Y Ge, Y Fan, W Xu, Y Mi, Z Hu… - Frontiers of Computer …, 2025 - Springer
Abstract Low-Rank Adaptation (LoRA), which updates the dense neural network layers with
pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning …
pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning …
Strategic preys make acute predators: Enhancing camouflaged object detectors by generating camouflaged objects
Camouflaged object detection (COD) is the challenging task of identifying camouflaged
objects visually blended into surroundings. Albeit achieving remarkable success, existing …
objects visually blended into surroundings. Albeit achieving remarkable success, existing …
Gra: Detecting oriented objects through group-wise rotating and attention
Oriented object detection, an emerging task in recent years, aims to identify and locate
objects across varied orientations. This requires the detector to accurately capture the …
objects across varied orientations. This requires the detector to accurately capture the …
Efficient diffusion transformer with step-wise dynamic attention mediators
This paper identifies significant redundancy in the query-key interactions within self-attention
mechanisms of diffusion transformer models, particularly during the early stages of …
mechanisms of diffusion transformer models, particularly during the early stages of …
Adanat: Exploring adaptive policy for token-based image generation
Recent studies have demonstrated the effectiveness of token-based methods for visual
content generation. As a representative work, non-autoregressive Transformers (NATs) are …
content generation. As a representative work, non-autoregressive Transformers (NATs) are …
Diffusion models and representation learning: A survey
Diffusion Models are popular generative modeling methods in various vision tasks, attracting
significant attention. They can be considered a unique instance of self-supervised learning …
significant attention. They can be considered a unique instance of self-supervised learning …
Everything to the Synthetic: Diffusion-driven Test-time Adaptation via Synthetic-Domain Alignment
Test-time adaptation (TTA) aims to enhance the performance of source-domain pretrained
models when tested on unknown shifted target domains. Traditional TTA methods primarily …
models when tested on unknown shifted target domains. Traditional TTA methods primarily …
Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices
Z Ma, Y Zhang, G Jia, L Zhao, Y Ma, M Ma… - arXiv preprint arXiv …, 2024 - arxiv.org
As one of the most popular and sought-after generative models in the recent years, diffusion
models have sparked the interests of many researchers and steadily shown excellent …
models have sparked the interests of many researchers and steadily shown excellent …
Taming Rectified Flow for Inversion and Editing
Rectified-flow-based diffusion transformers, such as FLUX and OpenSora, have
demonstrated exceptional performance in the field of image and video generation. Despite …
demonstrated exceptional performance in the field of image and video generation. Despite …
COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing
Video editing is an emerging task, in which most current methods adopt the pre-trained text-
to-image (T2I) diffusion model to edit the source video in a zero-shot manner. Despite …
to-image (T2I) diffusion model to edit the source video in a zero-shot manner. Despite …