CrossKD: Cross-head knowledge distillation for object detection

J Wang, Y Chen, Z Zheng, X Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Knowledge Distillation (KD) has been validated as an effective model compression
technique for learning compact object detectors. Existing state-of-the-art KD methods for …

A Review of Knowledge Distillation in Object Detection

N Yadikar, K Ubul - IEEE Access, 2023 - ieeexplore.ieee.org
Target detection is a revolutionary advancement in computer vision that provides the ability
to identify specific targets in images for a wide variety of applications, including but not …

[HTML][HTML] Computer vision model compression techniques for embedded systems: A survey

A Lopes, FP dos Santos, D de Oliveira, M Schiezaro… - Computers & …, 2024 - Elsevier
Deep neural networks have consistently represented the state of the art in most computer
vision problems. In these scenarios, larger and more complex models have demonstrated …

Relation knowledge distillation by auxiliary learning for object detection

H Wang, T Jia, Q Wang, W Zuo - IEEE Transactions on Image …, 2024 - ieeexplore.ieee.org
Balancing the trade-off between accuracy and speed for obtaining higher performance
without sacrificing the inference time is a challenging topic for object detection task …

Research on knowledge distillation algorithm based on Yolov5 attention mechanism

P Zhou, A Aysa, K Ubul - Expert Systems with Applications, 2024 - Elsevier
The current most advanced CNN-based detection models are nearly not deployable on
mobile devices with limited arithmetic power due to problems such as too many redundant …

FM-OV3D: Foundation Model-Based Cross-Modal Knowledge Blending for Open-Vocabulary 3D Detection

D Zhang, C Li, R Zhang, S Xie, W Xue, X Xie… - Proceedings of the …, 2024 - ojs.aaai.org
The superior performances of pre-trained foundation models in various visual tasks
underscore their potential to enhance the 2D models' open-vocabulary ability. Existing …

Domain-invariant Progressive Knowledge Distillation for UAV-based Object Detection

L Yao, F Liu, C Zhang, Z Ou… - IEEE Geoscience and …, 2024 - ieeexplore.ieee.org
Knowledge distillation (KD) is an effective method for compressing models in object
detection tasks. Due to limited computational capability, unmanned aerial vehicle-based …

DrkD: Decoupling response-based distillation for object detection

Y Lv, Y Cai, Y He, M Li - Pattern Recognition, 2024 - Elsevier
Response-based distillation, a key form of knowledge distillation (KD), has been central to
KD research. However, the sequential training pipelines inherent to object detection models …

Towards Real-Time and Efficient Perception Workflows in Software-Defined Vehicles

R Jafarpourmarzouni, Y Luo, S Lu… - IEEE Internet of Things …, 2024 - ieeexplore.ieee.org
With the growing demand for software-defined vehicles (SDVs), deep learning-based
perception models have become increasingly important in intelligent transportation systems …

InstKD: Towards Lightweight 3D Object Detection With Instance-Aware Knowledge Distillation

H Zhang, L Liu, Y Huang, X Lei… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep neural network (DNN) is extensively explored for LiDAR-based 3D object detection, a
crucial perception task in the field of autonomous driving. However, the presence of …