Distilling knowledge via knowledge review

P Chen, S Liu, H Zhao, J Jia - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Abstract Knowledge distillation transfers knowledge from the teacher network to the student
one, with the goal of greatly improving the performance of the student network. Previous …

Knowledge distillation and student-teacher learning for visual intelligence: A review and new outlooks

L Wang, KJ Yoon - IEEE transactions on pattern analysis and …, 2021 - ieeexplore.ieee.org
Deep neural models, in recent years, have been successful in almost every field, even
solving the most complex problem statements. However, these models are huge in size with …

YOLOv6: A single-stage object detection framework for industrial applications

C Li, L Li, H Jiang, K Weng, Y Geng, L Li, Z Ke… - arXiv preprint arXiv …, 2022 - arxiv.org
For years, the YOLO series has been the de facto industry-level standard for efficient object
detection. The YOLO community has prospered overwhelmingly to enrich its use in a …

Decoupled knowledge distillation

B Zhao, Q Cui, R Song, Y Qiu… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
State-of-the-art distillation methods are mainly based on distilling deep features from
intermediate layers, while the significance of logit distillation is greatly overlooked. To …

Focal and global knowledge distillation for detectors

Z Yang, Z Li, X Jiang, Y Gong, Z Yuan… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Knowledge distillation has been applied to image classification successfully.
However, object detection is much more sophisticated and most knowledge distillation …

Masked generative distillation

Z Yang, Z Li, M Shao, D Shi, Z Yuan, C Yuan - European Conference on …, 2022 - Springer
Abstract Knowledge distillation has been applied to various tasks successfully. The current
distillation algorithm usually improves students' performance by imitating the output of the …

Learning multiple adverse weather removal via two-stage knowledge learning and multi-contrastive regularization: Toward a unified model

WT Chen, ZK Huang, CC Tsai… - Proceedings of the …, 2022 - openaccess.thecvf.com
In this paper, an ill-posed problem of multiple adverse weather removal is investigated. Our
goal is to train a model with a'unified'architecture and only one set of pretrained weights that …

Knowledge distillation: A survey

J Gou, B Yu, SJ Maybank, D Tao - International Journal of Computer Vision, 2021 - Springer
In recent years, deep neural networks have been successful in both industry and academia,
especially for computer vision tasks. The great success of deep learning is mainly due to its …

Damo-yolo: A report on real-time object detection design

X Xu, Y Jiang, W Chen, Y Huang, Y Zhang… - arXiv preprint arXiv …, 2022 - arxiv.org
In this report, we present a fast and accurate object detection method dubbed DAMO-YOLO,
which achieves higher performance than the state-of-the-art YOLO series. DAMO-YOLO is …

[HTML][HTML] 基于深度学习的视觉目标检测技术综述

曹家乐, 李亚利, 孙汉卿, 谢今, 黄凯奇, 庞彦伟 - 2022 - cjig.cn
摘要视觉目标检测旨在定位和识别图像中存在的物体, 属于计算机视觉领域的经典任务之一,
也是许多计算机视觉任务的前提与基础, 在自动驾驶, 视频监控等领域具有重要的应用价值 …