Improve Object Detection with Feature-based Knowledge Distillation: Towards Accurate and Efficient DetectorsLinfeng ZhangKaisheng MaInternational Conference on Learning Representations
To relieve such problem, we propose a novel and efficient SR model, named Feature Affinity-based Knowledge Distillation (FAKD), by transferring the structural knowledge of a heavy teacher model to a lightweight student model. To transfer the structural knowledge effectively, FAKD aims to distill ...
Object-Detection-Knowledge-Distillation-ICLR2021 The official implementation of ICLR2021 paper "Improve Object Detection with Feature-based Knowledge Distillation: Towards Accurate and Efficient Detectors". Please refer to thesupplementary material in Openreviewfor the codes now. ...
Regularizing Class-wise Predictions via Self-knowledge Distillation 解决的问题是图像分类模型的过拟合,做法利用类class-wise正则化项。思想是比如上图,这个思想简单的作为KL散度中不动的一方,下面这个背景复杂的作为动的一方,在类别预测的概率分布上进行蒸馏,过滤掉黑暗知识。一个模型,两个不同的样本但是类别是一致的...
Model compression with two-stage multi-teacher knowledge distillation for web question answering system. In Proceedings of the 13th International Conference on Web Search and Data Mining, Houston, TX, USA, 3–7 February 2020; pp. 690–698. [Google Scholar] Liscio, E.; Araque, O.; Gatti, L...
On the other hand, for reducing the computational demand of CapsNet, mutual learning such as knowledge distillation50, 51 may be introduced.Data availability The data that support the findings of this study are openly available in RGB-D benchmark datasets, including NJU2K30, NLPR31, STERE32 ...
Comparing kullback-leibler divergence and mean squared error loss in knowledge distillation. arXiv 2021, arXiv:2105.08919. [Google Scholar] Tung, F.; Mori, G. Similarity-preserving knowledge distillation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of ...
To address the fuzzy segmentation boundaries, missing details, small target losses and low efficiency of traditional segmentation methods in ancient mural image segmentation scenarios, this paper proposes a mural segmentation model based on multiscale fe
& Chen, Z. Uncertainty-aware multi-shot knowledge distillation for image-based object re-identification. Proc. AAAI Conf. Artif. Intell. 34, 11165–11172 (2020). Google Scholar Meng, D., et al. Parsing-based view-aware embedding network for vehicle re-identification. In Proceedings of the...
The distillation of knowledge from this huge amount of unstructured information, also known as opinion mining and sentiment analysis. Nowadays, with the rapid evolution of smart phones, mobile applications (Mobile Apps) have become essential parts of our lives. However, it is difficult for consumers...