Image recognition based on lightweight convolutional neural network: Recent advances
Y Liu, J Xue, D Li, W Zhang, TK Chiew, Z Xu - Image and Vision Computing, 2024 - Elsevier
Image recognition is an important task in computer vision with broad applications. In recent
years, with the advent of deep learning, lightweight convolutional neural network (CNN) has …
years, with the advent of deep learning, lightweight convolutional neural network (CNN) has …
NTCE-KD: Non-Target-Class-Enhanced Knowledge Distillation
C Li, X Teng, Y Ding, L Lan - Sensors, 2024 - mdpi.com
Most logit-based knowledge distillation methods transfer soft labels from the teacher model
to the student model via Kullback–Leibler divergence based on softmax, an exponential …
to the student model via Kullback–Leibler divergence based on softmax, an exponential …