[HTML][HTML] A Multi-Level Adaptive Lightweight Net for Damaged Road Marking Detection Based on Knowledge Distillation

J Wang, X Zeng, Y Wang, X Ren, D Wang, W Qu… - Remote Sensing, 2024 - mdpi.com
To tackle the complexity and limited applicability of high-precision segmentation models for
damaged road markings, this study proposes a Multi-level Adaptive Lightweight Network …

HSViT: Horizontally Scalable Vision Transformer

C Xu, CT Li, CP Lim, D Creighton - arXiv preprint arXiv:2404.05196, 2024 - arxiv.org
While the Vision Transformer (ViT) architecture gains prominence in computer vision and
attracts significant attention from multimedia communities, its deficiency in prior knowledge …

PHD-NAS: Preserving helpful data to promote Neural Architecture Search

S Lu, Y Hu, L Yang, J Mei, Z Sun, J Tan, C Song - Neurocomputing, 2024 - Elsevier
Abstract Neural Architecture Search (NAS) has achieved promising results in many
domains. However, the enormous computational burden consumed by the NAS procedure …

Unified Framework for Neural Network Compression via Decomposition and Optimal Rank Selection

A Aghababaei-Harandi, MR Amini - arXiv preprint arXiv:2409.03555, 2024 - arxiv.org
Despite their high accuracy, complex neural networks demand significant computational
resources, posing challenges for deployment on resource-constrained devices such as …

Improving Neural Network Efficiency Through Advanced Pruning Techniques

N Tyche, A Taylor, J Evans, M Reid - Authorea Preprints, 2024 - techrxiv.org
In this paper, we propose a novel method for compressing and optimizing deep neural
networks through channel pruning based on spectral norm. As deep learning models grow …