Weight-sharing neural architecture search: A battle to shrink the optimization gap

L Xie, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Dynamic neural networks: A survey

Y Han, G Huang, S Song, L Yang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …

Micronet: Improving image recognition with extremely low flops

Y Li, Y Chen, X Dai, D Chen, M Liu… - Proceedings of the …, 2021 - openaccess.thecvf.com
This paper aims at addressing the problem of substantial performance degradation at
extremely low computational cost (eg 5M FLOPs on ImageNet classification). We found that …

Adapting Neural Networks at Runtime: Current Trends in At-Runtime Optimizations for Deep Learning

M Sponner, B Waschneck, A Kumar - ACM Computing Surveys, 2024 - dl.acm.org
Adaptive optimization methods for deep learning adjust the inference task to the current
circumstances at runtime to improve the resource footprint while maintaining the model's …

Controllable dynamic multi-task architectures

DS Raychaudhuri, Y Suh, S Schulter… - Proceedings of the …, 2022 - openaccess.thecvf.com
Multi-task learning commonly encounters competition for resources among tasks,
specifically when model capacity is limited. This challenge motivates models which allow …

Apg: Adaptive parameter generation network for click-through rate prediction

B Yan, P Wang, K Zhang, F Li… - Advances in Neural …, 2022 - proceedings.neurips.cc
In many web applications, deep learning-based CTR prediction models (deep CTR models
for short) are widely adopted. Traditional deep CTR models learn patterns in a static …

Multi-exit semantic segmentation networks

A Kouris, SI Venieris, S Laskaridis, N Lane - European Conference on …, 2022 - Springer
Semantic segmentation arises as the backbone of many vision systems, spanning from self-
driving cars and robot navigation to augmented reality and teleconferencing. Frequently …

Efficient deep visual and inertial odometry with adaptive visual modality selection

M Yang, Y Chen, HS Kim - European Conference on Computer Vision, 2022 - Springer
In recent years, deep learning-based approaches for visual-inertial odometry (VIO) have
shown remarkable performance outperforming traditional geometric methods. Yet, all …

SlowFormer: Adversarial Attack on Compute and Energy Consumption of Efficient Vision Transformers

KL Navaneet, SA Koohpayegani… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recently there has been a lot of progress in reducing the computation of deep models at
inference time. These methods can reduce both the computational needs and power usage …

Dynamic feature pyramid networks for object detection

M Zhu - … Conference on Signal Processing Systems (ICSPS …, 2024 - spiedigitallibrary.org
Feature pyramid network (FPN) is a critical component in modern object detection
frameworks. The performance gain in most of the existing FPN variants is mainly attributed to …