A comprehensive benchmark of deep learning libraries on mobile devices

Q Zhang, X Li, X Che, X Ma, A Zhou, M Xu… - Proceedings of the …, 2022 - dl.acm.org
Deploying deep learning (DL) on mobile devices has been a notable trend in recent years.
To support fast inference of on-device DL, DL libraries play a critical role as algorithms and …

A comprehensive deep learning library benchmark and optimal library selection

Q Zhang, X Che, Y Chen, X Ma, M Xu… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Deploying deep learning (DL) on mobile devices has been a notable trend in recent years.
To support fast inference of on-device DL, DL libraries play a critical role as algorithms and …

A survey of deep learning on mobile devices: Applications, optimizations, challenges, and research opportunities

T Zhao, Y Xie, Y Wang, J Cheng, X Guo… - Proceedings of the …, 2022 - ieeexplore.ieee.org
Deep learning (DL) has demonstrated great performance in various applications on
powerful computers and servers. Recently, with the advancement of more powerful mobile …

MNN: A universal and efficient inference engine

X Jiang, H Wang, Y Chen, Z Wu… - Proceedings of …, 2020 - proceedings.mlsys.org
Deploying deep learning (DL) models on mobile devices draws more and more attention
recently. However, designing an efficient inference engine on devices is under the great …

Custom hardware architectures for deep learning on portable devices: a review

KS Zaman, MBI Reaz, SHM Ali… - … on Neural Networks …, 2021 - ieeexplore.ieee.org
The staggering innovations and emergence of numerous deep learning (DL) applications
have forced researchers to reconsider hardware architecture to accommodate fast and …

Mdinference: Balancing inference accuracy and latency for mobile applications

SS Ogden, T Guo - 2020 IEEE International Conference on …, 2020 - ieeexplore.ieee.org
Deep Neural Networks are allowing mobile devices to incorporate a wide range of features
into user applications. However, the computational complexity of these models makes it …

An empirical study towards characterizing deep learning development and deployment across different frameworks and platforms

Q Guo, S Chen, X Xie, L Ma, Q Hu, H Liu… - 2019 34th IEEE/ACM …, 2019 - ieeexplore.ieee.org
Deep Learning (DL) has recently achieved tremendous success. A variety of DL frameworks
and platforms play a key role to catalyze such progress. However, the differences in …

[HTML][HTML] Efficient deep learning inference on edge devices

Z Jiang, T Chen, M Li - 2018 - amazon.science
Deploying deep learning (DL) models on edge devices is getting popular nowadays. The
huge diversity of edge devices, with both computation and memory constraints, however …

Deep learning on computational‐resource‐limited platforms: A survey

C Chen, P Zhang, H Zhang, J Dai, Y Yi… - Mobile Information …, 2020 - Wiley Online Library
Nowadays, Internet of Things (IoT) gives rise to a huge amount of data. IoT nodes equipped
with smart sensors can immediately extract meaningful knowledge from the data through …

Benchmarking deep learning frameworks: Design considerations, metrics and beyond

L Liu, Y Wu, W Wei, W Cao, S Sahin… - 2018 IEEE 38th …, 2018 - ieeexplore.ieee.org
With increasing number of open-source deep learning (DL) software tools made available,
benchmarking DL software frameworks and systems is in high demand. This paper presents …