Edge AI: On-demand accelerating deep neural network inference via edge computing

E Li, L Zeng, Z Zhou, X Chen - IEEE Transactions on Wireless …, 2019 - ieeexplore.ieee.org
As a key technology of enabling Artificial Intelligence (AI) applications in 5G era, Deep
Neural Networks (DNNs) have quickly attracted widespread attention. However, it is …

面向实时应用的深度学习研究综述

张政馗, 庞为光, 谢文静, 吕鸣松, 王义 - 软件学报, 2019 - jos.org.cn
深度学习算法和GPU 算力的不断进步, 正促进着人工智能技术在包括计算机视觉, 语音识别,
自然语言处理等领域得到广泛应用. 与此同时, 深度学习已经开始应用于以自动驾驶为代表的 …

Machine learning in real-time internet of things (iot) systems: A survey

J Bian, A Al Arafat, H Xiong, J Li, L Li… - IEEE Internet of …, 2022 - ieeexplore.ieee.org
Over the last decade, machine learning (ML) and deep learning (DL) algorithms have
significantly evolved and been employed in diverse applications, such as computer vision …

Lalarand: Flexible layer-by-layer cpu/gpu scheduling for real-time dnn tasks

W Kang, K Lee, J Lee, I Shin… - 2021 IEEE Real-Time …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have shown remarkable success in various machine-learning
(ML) tasks useful for many safety-critical, real-time embedded systems. The foremost design …

Deep learning for real-time applications: A survey

张政馗, 庞为光, 谢文静, 吕鸣松, 王义 - Journal of software, 2019 - jos.org.cn
深度学习算法和 GPU 算力的不断进步, 正促进着人工智能技术在包括计算机视觉, 语音识别,
自然语言处理等领域得到广泛应用. 与此同时, 深度学习已经开始应用于以自动驾驶为代表的 …

Scheduling real-time deep learning services as imprecise computations

S Yao, Y Hao, Y Zhao, H Shao, D Liu… - 2020 IEEE 26th …, 2020 - ieeexplore.ieee.org
The paper presents a real-time computing framework for intelligent real-time edge services,
on behalf of local embedded devices that are themselves unable to support extensive …

On removing algorithmic priority inversion from mission-critical machine inference pipelines

S Liu, S Yao, X Fu, R Tabish, S Yu… - 2020 IEEE Real …, 2020 - ieeexplore.ieee.org
The paper discusses algorithmic priority inversion in mission-critical machine inference
pipelines used in modern neural-network-based cyber-physical applications, and develops …

Co-optimizing performance and memory footprint via integrated cpu/gpu memory management, an implementation on autonomous driving platform

S Bateni, Z Wang, Y Zhu, Y Hu… - 2020 IEEE Real-Time and …, 2020 - ieeexplore.ieee.org
Cutting-edge embedded system applications, such as self-driving cars and unmanned
drone software, are reliant on integrated CPU/GPU platforms for their DNNs-driven …

Deepperform: An efficient approach for performance testing of resource-constrained neural networks

S Chen, M Haque, C Liu, W Yang - Proceedings of the 37th IEEE/ACM …, 2022 - dl.acm.org
Today, an increasing number of Adaptive Deep Neural Networks (AdNNs) are being used
on resource-constrained embedded devices. We observe that, similar to traditional software …

Real-time object detection system with multi-path neural networks

S Heo, S Cho, Y Kim, H Kim - 2020 IEEE Real-Time and …, 2020 - ieeexplore.ieee.org
Thanks to the recent advances in Deep Neural Networks (DNNs), DNN-based object
detection systems become highly accurate and widely used in real-time environments such …