[HTML][HTML] Optimizing DNN training with pipeline model parallelism for enhanced performance in embedded systems

M Al Maruf, A Azim, N Auluck, M Sahi - Journal of Parallel and Distributed …, 2024 - Elsevier
Abstract Deep Neural Networks (DNNs) have gained widespread popularity in different
domain applications due to their dominant performance. Despite the prevalence of …

Energy and cost considerations for GPU accelerated AI inference workloads

T Molom-Ochir, R Shenoy - 2021 IEEE MIT Undergraduate …, 2021 - ieeexplore.ieee.org
Recent advances in AI have motivated hardware manufacturers to design deep learning
friendly accelerators to keep with the ever-growing increases in model sizes and compu …

Inference at the Edge for Complex Deep Learning Applications with Multiple Models and Accelerators

K Ashwanth, DN LK, VK Sundar… - 2023 14th International …, 2023 - ieeexplore.ieee.org
In this paper, we demonstrate the performance benefits of offloading deep learning
workloads to specialized hardware accelerators using an experimental setup consisting of a …

Intelligent predicting method for optimizing remote loading efficiency in edge service migration

X Meng, X Shao, H Masui, W Lu - Mobile Networks and Applications, 2022 - Springer
In mobile edge computing (MEC) systems, enhancing the learning capabilities of edge
nodes through Artificial Intelligence (AI) can improve the efficiency of dynamically allocating …

Time'sa Thief of Memory: Breaking Multi-tenant Isolation in TrustZones Through Timing Based Bidirectional Covert Channels

N Mishra, A Chakraborty, U Chatterjee… - … Conference on Smart …, 2022 - Springer
ARM TrustZone is a system-on-chip security solution that provides hardware guarantees to
isolate the untrusted applications running in the normal world from sensitive computation …

Load Characterization of AI Applications using DQoES Scheduler for Serving Multiple Requests

TOD Putra, RM Ijtihadie… - 2024 12th International …, 2024 - ieeexplore.ieee.org
In today's era, many types of Artificial Intelligence (AI)-based applications are being
developed to fulfill a variety of needs, for example, counting objects recorded using a …

Leveraging the Decentralised Open IoT Security Protocol ((d) OISP)™: Facilitating Edge-Based Artificial Intelligence in Large-Scale Network Infrastructures

CP Autry, W Henderson, M Magal… - … Computer and Energy …, 2023 - ieeexplore.ieee.org
There is an increasing demand for integrating edge-based Artificial Intelligence (AI) into
complex large-scale network infrastructures. This need is driven by the requirement for faster …

Characterizing ML training performance at the tactical edge

A Alshabanah, K Balasubramanian… - … Learning for Multi …, 2022 - spiedigitallibrary.org
The commercial industry has been working to develop ever-larger and more capable
machine learning (ML) models (such as recent models from OpenAI, Microsoft and Google …

Power, Performance and Reliability Evaluation of Multi-thread Machine Learning Inference Models Executing in Multicore Edge Devices

G Abich, AI da Silva, JE Thums… - 2023 IEEE Computer …, 2023 - ieeexplore.ieee.org
Incorporating Machine Learning (ML) inference models into edge computing devices has
presented some performance and reliability enhancement challenges. Multi-threaded ML …

Edge orchestration for latency-sensitive applications

A Rahmanian - 2024 - diva-portal.org
The emerging edge computing infrastructure provides distributed and heterogeneous
resources closer to where data is generated and where end-users are located, thereby …