Two sparsities are better than one: unlocking the performance benefits of sparse–sparse networks

K Hunter, L Spracklen, S Ahmad - Neuromorphic Computing and …, 2022 - iopscience.iop.org
In principle, sparse neural networks should be significantly more efficient than traditional
dense networks. Neurons in the brain exhibit two types of sparsity; they are sparsely …

Quantized sparse training: A unified trainable framework for joint pruning and quantization in DNNs

JH Park, KM Kim, S Lee - ACM Transactions on Embedded Computing …, 2022 - dl.acm.org
Deep neural networks typically have extensive parameters and computational operations.
Pruning and quantization techniques have been widely used to reduce the complexity of …

Weight update skipping: Reducing training time for artificial neural networks

P Safayenikoo, I Akturk - … on Emerging and Selected Topics in …, 2021 - ieeexplore.ieee.org
Artificial Neural Networks (ANNs) are known as state-of-the-art techniques in Machine
Learning (ML) and have achieved outstanding results in data-intensive applications, such as …

LRPRNet: Lightweight deep network by low-rank pointwise residual convolution

B Sun, J Li, M Shao, Y Fu - IEEE Transactions on Neural …, 2021 - ieeexplore.ieee.org
Deep learning has become popular in recent years primarily due to powerful computing
devices such as graphics processing units (GPUs). However, it is challenging to deploy …

Model-agnostic Meta-learning for resilience optimization of artificial intelligence system

VV Moskalenko - Radio Electronics, Computer Science, Control, 2023 - ric.zntu.edu.ua
Context. The problem of optimizing the resilience of artificial intelligence systems to
destructive disturbances has not yet been fully solved and is quite relevant for safety-critical …

[HTML][HTML] Model and Method for Providing Resilience to Resource-Constrained AI-System

V Moskalenko, V Kharchenko, S Semenov - Sensors, 2024 - mdpi.com
Artificial intelligence technologies are becoming increasingly prevalent in resource-
constrained, safety-critical embedded systems. Numerous methods exist to enhance the …

Class-Separation Preserving Pruning for Deep Neural Networks

I Preet, O Boydell, D John - IEEE Transactions on Artificial …, 2022 - ieeexplore.ieee.org
Neural network pruning has been deemed essential in the deployment of deep neural
networks on resource-constrained edge devices, greatly reducing the number of network …

Meta-Learning with Evolutionary Strategy for Resilience Optimization of Image Recognition System

V Moskalenko, A Korobov… - 2023 IEEE 12th …, 2023 - ieeexplore.ieee.org
The problem of optimizing the resilience of image recognition systems to destructive
disturbances has not yet been fully solved and is quite relevant for safety-critical …

Toward a Runtime Programmable Spiking Neural Network Hardware Accelerator with On-Chip Learning

NNN Thao - 2023 - search.proquest.com
Spiking neural network (SNN), due to its event-based nature, has gained popularity in the
recent years as an energy-efficient algorithm to service the applications that are restricted on …

Factorization Guided Lightweight Neural Networks for Visual Analysis

B Sun - 2022 - search.proquest.com
Deep learning has become popular in recent years primarily due to powerful computing
devices such as GPUs. However, many applications such as face alignment, image …