Compacting deep neural networks for Internet of Things: Methods and applications

K Zhang, H Ying, HN Dai, L Li, Y Peng… - IEEE Internet of …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have shown great success in completing complex tasks.
However, DNNs inevitably bring high computational cost and storage consumption due to …

Cpt: Efficient deep neural network training via cyclic precision

Y Fu, H Guo, M Li, X Yang, Y Ding, V Chandra… - arXiv preprint arXiv …, 2021 - arxiv.org
Low-precision deep neural network (DNN) training has gained tremendous attention as
reducing precision is one of the most effective knobs for boosting DNNs' training time/energy …

An efficient and scalable collection of fly-inspired voting units for visual place recognition in changing environments

B Arcanjo, B Ferrarini, M Milford… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
State-of-the-art visual place recognition performance is currently being achieved utilizing
deep learning based approaches. Despite the recent efforts in designing lightweight …

Better schedules for low precision training of deep neural networks

CR Wolfe, A Kyrillidis - Machine Learning, 2024 - Springer
Low precision training can significantly reduce the computational overhead of training deep
neural networks (DNNs). Though many such techniques exist, cyclic precision training …

Contrastive quant: quantization makes stronger contrastive learning

Y Fu, Q Yu, M Li, X Ouyang, V Chandra… - Proceedings of the 59th …, 2022 - dl.acm.org
Contrastive learning learns visual representations by enforcing feature consistency under
different augmented views. In this work, we explore contrastive learning from a new …

Position-aware lightweight object detectors with depthwise separable convolutions

L Chang, S Zhang, H Du, Z You, S Wang - Journal of Real-Time Image …, 2021 - Springer
Recently, significant improvements have been achieved for object detection algorithm by
increasing the size of convolutional neural network (CNN) models, but the resulting increase …

Exploring the Creation and Humanization of Digital Life: Consciousness Simulation and Human-Machine Interaction

Q Zhang - arXiv preprint arXiv:2310.13710, 2023 - arxiv.org
Digital life, a form of life generated by computer programs or artificial intelligence systems, it
possesses self-awareness, thinking abilities, emotions, and subjective consciousness …

[PDF][PDF] Theories and Perspectives on Practical Deep Learning

CR WOLFE - 2023 - repository.rice.edu
Since not all data can be represented in Euclidean space [26], many applications rely on
graph-structured data. For example, social networks can be modeled as graphs by …

Mixed precision training of an artificial neural network

H Zhu, NA Taesik, D Lo, ES Chung - US Patent App. 16/357,139, 2020 - Google Patents
The use of mixed precision values when training an artificial neural network (ANN) can
increase performance while reducing cost. Certain portions and/or steps of an ANN may be …

Feature map alignment: Towards efficient design of mixed-precision quantization scheme

Y Bao, Y Xu, H Xiong - 2019 IEEE Visual Communications and …, 2019 - ieeexplore.ieee.org
Quantization is known as an effective compression method for deploying neural networks on
mobile devices. However, most existing works train from scratch a quantized network with …