A review of binarized neural networks

T Simons, DJ Lee - Electronics, 2019 - mdpi.com
In this work, we review Binarized Neural Networks (BNNs). BNNs are deep neural networks
that use binary values for activations and weights, instead of full precision values. With …

Binary neural networks: A survey

H Qin, R Gong, X Liu, X Bai, J Song, N Sebe - Pattern Recognition, 2020 - Elsevier
The binary neural network, largely saving the storage and computation, serves as a
promising technique for deploying deep models on resource-limited devices. However, the …

Forward and backward information retention for accurate binary neural networks

H Qin, R Gong, X Liu, M Shen, Z Wei… - Proceedings of the …, 2020 - openaccess.thecvf.com
Weight and activation binarization is an effective approach to deep neural network
compression and can accelerate the inference by leveraging bitwise operations. Although …

Rotated binary neural network

M Lin, R Ji, Z Xu, B Zhang, Y Wang… - Advances in neural …, 2020 - proceedings.neurips.cc
Abstract Binary Neural Network (BNN) shows its predominance in reducing the complexity of
deep neural networks. However, it suffers severe performance degradation. One of the …

Estimator meets equilibrium perspective: A rectified straight through estimator for binary neural networks training

XM Wu, D Zheng, Z Liu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Binarization of neural networks is a dominant paradigm in neural networks compression.
The pioneering work BinaryConnect uses Straight Through Estimator (STE) to mimic the …

Effective and efficient computation with multiple-timescale spiking recurrent neural networks

B Yin, F Corradi, SM Bohté - International Conference on Neuromorphic …, 2020 - dl.acm.org
The emergence of brain-inspired neuromorphic computing as a paradigm for edge AI is
motivating the search for high-performance and efficient spiking neural networks to run on …

Learning frequency domain approximation for binary neural networks

Y Xu, K Han, C Xu, Y Tang, C Xu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Binary neural networks (BNNs) represent original full-precision weights and activations into
1-bit with sign function. Since the gradient of the conventional sign function is almost zero …

Distribution-sensitive information retention for accurate binary neural network

H Qin, X Zhang, R Gong, Y Ding, Y Xu, X Liu - International Journal of …, 2023 - Springer
Abstract Model binarization is an effective method of compressing neural networks and
accelerating their inference process, which enables state-of-the-art models to run on …

Lipschitz continuity retained binary neural network

Y Shang, D Xu, B Duan, Z Zong, L Nie… - European conference on …, 2022 - Springer
Relying on the premise that the performance of a binary neural network can be largely
restored with eliminated quantization error between full-precision weight vectors and their …

Improving accuracy of binary neural networks using unbalanced activation distribution

H Kim, J Park, C Lee, JJ Kim - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Binarization of neural network models is considered as one of the promising methods to
deploy deep neural network models on resource-constrained environments such as mobile …