Binary neural networks: A survey

H Qin, R Gong, X Liu, X Bai, J Song, N Sebe - Pattern Recognition, 2020 - Elsevier
The binary neural network, largely saving the storage and computation, serves as a
promising technique for deploying deep models on resource-limited devices. However, the …

Distribution-sensitive information retention for accurate binary neural network

H Qin, X Zhang, R Gong, Y Ding, Y Xu, X Liu - International Journal of …, 2023 - Springer
Abstract Model binarization is an effective method of compressing neural networks and
accelerating their inference process, which enables state-of-the-art models to run on …

Adabin: Improving binary neural networks with adaptive binary sets

Z Tu, X Chen, P Ren, Y Wang - European conference on computer vision, 2022 - Springer
This paper studies the Binary Neural Networks (BNNs) in which weights and activations are
both binarized into 1-bit values, thus greatly reducing the memory usage and computational …

High-capacity expert binary networks

A Bulat, B Martinez, G Tzimiropoulos - arXiv preprint arXiv:2010.03558, 2020 - arxiv.org
Network binarization is a promising hardware-aware direction for creating efficient deep
models. Despite its memory and computational advantages, reducing the accuracy gap …

Back to simplicity: How to train accurate bnns from scratch?

J Bethge, H Yang, M Bornstein, C Meinel - arXiv preprint arXiv:1906.08637, 2019 - arxiv.org
Binary Neural Networks (BNNs) show promising progress in reducing computational and
memory costs but suffer from substantial accuracy degradation compared to their real …

Larq compute engine: Design, benchmark and deploy state-of-the-art binarized neural networks

T Bannink, A Hillier, L Geiger… - Proceedings of …, 2021 - proceedings.mlsys.org
Abstract We introduce Larq Compute Engine (LCE), a state-of-the-art Binarized Neural
Network (BNN) inference engine, and use this framework to investigate several important …

BinaryDenseNet: Developing an architecture for binary neural networks

J Bethge, H Yang, M Bornstein… - Proceedings of the …, 2019 - openaccess.thecvf.com
Abstract Binary Neural Networks (BNNs) show promising progress in reducing
computational and memory costs, but suffer from substantial accuracy degradation …

Training binary neural networks through learning with noisy supervision

K Han, Y Wang, Y Xu, C Xu, E Wu… - … conference on machine …, 2020 - proceedings.mlr.press
This paper formalizes the binarization operations over neural networks from a learning
perspective. In contrast to classical hand crafted rules (\eg hard thresholding) to binarize full …

Recu: Reviving the dead weights in binary neural networks

Z Xu, M Lin, J Liu, J Chen, L Shao… - Proceedings of the …, 2021 - openaccess.thecvf.com
Binary neural networks (BNNs) have received increasing attention due to their superior
reductions of computation and memory. Most existing works focus on either lessening the …

Improving accuracy of binary neural networks using unbalanced activation distribution

H Kim, J Park, C Lee, JJ Kim - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Binarization of neural network models is considered as one of the promising methods to
deploy deep neural network models on resource-constrained environments such as mobile …