How much position information do convolutional neural networks encode?

MA Islam, S Jia, NDB Bruce - arXiv preprint arXiv:2001.08248, 2020 - arxiv.org
… It is our hypothesis that deep neural networks succeed in part by learning both what and
where things are. This paper tests this hypothesis, and provides convincing evidence that CNNs …

Learning not to learn: Training deep neural networks with biased data

B Kim, H Kim, K Kim, S Kim… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
… simple prior information: Do … information, to train deep neural networks, which prevents
learning of a given bias. In other words, we regulate a network to minimize the mutual information

Understanding the role of individual units in a deep neural network

D Bau, JY Zhu, H Strobelt… - Proceedings of the …, 2020 - National Acad Sciences
… We first identify individual units that emerge as object detectors when training a network
on a scene classification task. The network we analyze is a convolutional neural network (CNN) …

An improved deep convolutional neural network with multi-scale information for bearing fault diagnosis

W Huang, J Cheng, Y Yang, G Guo - Neurocomputing, 2019 - Elsevier
… provide more useful information. Thus, in this paper, an improved CNN named multi-scale
cascade convolutional neural network (MC-CNN) is proposed for the classification information

Training behavior of deep neural network in frequency domain

ZQJ Xu, Y Zhang, Y Xiao - Neural Information Processing: 26th …, 2019 - Springer
… Why deep neural networks (DNNs) capable of overfitting often generalize well in practice
is a mystery [24]. To find a potential mechanism, we focus on the study of implicit biases …

Multi-task learning with deep neural networks: A survey

M Crawshaw - arXiv preprint arXiv:2009.09796, 2020 - arxiv.org
… It’s no wonder that neural networks require such numerous training examples and … division
of information between tasks is a fine line to walk: we want to allow information flow between …

Deep neural network concepts for background subtraction: A systematic review and comparative evaluation

T Bouwmans, S Javed, M Sultana, SK Jung - Neural Networks, 2019 - Elsevier
… the first review of deep neural network concepts in background … deep neural networks
concepts, and also deep learned features. We then discuss the adequacy of deep neural networks

Pooling methods in deep neural networks, a review

H Gholamalinezhad, H Khosravi - arXiv preprint arXiv:2009.07485, 2020 - arxiv.org
… expected to extract only useful information and discard irrelevant details. There are a lot of
methods for the implementation of pooling operation in Deep Neural Networks. In this paper, …

[HTML][HTML] The marabou framework for verification and analysis of deep neural networks

G Katz, DA Huang, D Ibeling, K Julian… - … Aided Verification: 31st …, 2019 - Springer
… Consequently, there is a pressing need for tools and techniques for network analysis and …
deep neural networks. Marabou is an SMT-based tool that can answer queries about a network

Evolving deep neural networks

R Miikkulainen, J Liang, E Meyerson, A Rawal… - … age of neural networks …, 2024 - Elsevier
… of a deep network and LSTM network were modified through … and hyperparameters of
convolutional neural networks, and … cells that can integrate information over longer time scales (…