Overview frequency principle/spectral bias in deep learning

ZQJ Xu, Y Zhang, T Luo - Communications on Applied Mathematics and …, 2024 - Springer
Understanding deep learning is increasingly emergent as it penetrates more and more into
industry and science. In recent years, a research line from Fourier analysis sheds light on …

Illuminating diverse neural cellular automata for level generation

S Earle, J Snider, MC Fontaine, S Nikolaidis… - Proceedings of the …, 2022 - dl.acm.org
We present a method of generating diverse collections of neural cellular automata (NCA) to
design video game levels. While NCAs have so far only been trained via supervised …

Convolutional neural network for monkeypox detection

V Alcalá-Rmz, KE Villagrana-Bañuelos… - … on ubiquitous computing …, 2022 - Springer
Abstract Machine learning has been implemented in medical applications, especially in
classification models to support diagnosis. In dermatology, it is of great relevance, due to the …

It's hard for neural networks to learn the game of life

JM Springer, GT Kenyon - 2021 International Joint Conference …, 2021 - ieeexplore.ieee.org
Efforts to improve the learning abilities of neural networks have focused mostly on the role of
optimization methods rather than on weight initializations. Recent findings, however …

Deep artificial neural networks for the diagnostic of caries using socioeconomic and nutritional features as determinants: data from NHANES 2013–2014

LA Zanella-Calzada, CE Galván-Tejada… - Bioengineering, 2018 - mdpi.com
Oral health represents an essential component in the quality of life of people, being a
determinant factor in general health since it may affect the risk of suffering other conditions …

Reverse engineering the neural tangent kernel

JB Simon, S Anand… - … Conference on Machine …, 2022 - proceedings.mlr.press
The development of methods to guide the design of neural networks is an important open
challenge for deep learning theory. As a paradigm for principled neural architecture design …

Do deep neural networks have an inbuilt Occam's razor?

C Mingard, H Rees, G Valle-Pérez, AA Louis - arXiv preprint arXiv …, 2023 - arxiv.org
The remarkable performance of overparameterized deep neural networks (DNNs) must
arise from an interplay between network architecture, training algorithms, and structure in …

Automatic driver identification from in-vehicle network logs

M Remeli, S Lestyán, G Acs… - 2019 IEEE Intelligent …, 2019 - ieeexplore.ieee.org
Data generated by cars is growing at an unprecedented scale. As cars gradually become
part of the Internet of Things (IoT) ecosystem, several stakeholders discover the value of in …

“Texting & Driving” detection using deep convolutional neural networks

JM Celaya-Padilla, CE Galván-Tejada… - Applied Sciences, 2019 - mdpi.com
The effects of distracted driving are one of the main causes of deaths and injuries on US
roads. According to the National Highway Traffic Safety Administration (NHTSA), among the …

Neural anisotropy directions

G Ortiz-Jiménez, A Modas… - Advances in Neural …, 2020 - proceedings.neurips.cc
In this work, we analyze the role of the network architecture in shaping the inductive bias of
deep classifiers. To that end, we start by focusing on a very simple problem, ie, classifying a …