A unifying review of deep and shallow anomaly detection

L Ruff, JR Kauffmann, RA Vandermeulen… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Deep learning approaches to anomaly detection (AD) have recently improved the state of
the art in detection performance on complex data sets, such as large collections of images or …

Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community

JE Ball, DT Anderson, CS Chan - Journal of applied remote …, 2017 - spiedigitallibrary.org
In recent years, deep learning (DL), a rebranding of neural networks (NNs), has risen to the
top in numerous areas, namely computer vision (CV), speech recognition, and natural …

Exploring single-cell data with deep multitasking neural networks

M Amodio, D Van Dijk, K Srinivasan, WS Chen… - Nature …, 2019 - nature.com
It is currently challenging to analyze single-cell data consisting of many cells and samples,
and to address variations arising from batch effects and different sample preparations. For …

Deep learning in electron microscopy

JM Ede - Machine Learning: Science and Technology, 2021 - iopscience.iop.org
Deep learning is transforming most areas of science and technology, including electron
microscopy. This review paper offers a practical perspective aimed at developers with …

From neural re-ranking to neural ranking: Learning a sparse representation for inverted indexing

H Zamani, M Dehghani, WB Croft… - Proceedings of the 27th …, 2018 - dl.acm.org
The availability of massive data and computing power allowing for effective data driven
neural approaches is having a major impact on machine learning and information retrieval …

Unsupervised anomaly detection in energy time series data using variational recurrent autoencoders with attention

J Pereira, M Silveira - 2018 17th IEEE international conference …, 2018 - ieeexplore.ieee.org
In the age of big data, time series are being generated in massive amounts. In the energy
field, smart grids are enabling a unprecedented data acquisition with the integration of …

Understanding autoencoders with information theoretic concepts

S Yu, JC Principe - Neural Networks, 2019 - Elsevier
Despite their great success in practical applications, there is still a lack of theoretical and
systematic methods to analyze deep neural networks. In this paper, we illustrate an …

Convergence guarantees for RMSProp and ADAM in non-convex optimization and an empirical comparison to Nesterov acceleration

S De, A Mukherjee, E Ullah - arXiv preprint arXiv:1807.06766, 2018 - arxiv.org
RMSProp and ADAM continue to be extremely popular algorithms for training neural nets
but their theoretical convergence properties have remained unclear. Further, recent work …

Large-margin contrastive learning with distance polarization regularizer

S Chen, G Niu, C Gong, J Li, J Yang… - International …, 2021 - proceedings.mlr.press
Abstract\emph {Contrastive learning}(CL) pretrains models in a pairwise manner, where
given a data point, other data points are all regarded as dissimilar, including some that …

Learning representations from healthcare time series data for unsupervised anomaly detection

J Pereira, M Silveira - … international conference on big data and …, 2019 - ieeexplore.ieee.org
The amount of time series data generated in Healthcare is growing very fast and so is the
need for methods that can analyse these data, detect anomalies and provide meaningful …