[HTML][HTML] Embracing change: Continual learning in deep neural networks

R Hadsell, D Rao, AA Rusu, R Pascanu - Trends in cognitive sciences, 2020 - cell.com
Artificial intelligence research has seen enormous progress over the past few decades, but it
predominantly relies on fixed datasets and stationary environments. Continual learning is an …

Inductive biases for deep learning of higher-level cognition

A Goyal, Y Bengio - Proceedings of the Royal Society A, 2022 - royalsocietypublishing.org
A fascinating hypothesis is that human and animal intelligence could be explained by a few
principles (rather than an encyclopaedic list of heuristics). If that hypothesis was correct, we …

[HTML][HTML] Graph neural networks: A review of methods and applications

J Zhou, G Cui, S Hu, Z Zhang, C Yang, Z Liu, L Wang… - AI open, 2020 - Elsevier
Lots of learning tasks require dealing with graph data which contains rich relation
information among elements. Modeling physics systems, learning molecular fingerprints …

Deformable convnets v2: More deformable, better results

X Zhu, H Hu, S Lin, J Dai - … of the IEEE/CVF conference on …, 2019 - openaccess.thecvf.com
The superior performance of Deformable Convolutional Networks arises from its ability to
adapt to the geometric variations of objects. Through an examination of its adaptive …

Weisfeiler and leman go machine learning: The story so far

C Morris, Y Lipman, H Maron, B Rieck… - The Journal of Machine …, 2023 - dl.acm.org
In recent years, algorithms and neural architectures based on the Weisfeiler-Leman
algorithm, a well-known heuristic for the graph isomorphism problem, have emerged as a …

A survey of the usages of deep learning for natural language processing

DW Otter, JR Medina, JK Kalita - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Over the last several years, the field of natural language processing has been propelled
forward by an explosion in the use of deep learning models. This article provides a brief …

Relation networks for object detection

H Hu, J Gu, Z Zhang, J Dai… - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
Although it is well believed for years that modeling relations between objects would help
object recognition, there has not been evidence that the idea is working in the deep learning …

Graph networks as learnable physics engines for inference and control

A Sanchez-Gonzalez, N Heess… - International …, 2018 - proceedings.mlr.press
Understanding and interacting with everyday physical scenes requires rich knowledge
about the structure of the world, represented either implicitly in a value or policy function, or …

A simple neural network module for relational reasoning

A Santoro, D Raposo, DG Barrett… - Advances in neural …, 2017 - proceedings.neurips.cc
Relational reasoning is a central component of generally intelligent behavior, but has
proven difficult for neural networks to learn. In this paper we describe how to use Relation …

Discovering physical concepts with neural networks

R Iten, T Metger, H Wilming, L Del Rio, R Renner - Physical review letters, 2020 - APS
Despite the success of neural networks at solving concrete physics problems, their use as a
general-purpose tool for scientific discovery is still in its infancy. Here, we approach this …