On the binding problem in artificial neural networks

K Greff, S Van Steenkiste, J Schmidhuber - arXiv preprint arXiv …, 2020 - arxiv.org
Contemporary neural networks still fall short of human-level generalization, which extends
far beyond our direct experiences. In this paper, we argue that the underlying cause for this …

[HTML][HTML] Reconciling deep learning with symbolic artificial intelligence: representing objects and relations

M Garnelo, M Shanahan - Current Opinion in Behavioral Sciences, 2019 - Elsevier
In the history of the quest for human-level artificial intelligence, a number of rival paradigms
have vied for supremacy. Symbolic artificial intelligence was dominant for much of the 20th …

Emergent symbols through binding in external memory

TW Webb, I Sinha, JD Cohen - arXiv preprint arXiv:2012.14601, 2020 - arxiv.org
A key aspect of human intelligence is the ability to infer abstract rules directly from high-
dimensional sensory data, and to do so given only a limited amount of training experience …

Improving compositional generalization using iterated learning and simplicial embeddings

Y Ren, S Lavoie, M Galkin… - Advances in …, 2024 - proceedings.neurips.cc
Compositional generalization, the ability of an agent to generalize to unseen combinations
of latent factors, is easy for humans but hard for deep neural networks. A line of research in …

Neural-symbolic integration: A compositional perspective

E Tsamoura, T Hospedales, L Michael - Proceedings of the AAAI …, 2021 - ojs.aaai.org
Despite significant progress in the development of neural-symbolic frameworks, the question
of how to integrate a neural and a symbolic system in a compositional manner remains …

Scan: Learning hierarchical compositional visual concepts

I Higgins, N Sonnerat, L Matthey, A Pal… - arXiv preprint arXiv …, 2017 - arxiv.org
The seemingly infinite diversity of the natural world arises from a relatively small set of
coherent rules, such as the laws of physics or chemistry. We conjecture that these rules give …

Neural collaborative reasoning

H Chen, S Shi, Y Li, Y Zhang - Proceedings of the Web Conference 2021, 2021 - dl.acm.org
Existing Collaborative Filtering (CF) methods are mostly designed based on the idea of
matching, ie, by learning user and item embeddings from data using shallow or deep …

Compositional generalization from first principles

T Wiedemer, P Mayilvahanan… - Advances in Neural …, 2024 - proceedings.neurips.cc
Leveraging the compositional nature of our world to expedite learning and facilitate
generalization is a hallmark of human perception. In machine learning, on the other hand …

The relational bottleneck as an inductive bias for efficient abstraction

TW Webb, SM Frankland, A Altabaa, S Segert… - Trends in Cognitive …, 2024 - cell.com
A central challenge for cognitive science is to explain how abstract concepts are acquired
from limited experience. This has often been framed in terms of a dichotomy between …

Neural-symbolic computing: An effective methodology for principled integration of machine learning and reasoning

AA Garcez, M Gori, LC Lamb, L Serafini… - arXiv preprint arXiv …, 2019 - arxiv.org
Current advances in Artificial Intelligence and machine learning in general, and deep
learning in particular have reached unprecedented impact not only across research …