Probing classifiers: Promises, shortcomings, and advances

Y Belinkov - Computational Linguistics, 2022 - direct.mit.edu
Probing classifiers have emerged as one of the prominent methodologies for interpreting
and analyzing deep neural network models of natural language processing. The basic idea …

Convolutional neural networks as a model of the visual system: Past, present, and future

GW Lindsay - Journal of cognitive neuroscience, 2021 - direct.mit.edu
Convolutional neural networks (CNNs) were inspired by early findings in the study of
biological vision. They have since become successful tools in computer vision and state-of …

A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence

EJ Allen, G St-Yves, Y Wu, JL Breedlove… - Nature …, 2022 - nature.com
Extensive sampling of neural activity during rich cognitive phenomena is critical for robust
understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in …

Do vision transformers see like convolutional neural networks?

M Raghu, T Unterthiner, S Kornblith… - Advances in neural …, 2021 - proceedings.neurips.cc
Convolutional neural networks (CNNs) have so far been the de-facto model for visual data.
Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or …

Brains and algorithms partially converge in natural language processing

C Caucheteux, JR King - Communications biology, 2022 - nature.com
Deep learning algorithms trained to predict masked words from large amount of text have
recently been shown to generate activations similar to those of the human brain. However …

Multi-task learning with deep neural networks: A survey

M Crawshaw - arXiv preprint arXiv:2009.09796, 2020 - arxiv.org
Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are
simultaneously learned by a shared model. Such approaches offer advantages like …

Similarity of neural network representations revisited

S Kornblith, M Norouzi, H Lee… - … conference on machine …, 2019 - proceedings.mlr.press
Recent work has sought to understand the behavior of neural networks by comparing
representations between layers and between different trained models. We examine methods …

The neuroconnectionist research programme

A Doerig, RP Sommers, K Seeliger… - Nature Reviews …, 2023 - nature.com
Artificial neural networks (ANNs) inspired by biology are beginning to be widely used to
model behavioural and neural data, an approach we call 'neuroconnectionism'. ANNs have …

Deep problems with neural network models of human vision

JS Bowers, G Malhotra, M Dujmović… - Behavioral and Brain …, 2023 - cambridge.org
Deep neural networks (DNNs) have had extraordinary successes in classifying
photographic images of objects and are often described as the best models of biological …

If deep learning is the answer, what is the question?

A Saxe, S Nelli, C Summerfield - Nature Reviews Neuroscience, 2021 - nature.com
Neuroscience research is undergoing a minor revolution. Recent advances in machine
learning and artificial intelligence research have opened up new ways of thinking about …