Predicting brain activity using Transformers

H Adeli, S Minni, N Kriegeskorte - bioRxiv, 2023 - biorxiv.org
The Algonauts challenge (Gifford et al.[2023]) called on the community to provide novel
solutions for predicting brain activity of humans viewing natural scenes. This report provides …

Visual Reasoning in Object-Centric Deep Neural Networks: A Comparative Cognition Approach

G Puebla, JS Bowers - arXiv preprint arXiv:2402.12675, 2024 - arxiv.org
Achieving visual reasoning is a long-term goal of artificial intelligence. In the last decade,
several studies have applied deep neural networks (DNNs) to the task of learning visual …

Dissecting Query-Key Interaction in Vision Transformers

X Pan, A Philip, Z Xie, O Schwartz - arXiv preprint arXiv:2405.14880, 2024 - arxiv.org
Self-attention in vision transformers has been thought to perform perceptual grouping where
tokens attend to other tokens with similar embeddings, which could correspond to …