Retrieving multimodal information for augmented generation: A survey

R Zhao, H Chen, W Wang, F Jiao, XL Do, C Qin… - arXiv preprint arXiv …, 2023 - arxiv.org
As Large Language Models (LLMs) become popular, there emerged an important trend of
using multimodality to augment the LLMs' generation ability, which enables LLMs to better …

Infusing lattice symmetry priors in attention mechanisms for sample-efficient abstract geometric reasoning

M Atzeni, M Sachan, A Loukas - International Conference on …, 2023 - proceedings.mlr.press
Abstract The Abstraction and Reasoning Corpus (ARC)(Chollet, 2019) and its most recent
language-complete instantiation (LARC) has been postulated as an important step towards …

Learning symbolic rules over abstract meaning representations for textual reinforcement learning

S Chaudhury, S Swaminathan, D Kimura, P Sen… - arXiv preprint arXiv …, 2023 - arxiv.org
Text-based reinforcement learning agents have predominantly been neural network-based
models with embeddings-based representation, learning uninterpretable policies that often …

Case-based reasoning for better generalization in textual reinforcement learning

M Atzeni, S Dhuliawala, K Murugesan… - arXiv preprint arXiv …, 2021 - arxiv.org
Text-based games (TBG) have emerged as promising environments for driving research in
grounded language understanding and studying problems like generalization and sample …

EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning

K Basu, K Murugesan, S Chaudhury… - arXiv preprint arXiv …, 2024 - arxiv.org
Text-based games (TBGs) have emerged as an important collection of NLP tasks, requiring
reinforcement learning (RL) agents to combine natural language understanding with …

Polar Ducks and Where to Find Them: Enhancing Entity Linking with Duck Typing and Polar Box Embeddings

M Atzeni, M Plekhanov, FA Dreyer, N Kassner… - arXiv preprint arXiv …, 2023 - arxiv.org
Entity linking methods based on dense retrieval are an efficient and widely used solution in
large-scale applications, but they fall short of the performance of generative models, as they …

Textworldexpress: Simulating text games at one million steps per second

PA Jansen, MA Côté - arXiv preprint arXiv:2208.01174, 2022 - arxiv.org
Text-based games offer a challenging test bed to evaluate virtual agents at language
understanding, multi-step problem-solving, and common-sense reasoning. However, speed …

Complexworld: A large language model-based interactive fiction learning environment for text-based reinforcement learning agents

S Basavatia, S Ratnakar… - … Joint Conference on …, 2023 - openreview.net
Interactive fiction games have emerged as an important vehicle to improve the
generalization and compositional reasoning capabilities of language-based reinforcement …

PLM-based world models for text-based games

M Kim, Y Jung, D Lee, S Hwang - Proceedings of the 2022 …, 2022 - aclanthology.org
World models have improved the ability of reinforcement learning agents to operate in a
sample efficient manner, by being trained to predict plausible changes in the underlying …

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

M Atzeni - 2024 - infoscience.epfl.ch
The ability to reason, plan and solve highly abstract problems is a hallmark of human
intelligence. Recent advancements in artificial intelligence, propelled by deep neural …