A mechanistic interpretation of syllogistic reasoning in auto-regressive language models
Recent studies on logical reasoning in auto-regressive Language Models (LMs) have
sparked a debate on whether such models can learn systematic reasoning principles during …
sparked a debate on whether such models can learn systematic reasoning principles during …
A systematic comparison of syllogistic reasoning in humans and language models
A central component of rational behavior is logical inference: the process of determining
which conclusions follow from a set of premises. Psychologists have documented several …
which conclusions follow from a set of premises. Psychologists have documented several …
Exploring reasoning biases in large language models through syllogism: insights from the NeuBAROCO dataset
K Ozeki, R Ando, T Morishita, H Abe… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper explores the question of how accurately current large language models can
perform logical reasoning in natural language, with an emphasis on whether these models …
perform logical reasoning in natural language, with an emphasis on whether these models …
Categorical Syllogisms Revisited: A Review of the Logical Reasoning Abilities of LLMs for Analyzing Categorical Syllogism
S Zong, J Lin - arXiv preprint arXiv:2406.18762, 2024 - arxiv.org
There have been a huge number of benchmarks proposed to evaluate how large language
models (LLMs) behave for logic inference tasks. However, it remains an open question how …
models (LLMs) behave for logic inference tasks. However, it remains an open question how …
Socratic Reasoning Improves Positive Text Rewriting
Reframing a negative into a positive thought is at the crux of several cognitive approaches to
mental health and psychotherapy that could be made more accessible by large language …
mental health and psychotherapy that could be made more accessible by large language …
QUENCH: Measuring the gap between Indic and Non-Indic Contextual General Reasoning in LLMs
The rise of large language models (LLMs) has created a need for advanced benchmarking
systems beyond traditional setups. To this end, we introduce QUENCH, a novel text-based …
systems beyond traditional setups. To this end, we introduce QUENCH, a novel text-based …
SR-FoT: A Syllogistic-Reasoning Framework of Thought for Large Language Models Tackling Knowledge-based Reasoning Tasks
Deductive reasoning is a crucial logical capability that assists us in solving complex
problems based on existing knowledge. Although augmented by Chain-of-Thought prompts …
problems based on existing knowledge. Although augmented by Chain-of-Thought prompts …
SylloBio-NLI: Evaluating Large Language Models on Biomedical Syllogistic Reasoning
Syllogistic reasoning is crucial for Natural Language Inference (NLI). This capability is
particularly significant in specialized domains such as biomedicine, where it can support …
particularly significant in specialized domains such as biomedicine, where it can support …