Introduction to mathematical language processing: Informal proofs, word problems, and supporting tasks

J Meadows, A Freitas - Transactions of the Association for …, 2023 - direct.mit.edu
Automating discovery in mathematics and science will require sophisticated methods of
information extraction and abstract reasoning, including models that can convincingly …

Generating mathematical derivations with large language models

J Meadows, M Valentino, A Freitas - arXiv preprint arXiv:2307.09998, 2023 - arxiv.org
The derivation of mathematical results in specialised fields using Large Language Models
(LLMs) is an emerging research direction that can help identify models' limitations, and …

Multi-operational mathematical derivations in latent space

M Valentino, J Meadows, L Zhang, A Freitas - arXiv preprint arXiv …, 2023 - arxiv.org
This paper investigates the possibility of approximating multiple mathematical operations in
latent space for expression derivation. To this end, we introduce different multi-operational …

A symbolic framework for systematic evaluation of mathematical reasoning with transformers

J Meadows, M Valentino, D Teney, A Freitas - 2023 - research.manchester.ac.uk
Whether Transformers can learn to apply symbolic rules and generalise to out-of-distribution
examples is an open research question. In this paper, we devise a data generation method …

Ijs at textgraphs-16 natural language premise selection task: Will contextual information improve natural language premise selection?

THH Tran, M Martinc, A Doucet… - … of TextGraphs-16: Graph …, 2022 - aclanthology.org
Abstract Natural Language Premise Selection (NLPS) is a mathematical Natural Language
Processing (NLP) task that retrieves a set of applicable relevant premises to support the end …

Textgraphs-16 natural language premise selection task: Zero-shot premise selection with prompting generative language models

L Kovriguina, R Teucher… - Proceedings of TextGraphs …, 2022 - aclanthology.org
Automated theorem proving can benefit a lot from methods employed in natural language
processing, knowledge graphs and information retrieval: this non-trivial task combines …

Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions

J Meadows, T James, A Freitas - arXiv preprint arXiv:2404.18384, 2024 - arxiv.org
Language models can hallucinate when performing complex and detailed mathematical
reasoning. Physics provides a rich domain for assessing mathematical reasoning …

Transforming Text Into Knowledge with Graphs: Report of the GDR MADICS DOING Action

M Halfeld-Ferrari, AL Minard… - European Conference on …, 2024 - Springer
This paper provides an overview on graph databases for the retrieval and the integration of
knowledge originating from textual data, attempting to bring together different bricks that are …

A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers

J Meadows, M Valentino, D Teney, A Freitas - arXiv preprint arXiv …, 2023 - arxiv.org
This paper proposes a methodology for generating and perturbing detailed derivations of
equations at scale, aided by a symbolic engine, to evaluate the generalisability of …

Transforming Text into Knowledge with Graphs: report of the GDR MADICS DOING Action

MH Ferrari, G Vargas-Solar, AL Minard - 3rd International Workshop on …, 2024 - hal.science
This paper provides an overview on graph databases for the retrieval and the integration of
knowledge originating from textual data, attempting to bring together different bricks that are …