Towards understanding how transformer perform multi-step reasoning with matching operation

Z Wang, Y Wang, Z Zhang, Z Zhou, H Jin, T Hu… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models have consistently struggled with complex reasoning tasks, such as
mathematical problem-solving. Investigating the internal reasoning mechanisms of these …

Quantifying artificial intelligence through algebraic generalization

T Ito, M Campbell, L Horesh, T Klinger… - arXiv preprint arXiv …, 2024 - arxiv.org
The rapid development of modern artificial intelligence (AI) systems has created an urgent
need for their scientific quantification. While their fluency across a variety of domains is …