[HTML][HTML] Automatically Correcting Large Language Models: Surveying the Landscape of Diverse Automated Correction Strategies

L Pan, M Saxon, W Xu, D Nathani, X Wang… - Transactions of the …, 2024 - direct.mit.edu
While large language models (LLMs) have shown remarkable effectiveness in various NLP
tasks, they are still prone to issues such as hallucination, unfaithful reasoning, and toxicity. A …

Automatically correcting large language models: Surveying the landscape of diverse self-correction strategies

L Pan, M Saxon, W Xu, D Nathani, X Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) have demonstrated remarkable performance across a wide
array of NLP tasks. However, their efficacy is undermined by undesired and inconsistent …

MAF: Multi-aspect feedback for improving reasoning in large language models

D Nathani, D Wang, L Pan, WY Wang - arXiv preprint arXiv:2310.12426, 2023 - arxiv.org
Language Models (LMs) have shown impressive performance in various natural language
tasks. However, when it comes to natural language reasoning, LMs still face challenges …

Large language models cannot self-correct reasoning yet

J Huang, X Chen, S Mishra, HS Zheng, AW Yu… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have emerged as a groundbreaking technology with their
unparalleled text generation capabilities across various applications. Nevertheless …

Editing large language models: Problems, methods, and opportunities

Y Yao, P Wang, B Tian, S Cheng, Z Li, S Deng… - arXiv preprint arXiv …, 2023 - arxiv.org
Despite the ability to train capable LLMs, the methodology for maintaining their relevancy
and rectifying errors remains elusive. To this end, the past few years have witnessed a surge …

Model editing can hurt general abilities of large language models

JC Gu, HX Xu, JY Ma, P Lu, ZH Ling, KW Chang… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent advances in large language models (LLMs) have opened up new paradigms for
accessing the knowledge stored in their parameters. One critical challenge that has …

Critic: Large language models can self-correct with tool-interactive critiquing

Z Gou, Z Shao, Y Gong, Y Shen, Y Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent developments in large language models (LLMs) have been impressive. However,
these models sometimes show inconsistencies and problematic behavior, such as …

Reflection-tuning: Data recycling improves llm instruction-tuning

M Li, L Chen, J Chen, S He, H Huang, J Gu… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent advancements in Large Language Models (LLMs) have expanded the horizons of
natural language understanding and generation. Notably, the output control and alignment …

Hallucination detection and hallucination mitigation: An investigation

J Luo, T Li, D Wu, M Jenkin, S Liu, G Dudek - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved
remarkable successes over the last two years in a range of different applications. In spite of …

Language model based grammatical error correction without annotated training data

C Bryant, T Briscoe - Proceedings of the thirteenth workshop on …, 2018 - aclanthology.org
Since the end of the CoNLL-2014 shared task on grammatical error correction (GEC),
research into language model (LM) based approaches to GEC has largely stagnated. In this …