Longwriter: Unleashing 10,000+ word generation from long context llms

Y Bai, J Zhang, X Lv, L Zheng, S Zhu, L Hou… - arXiv preprint arXiv …, 2024 - arxiv.org
Current long context large language models (LLMs) can process inputs up to 100,000
tokens, yet struggle to generate outputs exceeding even a modest length of 2,000 words …

HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models

H Que, F Duan, L He, Y Mou, W Zhou, J Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities
in various tasks (eg, long-context understanding), and many benchmarks have been …