Exploring Quantization Techniques for Large-Scale Language Models: Methods, Challenges and Future Directions

A Shen, Z Lai, D Li - Proceedings of the 2024 9th International …, 2024 - dl.acm.org
Breakthroughs in natural language processing (NLP) by large-scale language models
(LLMs) have led to superior performance in multilingual tasks such as translation …