Towards efficient generative large language model serving: A survey from algorithms to systems

X Miao, G Oliaro, Z Zhang, X Cheng, H Jin… - arXiv preprint arXiv …, 2023 - arxiv.org
In the rapidly evolving landscape of artificial intelligence (AI), generative large language
models (LLMs) stand at the forefront, revolutionizing how we interact with our data. However …

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems

X Miao, G Oliaro, Z Zhang, X Cheng, H Jin… - arXiv e …, 2023 - ui.adsabs.harvard.edu
In the rapidly evolving landscape of artificial intelligence (AI), generative large language
models (LLMs) stand at the forefront, revolutionizing how we interact with our data. However …