Vidur: A Large-Scale Simulation Framework For LLM Inference A Agrawal, N Kedia, J Mohan, A Panwar, N Kwatra, B Gulavani, ... Proceedings of Machine Learning and Systems 6, 351-366, 2024 | 7 | 2024 |
Metron: Holistic performance evaluation framework for llm inference systems A Agrawal, A Agarwal, N Kedia, J Mohan, S Kundu, N Kwatra, R Ramjee, ... arXiv preprint arXiv:2407.07000, 2024 | 3 | 2024 |