A survey on knowledge distillation of large language models

X Xu, M Li, C Tao, T Shen, R Cheng, J Li, C Xu… - arXiv preprint arXiv …, 2024 - arxiv.org
This survey presents an in-depth exploration of knowledge distillation (KD) techniques
within the realm of Large Language Models (LLMs), spotlighting the pivotal role of KD in …
被引用次数：116 相关文章

A Survey on Knowledge Distillation of Large Language Models

X Xu, M Li, C Tao, T Shen, R Cheng, J Li, C Xu… - arXiv e …, 2024 - ui.adsabs.harvard.edu
This survey presents an in-depth exploration of knowledge distillation (KD) techniques
within the realm of Large Language Models (LLMs), spotlighting the pivotal role of KD in …