Survey on knowledge distillation for large language models: methods, evaluation, and application

C Yang, Y Zhu, W Lu, Y Wang, Q Chen, C Gao… - ACM Transactions on … - dl.acm.org
Large Language Models (LLMs) have showcased exceptional capabilities in various
domains, attracting significant interest from both academia and industry. Despite their …

Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application

C Yang, W Lu, Y Zhu, Y Wang, Q Chen, C Gao… - arXiv e …, 2024 - ui.adsabs.harvard.edu
Abstract Large Language Models (LLMs) have showcased exceptional capabilities in
various domains, attracting significant interest from both academia and industry. Despite …

Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application

C Yang, W Lu, Y Zhu, Y Wang, Q Chen, C Gao… - arXiv preprint arXiv …, 2024 - arxiv.org
Large Language Models (LLMs) have showcased exceptional capabilities in various
domains, attracting significant interest from both academia and industry. Despite their …

Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application

C Yang, W Lu, Y Zhu, Y Wang, Q Chen, C Gao, B Yan… - CoRR, 2024 - openreview.net
Large Language Models (LLMs) have showcased exceptional capabilities in various
domains, attracting significant interest from both academia and industry. Despite their …