U Jang, JD Lee, EK Ryu - arXiv preprint arXiv:2402.11867, 2024 - arxiv.org
Low-rank adaptation (LoRA) has become the standard approach for parameter-efficient fine- tuning of large language models (LLM), but our theoretical understanding of LoRA has been …