A survey on lora of large language models

Y Mao, Y Ge, Y Fan, W Xu, Y Mi, Z Hu… - Frontiers of Computer …, 2025 - Springer
Abstract Low-Rank Adaptation (LoRA), which updates the dense neural network layers with
pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning …

Task-Conditional Adapter for Multi-Task Dense Prediction

F Jiang, S Wang, X Gong - Proceedings of the 32nd ACM International …, 2024 - dl.acm.org
Multi-task dense prediction plays an important role in the field of computer vision and has an
abundant array of applications. Its main purpose is to reduce the amount of network training …

EK-Net++: Real-time scene text detection with expand kernel distance and Epoch Adaptive Weight

B Zhu, X Chen, Q Tang, CLP Chen, F Liu - Expert Systems with Applications, 2024 - Elsevier
Recently, scene text detection has received significant attention due to its wide applications.
Accurate detection in complex scenes of multiple scales, orientations, and curvature remains …

Collaborative and Efficient Personalization with Mixtures of Adaptors

AJ Almansoori, S Horváth, M Takáč - arXiv preprint arXiv:2410.03497, 2024 - arxiv.org
Non-iid data is prevalent in real-world federated learning problems. Data heterogeneity can
come in different types in terms of distribution shifts. In this work, we are interested in the …

HirMTL: Hierarchical Multi-Task Learning for dense scene understanding

H Luo, W Hu, Y Wei, J He, M Yu - Neural Networks, 2025 - Elsevier
In the realm of artificial intelligence, simultaneous multi-task learning is crucial, particularly
for dense scene understanding. To address this, we introduce HirMTL, a novel hierarchical …

SM3Det: A Unified Model for Multi-Modal Remote Sensing Object Detection

Y Li, X Li, Y Li, Y Zhang, Y Dai, Q Hou… - arXiv preprint arXiv …, 2024 - arxiv.org
With the rapid advancement of remote sensing technology, high-resolution multi-modal
imagery is now more widely accessible. Conventional Object detection models are trained …

QR-DETR: Query Routing for Detection Transformer

T Senthivel, NS Vu - … of the Asian Conference on Computer …, 2024 - openaccess.thecvf.com
Detection Transformer (DETR) predicts object bounding boxes and classes from learned
object queries. However, DETR exhibits three major flaws:(1) Only a subset of object queries …

Swiss Army Knife: Synergizing Biases in Knowledge from Vision Foundation Models for Multi-Task Learning

Y Lu, S Cao, YX Wang - arXiv preprint arXiv:2410.14633, 2024 - arxiv.org
Vision Foundation Models (VFMs) have demonstrated outstanding performance on
numerous downstream tasks. However, due to their inherent representation biases …

CA-MoE: Channel-Adapted MoE for Incremental Weather Forecasting

H Chen, H Tao, G Song, J Zhang, Y Yu, Y Dong… - arXiv preprint arXiv …, 2024 - arxiv.org
Atmospheric science is intricately connected with other fields, eg, geography and
aerospace. Most existing approaches involve training a joint atmospheric and geographic …

RADIO Amplified: Improved Baselines for Agglomerative Vision Foundation Models

G Heinrich, M Ranzinger, Y Lu, J Kautz, A Tao… - arXiv preprint arXiv …, 2024 - arxiv.org
Agglomerative models have recently emerged as a powerful approach to training vision
foundation models, leveraging multi-teacher distillation from existing models such as CLIP …