Towards efficient fine-tuning of pre-trained code models: An experimental study and beyond

E Shi, Y Wang, H Zhang, L Du, S Han… - Proceedings of the …, 2023 - dl.acm.org
Recently, fine-tuning pre-trained code models such as CodeBERT on downstream tasks has
achieved great success in many software testing and analysis tasks. While effective and …

Cachegen: Kv cache compression and streaming for fast large language model serving

Y Liu, H Li, Y Cheng, S Ray, Y Huang… - Proceedings of the …, 2024 - dl.acm.org
As large language models (LLMs) take on complex tasks, their inputs are supplemented with
longer contexts that incorporate domain knowledge. Yet using long contexts is challenging …

Scalable and efficient full-graph gnn training for large graphs

X Wan, K Xu, X Liao, Y Jin, K Chen, X Jin - Proceedings of the ACM on …, 2023 - dl.acm.org
Graph Neural Networks (GNNs) have emerged as powerful tools to capture structural
information from graph-structured data, achieving state-of-the-art performance on …

Pathogen-based classification of plant diseases: A deep transfer learning approach for intelligent support systems

KPA Rani, S Gowrishankar - IEEE Access, 2023 - ieeexplore.ieee.org
The national economy's key pillar, agriculture has a significant influence on society. Plant
health monitoring and disease detection are essential for sustainable agriculture. To protect …

Efficient deepfake detection via layer-frozen assisted dual attention network for consumer imaging devices

MT Usman, H Khan, SK Singh… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The advancement of open-source frameworks and user-friendly manipulation applications
has accelerated the spread of deep fakes. In this study, we proposed optimal features …

{AdaEmbed}: Adaptive Embedding for {Large-Scale} Recommendation Models

F Lai, W Zhang, R Liu, W Tsai, X Wei, Y Hu… - … USENIX Symposium on …, 2023 - usenix.org
Deep learning recommendation models (DLRMs) are using increasingly larger embedding
tables to represent categorical sparse features such as video genres. Each embedding row …

Synchronize only the immature parameters: Communication-efficient federated learning by freezing parameters adaptively

C Chen, H Xu, W Wang, B Li, B Li… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning allows edge devices to collaboratively train a global model without
sharing their local private data. Yet, with limited network bandwidth at the edge …

Automatic monitoring cheese ripeness using computer vision and artificial intelligence

A Loddo, C Di Ruberto, G Armano, A Manconi - IEEE Access, 2022 - ieeexplore.ieee.org
Ripening is a very important process that contributes to cheese quality, as its characteristics
are determined by the biochemical changes that occur during this period. Therefore …

Automated optimization-based deep learning models for image classification tasks

DM Migayo, S Kaijage, S Swetala, DG Nyambo - Computers, 2023 - mdpi.com
Applying deep learning models requires design and optimization when solving multifaceted
artificial intelligence tasks. Optimization relies on human expertise and is achieved only with …

Heterogeneity-aware memory efficient federated learning via progressive layer freezing

Y Wu, L Li, C Tian, T Chang, C Lin… - 2024 IEEE/ACM 32nd …, 2024 - ieeexplore.ieee.org
Federated Learning (FL) emerges as a new learning paradigm that enables multiple devices
to collaboratively train a shared model while preserving data privacy. However, intensive …