[PDF][PDF] PAL-BERT: an improved question answering model

W Zheng, S Lu, Z Cai, R Wang, L Wang… - Computer Modeling in …, 2023 - researchgate.net
In the field of natural language processing (NLP), there have been various pre-training
language models in recent years, with question answering systems gaining significant …

Distilling knowledge from super-resolution for efficient remote sensing salient object detection

Y Liu, Z Xiong, Y Yuan, Q Wang - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Current state-of-the-art remote sensing salient object detectors always require high-
resolution spatial context to ensure excellent performance, which incurs enormous …

Towards fairness-aware adversarial network pruning

L Zhang, Z Wang, X Dong, Y Feng… - Proceedings of the …, 2023 - openaccess.thecvf.com
Network pruning aims to compress models while minimizing loss in accuracy. With the
increasing focus on bias in AI systems, the bias inheriting or even magnification nature of …

Solving oscillation problem in post-training quantization through a theoretical perspective

Y Ma, H Li, X Zheng, X Xiao, R Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Post-training quantization (PTQ) is widely regarded as one of the most efficient compression
methods practically, benefitting from its data privacy and low computation costs. We argue …

Dimensionality reduced training by pruning and freezing parts of a deep neural network: a survey

P Wimmer, J Mehnert, AP Condurache - Artificial Intelligence Review, 2023 - Springer
State-of-the-art deep learning models have a parameter count that reaches into the billions.
Training, storing and transferring such models is energy and time consuming, thus costly. A …

Towards Better Structured Pruning Saliency by Reorganizing Convolution

X Sun, H Shi - Proceedings of the IEEE/CVF Winter …, 2024 - openaccess.thecvf.com
We present SPSRC, a novel, simple and effective framework to extract enhanced Structured
Pruning Saliency scores by Reorganizing Convolution. We observe that performance of …

MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protection

B Peng, S Qu, Y Wu, T Zou, L He… - Proceedings of the …, 2024 - openaccess.thecvf.com
Deep learning has achieved remarkable progress in various applications heightening the
importance of safeguarding the intellectual property (IP) of well-trained models. It entails not …

Image recognition based on lightweight convolutional neural network: Recent advances

Y Liu, J Xue, D Li, W Zhang, TK Chiew, Z Xu - Image and Vision Computing, 2024 - Elsevier
Image recognition is an important task in computer vision with broad applications. In recent
years, with the advent of deep learning, lightweight convolutional neural network (CNN) has …

Pushing the efficiency limit using structured sparse convolutions

VK Verma, N Mehta, S Si, R Henao… - Proceedings of the …, 2023 - openaccess.thecvf.com
Weight pruning is among the most popular approaches for compressing deep convolutional
neural networks. Recent work suggests that in a randomly initialized deep neural network …

Hierarchical model compression via shape-edge representation of feature maps—an enlightenment from the primate visual system

H Zhang, L Liu, B Kang, N Zheng - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
The cumbersome computation of deep neural networks (DNNs) limits their practical
deployment on resource-constrained mobile multimedia devices. To deploy DNNs on …