Tip: Text-driven image processing with semantic and restoration instructions

C Qi, Z Tu, K Ye, M Delbracio, P Milanfar… - arXiv preprint arXiv …, 2023 - arxiv.org
Text-driven diffusion models have become increasingly popular for various image editing
tasks, including inpainting, stylization, and object replacement. However, it still remains an …

LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning

B Lai, X Dai, L Chen, G Pang, JM Rehg… - arXiv preprint arXiv …, 2023 - arxiv.org
Generating instructional images of human daily actions from an egocentric viewpoint serves
a key step towards efficient skill transfer. In this paper, we introduce a novel problem …

Efficient Diffusion-Driven Corruption Editor for Test-Time Adaptation

Y Oh, J Lee, J Choi, D Jung, U Hwang… - arXiv preprint arXiv …, 2024 - arxiv.org
Test-time adaptation (TTA) addresses the unforeseen distribution shifts occurring during test
time. In TTA, both performance and, memory and time consumption serve as crucial …

RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models

H Chen, W Li, J Gu, J Ren, S Chen, T Ye, R Pei… - arXiv preprint arXiv …, 2024 - arxiv.org
Natural images captured by mobile devices often suffer from multiple types of degradation,
such as noise, blur, and low light. Traditional image restoration methods require manual …

Towards Real-World Adverse Weather Image Restoration: Enhancing Clearness and Semantics with Vision-Language Models

J Xu, M Wu, X Hu, CW Fu, Q Dou, PA Heng - arXiv preprint arXiv …, 2024 - arxiv.org
This paper addresses the limitations of adverse weather image restoration approaches
trained on synthetic data when applied to real-world scenarios. We formulate a semi …

Any Image Restoration with Efficient Automatic Degradation Adaptation

B Ren, E Zamfir, Y Li, Z Wu, DP Paudel… - arXiv preprint arXiv …, 2024 - arxiv.org
With the emergence of mobile devices, there is a growing demand for an efficient model to
restore any degraded image for better perceptual quality. However, existing models often …

Universal Image Restoration with Text Prompt Diffusion

B Yu, Z Fan, X Xiang, J Chen, D Huang - Sensors, 2024 - mdpi.com
Universal image restoration (UIR) aims to accurately restore images with a variety of
unknown degradation types and levels. Existing methods, including both learning-based …

DiffRetouch: Using Diffusion to Retouch on the Shoulder of Experts

ZP Duan, Z Lin, X Jin, D Zou, C Guo, C Li - arXiv preprint arXiv …, 2024 - arxiv.org
Image retouching aims to enhance the visual quality of photos. Considering the different
aesthetic preferences of users, the target of retouching is subjective. However, current …

HAIR: Hypernetworks-based All-in-One Image Restoration

J Cao, Y Cao, L Pang, D Meng, X Cao - arXiv preprint arXiv:2408.08091, 2024 - arxiv.org
Image restoration involves recovering a high-quality clean image from its degraded version,
which is a fundamental task in computer vision. Recent progress in image restoration has …

Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration

Y Zhang, H Zhang, X Chai, Z Cheng, R Xie… - arXiv preprint arXiv …, 2024 - arxiv.org
Image restoration is a classic low-level problem aimed at recovering high-quality images
from low-quality images with various degradations such as blur, noise, rain, haze, etc …