arXiv Open Access 2025

UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement

Weiqi Li Xuanyu Zhang Bin Chen Jingfen Xie Yan Wang +5 lainnya
Lihat Sumber

Abstrak

Image quality assessment (IQA) and image restoration are fundamental problems in low-level vision. Although IQA and restoration are closely connected conceptually, most existing work treats them in isolation. Recent advances in unified multimodal understanding-generation models demonstrate promising results and indicate that stronger understanding can improve generative performance. This motivates a single model that unifies IQA and restoration and explicitly studies how IQA can guide restoration, a setting that remains largely underexplored yet highly valuable. In this paper, we propose UARE, to our knowledge the first Unified vision-language model for image quality Assessment, Restoration, and Enhancement. Built on pretrained unified understanding and generation models, we introduce a two-stage training framework. First, a progressive, easy-to-hard schedule expands from single-type distortions to higher-order mixed degradations, enabling UARE to handle multiple degradations. Second, we perform unified fine-tuning of quality understanding and restoration with interleaved text-image data, aligning IQA signals with restoration objectives. Through multi-task co-training, UARE leverages IQA to boost restoration and enhancement performance. Extensive experiments across IQA, restoration, and enhancement tasks demonstrate the effectiveness of UARE. The code and models will be available at https://github.com/lwq20020127/UARE.

Topik & Kata Kunci

Penulis (10)

W

Weiqi Li

X

Xuanyu Zhang

B

Bin Chen

J

Jingfen Xie

Y

Yan Wang

K

Kexin Zhang

J

Junlin Li

L

Li Zhang

J

Jian Zhang

S

Shijie Zhao

Format Sitasi

Li, W., Zhang, X., Chen, B., Xie, J., Wang, Y., Zhang, K. et al. (2025). UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement. https://arxiv.org/abs/2512.06750

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2025
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓