arXiv Open Access 2026

Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integration

Yingying Deng Xiangyu He Fan Tang Weiming Dong Xucheng Yin
Lihat Sumber

Abstrak

Text-guided image generation has advanced rapidly with large-scale diffusion models, yet achieving precise stylization with visual exemplars remains difficult. Existing approaches often depend on task-specific retraining or expensive inversion procedures, which can compromise content integrity, reduce style fidelity, and lead to an unsatisfactory trade-off between semantic prompt adherence and style alignment. In this work, we introduce a training-free framework that reformulates style-guided synthesis as an in-context learning task. Guided by textual semantic prompts, our method concatenates a reference style image with a masked target image, leveraging a pretrained ReFlow-based inpainting model to seamlessly integrate semantic content with the desired style through multimodal attention fusion. We further analyze the imbalance and noise sensitivity inherent in multimodal attention fusion and propose a Dynamic Semantic-Style Integration (DSSI) mechanism that reweights attention between textual semantic and style visual tokens, effectively resolving guidance conflicts and enhancing output coherence. Experiments show that our approach achieves high-fidelity stylization with superior semantic-style balance and visual quality, offering a simple yet powerful alternative to complex, artifact-prone prior methods.

Topik & Kata Kunci

Penulis (5)

Y

Yingying Deng

X

Xiangyu He

F

Fan Tang

W

Weiming Dong

X

Xucheng Yin

Format Sitasi

Deng, Y., He, X., Tang, F., Dong, W., Yin, X. (2026). Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integration. https://arxiv.org/abs/2601.06605

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2026
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓