arXiv Open Access 2026

SJD-PV: Speculative Jacobi Decoding with Phrase Verification for Autoregressive Image Generation

Zhehao Yu Baoquan Zhang Bingqi Shan Xinhao Liu Dongliang Zhou +3 lainnya
Lihat Sumber

Abstrak

Autoregressive (AR) image models have recently demonstrated remarkable generative capability, but their sequential nature results in significant inference latency. Existing training-free acceleration methods typically verify tokens independently, overlooking the strong co-occurrence patterns between adjacent visual tokens. This independence assumption often leads to contextual inconsistency and limits decoding efficiency. In this work, we introduce a novel training-free acceleration framework that performs phrase-level speculative verification, enabling the model to jointly validate multiple correlated tokens within each decoding window. To construct such phrase units, we analyze token co-occurrence statistics from the training corpus and group frequently co-occurring tokens into semantically coherent visual phrases. During inference, the proposed phrase-level verification evaluates aggregated likelihood ratios over each phrase, allowing simultaneous acceptance of multiple tokens while preserving generation quality. Extensive experiments on autoregressive text-to-image generation show that our method significantly reduces the number of function evaluations (NFE) and achieves up to 30% faster decoding without compromising visual fidelity. Our findings reveal that modeling short-range token co-occurrence provides an effective and general principle for accelerating autoregressive inference.

Topik & Kata Kunci

Penulis (8)

Z

Zhehao Yu

B

Baoquan Zhang

B

Bingqi Shan

X

Xinhao Liu

D

Dongliang Zhou

G

Guotao Liang

G

Guangming Ye

Y

Yunming Ye

Format Sitasi

Yu, Z., Zhang, B., Shan, B., Liu, X., Zhou, D., Liang, G. et al. (2026). SJD-PV: Speculative Jacobi Decoding with Phrase Verification for Autoregressive Image Generation. https://arxiv.org/abs/2603.06666

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2026
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓