arXiv Open Access 2026

State of the Art of LLM-Enabled Interaction with Visualization

Mathis Brossier Tobias Isenberg Konrad Schönborn Jonas Unger Mario Romero +3 lainnya
Lihat Sumber

Abstrak

We report on a systematic, PRISMA-guided survey of research at the intersection of LLMs and visualization, with a particular focus on visio-verbal interaction -- where verbal and visual modalities converge to support data sense-making. The emergence of Large Language Models (LLMs) has introduced new paradigms for interacting with data visualizations through natural language, leading to intuitive, multimodal, and accessible interfaces. We analyze 48 papers across six dimensions: application domain, visualization task, visualization representation, interaction modality, LLM integration, and system evaluation. Our classification framework maps LLM roles across the visualization pipeline, from data querying and transformation to visualization generation, explanation, and navigation. We highlight emerging design patterns, identify gaps in accessibility and visualization reading, and discuss the limitations of current LLMs in spatial reasoning and contextual grounding. We further reflect on evaluations of combined LLM-visualization systems, highlighting how current research projects tackle this challenge and discuss current gaps in conducting meaningful evaluations of such systems. With our survey we aim to guide future research and system design in LLM-enhanced visualization, supporting broad audiences and intelligent, conversational interfaces.

Topik & Kata Kunci

Penulis (8)

M

Mathis Brossier

T

Tobias Isenberg

K

Konrad Schönborn

J

Jonas Unger

M

Mario Romero

J

Johanna Björklund

A

Anders Ynnerman

L

Lonni Besançon

Format Sitasi

Brossier, M., Isenberg, T., Schönborn, K., Unger, J., Romero, M., Björklund, J. et al. (2026). State of the Art of LLM-Enabled Interaction with Visualization. https://arxiv.org/abs/2601.14943

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2026
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓