arXiv Open Access 2026

Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responses

Chongyuan Dai Yaling Shen Jinpeng Hu Zihan Gao Jia Li +4 lainnya
Lihat Sumber

Abstrak

Culture serves as a fundamental determinant of human affective processing and profoundly shapes how individuals perceive and interpret emotional stimuli. Despite this intrinsic link extant evaluations regarding cultural alignment within Large Language Models primarily prioritize declarative knowledge such as geographical facts or established societal customs. These benchmarks remain insufficient to capture the subjective interpretative variance inherent to diverse sociocultural lenses. To address this limitation, we introduce CEDAR, a multimodal benchmark constructed entirely from scenarios capturing Culturally \underline{\textsc{E}}licited \underline{\textsc{D}}istinct \underline{\textsc{A}}ffective \underline{\textsc{R}}esponses. To construct CEDAR, we implement a novel pipeline that leverages LLM-generated provisional labels to isolate instances yielding cross-cultural emotional distinctions, and subsequently derives reliable ground-truth annotations through rigorous human evaluation. The resulting benchmark comprises 10,962 instances across seven languages and 14 fine-grained emotion categories, with each language including 400 multimodal and 1,166 text-only samples. Comprehensive evaluations of 17 representative multilingual models reveal a dissociation between language consistency and cultural alignment, demonstrating that culturally grounded affective understanding remains a significant challenge for current models.

Topik & Kata Kunci

Penulis (9)

C

Chongyuan Dai

Y

Yaling Shen

J

Jinpeng Hu

Z

Zihan Gao

J

Jia Li

Y

Yishun Jiang

Y

Yaxiong Wang

L

Liu Liu

Z

Zongyuan Ge

Format Sitasi

Dai, C., Shen, Y., Hu, J., Gao, Z., Li, J., Jiang, Y. et al. (2026). Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responses. https://arxiv.org/abs/2601.13024

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2026
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓