arXiv Open Access 2026

MindGuard: Guardrail Classifiers for Multi-Turn Mental Health Support

António Farinhas Nuno M. Guerreiro José Pombal Pedro Henrique Martins Laura Melton +4 lainnya
Lihat Sumber

Abstrak

Large language models are increasingly used for mental health support, yet their conversational coherence alone does not ensure clinical appropriateness. Existing general-purpose safeguards often fail to distinguish between therapeutic disclosures and genuine clinical crises, leading to safety failures. To address this gap, we introduce a clinically grounded risk taxonomy, developed in collaboration with PhD-level psychologists, that identifies actionable harm (e.g., self-harm and harm to others) while preserving space for safe, non-crisis therapeutic content. We release MindGuard-testset, a dataset of real-world multi-turn conversations annotated at the turn level by clinical experts. Using synthetic dialogues generated via a controlled two-agent setup, we train MindGuard, a family of lightweight safety classifiers (with 4B and 8B parameters). Our classifiers reduce false positives at high-recall operating points and, when paired with clinician language models, help achieve lower attack success and harmful engagement rates in adversarial multi-turn interactions compared to general-purpose safeguards. We release all models and human evaluation data.

Topik & Kata Kunci

Penulis (9)

A

António Farinhas

N

Nuno M. Guerreiro

J

José Pombal

P

Pedro Henrique Martins

L

Laura Melton

A

Alex Conway

C

Cara Dochat

M

Maya D'Eon

R

Ricardo Rei

Format Sitasi

Farinhas, A., Guerreiro, N.M., Pombal, J., Martins, P.H., Melton, L., Conway, A. et al. (2026). MindGuard: Guardrail Classifiers for Multi-Turn Mental Health Support. https://arxiv.org/abs/2602.00950

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2026
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓