arXiv Open Access 2025

Na Prática, qual IA Entende o Direito? Um Estudo Experimental com IAs Generalistas e uma IA Jurídica

Marina Soares Marinho Daniela Vianna Livy Real Altigran da Silva Gabriela Migliorini

Lihat Sumber

Abstrak

This study presents the Jusbrasil Study on the Use of General-Purpose AIs in Law, proposing an experimental evaluation protocol combining legal theory, such as material correctness, systematic coherence, and argumentative integrity, with empirical assessment by 48 legal professionals. Four systems (JusIA, ChatGPT Free, ChatGPT Pro, and Gemini) were tested in tasks simulating lawyers' daily work. JusIA, a domain-specialized model, consistently outperformed the general-purpose systems, showing that both domain specialization and a theoretically grounded evaluation are essential for reliable legal AI outputs.

Topik & Kata Kunci

cs.CL

Penulis (5)

Marina Soares Marinho

Daniela Vianna

Livy Real

Altigran da Silva

Gabriela Migliorini

Format Sitasi

APA MLA BibTeX

Marinho, M.S., Vianna, D., Real, L., Silva, A.d., Migliorini, G. (2025). Na Prática, qual IA Entende o Direito? Um Estudo Experimental com IAs Generalistas e uma IA Jurídica. https://arxiv.org/abs/2510.18108

Akses Cepat

Lihat di Sumber

Informasi Jurnal

Tahun Terbit: 2025
Bahasa: en
Sumber Database: arXiv
Akses: Open Access ✓