arXiv Open Access 2022

The Legal Argument Reasoning Task in Civil Procedure

Leonard Bongard Lena Held Ivan Habernal

Lihat Sumber

Abstrak

We present a new NLP task and dataset from the domain of the U.S. civil procedure. Each instance of the dataset consists of a general introduction to the case, a particular question, and a possible solution argument, accompanied by a detailed analysis of why the argument applies in that case. Since the dataset is based on a book aimed at law students, we believe that it represents a truly complex task for benchmarking modern legal language models. Our baseline evaluation shows that fine-tuning a legal transformer provides some advantage over random baseline models, but our analysis reveals that the actual ability to infer legal arguments remains a challenging open research question.

Topik & Kata Kunci

cs.CL

Penulis (3)

Leonard Bongard

Lena Held

Ivan Habernal

Format Sitasi

APA MLA BibTeX

Bongard, L., Held, L., Habernal, I. (2022). The Legal Argument Reasoning Task in Civil Procedure. https://arxiv.org/abs/2211.02950

Akses Cepat

Lihat di Sumber

Informasi Jurnal

Tahun Terbit: 2022
Bahasa: en
Sumber Database: arXiv
Akses: Open Access ✓