arXiv Open Access 2018

Inter-Rater: Software for analysis of inter-rater reliability by permutating pairs of multiple users

Daniel J. Arenas

Lihat Sumber

Abstrak

Inter-Rater quantifies the reliability between multiple raters who evaluate a group of subjects. It calculates the group quantity, Fleiss kappa, and it improves on existing software by keeping information about each user and quantifying how each user agreed with the rest of the group. This is accomplished through permutations of user pairs. The software was written in Python, can be run in Linux, and the code is deposited in Zenodo and GitHub. This software can be used for evaluation of inter-rater reliability in systematic reviews, medical diagnosis algorithms, education applications, and others.

Topik & Kata Kunci

stat.OT

Penulis (1)

Daniel J. Arenas

Format Sitasi

APA MLA BibTeX

Arenas, D.J. (2018). Inter-Rater: Software for analysis of inter-rater reliability by permutating pairs of multiple users. https://arxiv.org/abs/1809.05731

Akses Cepat

Lihat di Sumber

Informasi Jurnal

Tahun Terbit: 2018
Bahasa: en
Sumber Database: arXiv
Akses: Open Access ✓