DOAJ Open Access 2023

Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project

Zoltan Kekecs Bence Palfi Barnabas Szaszi Peter Szecsi Mark Zrubka +25 lainnya

Abstrak

The low reproducibility rate in social sciences has produced hesitation among researchers in accepting published findings at their face value. Despite the advent of initiatives to increase transparency in research reporting, the field is still lacking tools to verify the credibility of research reports. In the present paper, we describe methodologies that let researchers craft highly credible research and allow their peers to verify this credibility. We demonstrate the application of these methods in a multi-laboratory replication of Bem's Experiment 1 (Bem 2011 J. Pers. Soc. Psychol. 100, 407–425. (doi:10.1037/a0021524)) on extrasensory perception (ESP), which was co-designed by a consensus panel including both proponents and opponents of Bem's original hypothesis. In the study we applied direct data deposition in combination with born-open data and real-time research reports to extend transparency to protocol delivery and data collection. We also used piloting, checklists, laboratory logs and video-documented trial sessions to ascertain as-intended protocol delivery, and external research auditors to monitor research integrity. We found 49.89% successful guesses, while Bem reported 53.07% success rate, with the chance level being 50%. Thus, Bem's findings were not replicated in our study. In the paper, we discuss the implementation, feasibility and perceived usefulness of the credibility-enhancing methodologies used throughout the project.

Topik & Kata Kunci

Science

Penulis (30)

Zoltan Kekecs

Bence Palfi

Barnabas Szaszi

Peter Szecsi

Mark Zrubka

Marton Kovacs

Bence E. Bakos

Denis Cousineau

Patrizio Tressoldi

Kathleen Schmidt

Massimo Grassi

Thomas Rhys Evans

Yuki Yamada

Jeremy K. Miller

Huanxu Liu

Fumiya Yonemitsu

Dmitrii Dubrov

Jan Philipp Röer

Marvin Becker

Roxane Schnepper

Atsunori Ariga

Patrícia Arriaga

Raquel Oliveira

Nele Põldver

Kairi Kreegipuu

Braeden Hall

Sera Wiechert

Bruno Verschuere

Kyra Girán

Balazs Aczel

Format Sitasi

APA MLA BibTeX

Kekecs, Z., Palfi, B., Szaszi, B., Szecsi, P., Zrubka, M., Kovacs, M. et al. (2023). Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project. https://doi.org/10.1098/rsos.191375

Akses Cepat

PDF tidak tersedia langsung

Cek di sumber asli →

Lihat di Sumber doi.org/10.1098/rsos.191375

Informasi Jurnal

Tahun Terbit: 2023
Sumber Database: DOAJ
DOI: 10.1098/rsos.191375
Akses: Open Access ✓