Publication:
Reproducibility of Published Meta-Analyses on Clinical-Psychological Interventions

Simple item page
dc.contributor.authorLópez Nicolás, Rubén
dc.contributor.authorLakens, Daniel
dc.contributor.authorLópez López, José Antonio
dc.contributor.authorRubio Aparicio, María
dc.contributor.authorSandoval Lentisco, Alejandro
dc.contributor.authorLópez-Ibáñez, Carmen
dc.contributor.authorBlázquez-Rincón, Desirée
dc.contributor.authorSánchez Meca, Julio
dc.contributor.departmentPsicología Básica y Metodología
dc.contributor.otherFacultad de Psicología y Logopedia
dc.date.accessioned2025-11-25T12:58:13Z
dc.date.available2025-11-25T12:58:13Z
dc.date.copyright© 2024 The Author(s)
dc.date.issued2024-02-05
dc.description.abstractMeta-analysis is one of the most useful research approaches, the relevance of which relies on its credibility. Reproducibility of scientific results could be considered as the minimal threshold of this credibility. We assessed the reproducibility of a sample of meta-analyses published between 2000 and 2020. From a random sample of 100 articles reporting results of meta-analyses of interventions in clinical psychology, 217 meta-analyses were selected. We first tried to retrieve the original data by recovering a data file, recoding the data from document files, or requesting it from original authors. Second, through a multistage workflow, we tried to reproduce the main results of each meta-analysis. The original data were retrieved for 67% (146/217) of meta-analyses. Although this rate showed an improvement over the years, in only 5% of these cases was it possible to retrieve a data file ready for reuse. Of these 146, 52 showed a discrepancy larger than 5% in the main results in the first stage. For 10 meta-analyses, this discrepancy was solved after fixing a coding error of our data-retrieval process, and for 15 of them, it was considered approximately reproduced in a qualitative assessment. In the remaining meta-analyses (18%, 27/146), different issues were identified in an in-depth review, such as reporting inconsistencies, lack of data, or transcription errors. Nevertheless, the numerical discrepancies were mostly minor and had little or no impact on the conclusions. Overall, one of the biggest threats to the reproducibility of meta-analysis is related to data availability and current data-sharing practices in meta-analysis.
dc.formatapplication/pdf
dc.format.extent14
dc.identifier.citationAdvances in Methods and Practices in Psychological Science. 2024;7(1)
dc.identifier.doihttps://doi.org/10.1177/2515245923120292
dc.identifier.eissn2515-2459
dc.identifier.urihttp://hdl.handle.net/10201/175470
dc.languageeng
dc.publisherSAGE Publications
dc.relationThis research was funded with a grant from the Spanish Ministry of Science and Innovation (Project PID2019-104080GB-I00/AEI/10.13039/501100011033; PID2019-104033GA-I00/MCIN/AEI/10.13039/501100011033, FEDER funds), by the Spanish Ministry of Universities (predoctoral grant: FPU18/04805), and by the Regional Program for the Promotion of Scientific and Technical Research of Excellence (Action Plan 2022) of the Seneca Foundation - Science and Technology Agency of the Region of Murcia (Grant 22064/PI/22).
dc.relation.publisherversionhttps://journals.sagepub.com/doi/10.1177/25152459231202929
dc.rightsAttribution-NonCommercial 4.0 International*
dc.rights.accessRightsinfo:eu-repo/semantics/openAccess
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/*
dc.subjectMeta-analysis
dc.subjectReproducibility
dc.subject Data sharing
dc.subjectData reusability
dc.subjectResearch synthesis
dc.subject.odsNo relacionado con ningún objetivo de desarrollo sostenible
dc.titleReproducibility of Published Meta-Analyses on Clinical-Psychological Interventions
dc.typeinfo:eu-repo/semantics/article
dspace.entity.typePublicationes
relation.isAuthorOfPublication6d5e0bf5-ef34-4006-afba-2462c3cb77f4
relation.isAuthorOfPublicationd8554b7e-c4bc-4d66-a9dc-a257a9f7b92b
relation.isAuthorOfPublication36c20b03-00af-45c3-8ee6-670ee01c209d
relation.isAuthorOfPublication3e0f7866-1ad4-4616-926c-30dc81d86dcf
relation.isAuthorOfPublication7a7ea857-99bb-4d09-882b-0cf9064c04d9
relation.isAuthorOfPublication.latestForDiscovery6d5e0bf5-ef34-4006-afba-2462c3cb77f4
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
LopezNicolas2024.pdf
Size:
1.86 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
1.37 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Artículos