Publication:
Improving the reporting quality of reliability generalization meta-analyses: The REGEMA checklist

Simple item page
dc.contributor.authorSánchez-Meca, Julio
dc.contributor.authorMarín-Martínez, Fulgencio
dc.contributor.authorLópez-López, José Antonio
dc.contributor.authorNúñez-Núñez, Rosa Maria
dc.contributor.authorRubio-Aparicio, María
dc.contributor.authorLópez-García, Juan José
dc.contributor.authorLópez-Pina, José Antonio
dc.contributor.authorBlázquez-Rincón, Desirée Mª
dc.contributor.authorLópez-Ibáñez, Carmen
dc.contributor.authorLópez-Nicolás, Rubén
dc.contributor.departmentPsicología Básica y Metodología
dc.date.accessioned2024-09-13T08:34:55Z
dc.date.available2024-09-13T08:34:55Z
dc.date.issued2021-03-20
dc.description© 2021 John Wiley & Sons Ltd.. This document is the published version of a published work that appeared in final form in Research Synthesis Methods. To access the final work, see DOI: https://doi.org/10.1002/jrsm.1487es
dc.description.abstractReliability generalization (RG) is a meta-analytic approach that aims to characterize how reliability estimates from the same test vary across different applications of the instrument. With this purpose RG meta-analyses typically focus on a particular test and intend to obtain an overall reliability of test scores and to investigate how the composition and variability of the samples affect reliability. Although several guidelines have been proposed in the meta-analytic literature to help authors improve the reporting quality of meta-analyses, none of them were devised for RG meta-analyses. The purpose of this investigation was to develop REGEMA (REliability GEneralization Meta-Analysis), a 30-item checklist (plus a flow chart) adapted to the specific issues that the reporting of an RG meta-analysis must take into account. Based on previous checklists and guidelines proposed in the meta-analytic arena, a first version was elaborated by applying the nominal group methodology. The resulting instrument was submitted to a list of independent meta-analysis experts and, after discussion, the final version of the REGEMA checklist was reached. In a pilot study, four pairs of coders applied REGEMA to a random sample of 40 RG meta-analyses in Psychology, and results showed satisfactory inter-coder reliability. REGEMA can be used by: (a) meta-analysts conducting or reporting an RG meta-analysis and aiming to improve its reporting quality; (b) consumers of RG meta-analyses who want to make informed critical appraisals of their reporting quality, and (c) reviewers and editors of journals who are considering submissions where an RG meta-analysis was reported for potential publication.es
dc.formatapplication/pdfes
dc.format.extent21es
dc.identifier.citationResearch Synthesis MethodsVolume 12, Issue 4 p. 516-536
dc.identifier.doihttps://doi.org/10.1002/jrsm.1487
dc.identifier.issnPrint: 1759-2879
dc.identifier.issnElectronic: 1759-2887
dc.identifier.urihttp://hdl.handle.net/10201/143936
dc.languageenges
dc.publisherWiley Online Libraryes
dc.relationFondo Europeo de Desarrollo Regional, Grant/Award Number: FEDER; Project PSI2016- 77676-P; Ministerio de Economía y Competitividad of the Spanish Governmentes
dc.relation.publisherversionhttps://onlinelibrary.wiley.com/doi/full/10.1002/jrsm.1487es
dc.rights.accessRightsinfo:eu-repo/semantics/restrictedAccess
dc.subjectMeta-analysises
dc.subjectReliability coefficientes
dc.subjectReliability generalizationes
dc.subjectReporting qualityes
dc.subjectSystematic reviewses
dc.titleImproving the reporting quality of reliability generalization meta-analyses: The REGEMA checklistes
dc.typeinfo:eu-repo/semantics/articlees
dspace.entity.typePublicationes
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Research Synthesis Methods - 2021 - Sánchez‐Meca - Improving the reporting quality of reliability generalization.pdf
Size:
1.61 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
2.26 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Artículos