Browsing by Subject "Rater reliability"

Now showing 1 - 1 of 1
  • Thumbnail Image
    Publication
    Open Access
    La calidad en el proceso de corrección de las pruebas de acceso a la universidad: variabilidad y factores
    (Universidad de Murcia. Servicio de Publicaciones, 2002) Grau, Rosa; Cuxart, Anna; Martí-Recober, Manuel
    The educational system in Spain is undergoing a reorganisation. At present, high-school graduates who want to enrol at a public university must take a set of examinations Pruebas de Acceso a la Universidad (PAU). This paper is related to one of the main educational measurement issues associated with the examinations: reliability ofgrading. It summarises an experiment designed and conducted to evaluate the quality of grading in four subjects: Philosophy, Biology, Mathematics and Catalan Literature. Elementary summaries, such a cross-tabulations ofoperational and experimental grades, provide a clear evidence of between raters differences. A statistically more profound way of summarising the quality ofgrading is in terms of the variance due to ability, severity and inconsistency (Longford, 1994). The study demonstrates the feasibility ofan on-going scheme ofpartial duplica te grading which would be solely used for quality control and for understanding the inconsistencies occurring in the grading process.