Publication:
A Prompt for Generating Script Concordance Test UsingChatGPT, Claude, and Llama Large Language ModelChatbots

Thumbnail Image
Files
Manuscript_SCT_v2.pdf(235.63 KB)
Date
2024
relationships.isAuthorOfPublication
relationships.isSecondaryAuthorOf
relationships.isDirectorOf
Authors
Kıyak, Yavuz Selim ; Emekli, Emre
item.page.secondaryauthor
item.page.director
Publisher
Universidad de Murcia. Servicio de publicaciones
publication.page.editor
publication.page.department
DOI
https://doi.org/10.6018/edumed.612381
item.page.type
info:eu-repo/semantics/article
Description
Abstract
Medical education always evolves to incorporate more tools for specific needs in assessing clinicalreasoning skills. Among these tools, Script Concordance Test (SCT) has a particular importancedue to its focus on assessing decision-making in uncertain clinical situations. However,development of SCT items is effortful. Artificial intelligence tools, such as large language models,offer significant benefits. These models are already used for generating multiple-choice questions,and their use in generating SCTs offers great promise. However, this requires well-designedprompts to generate SCTs. This article proposes a generic prompt for the ChatGPT-4, Claude 3,Llama 3, and ChatGPT-4o large language model chatbots to generate SCTs, which can be tailoredto various fields of medicine and different stages of medical education. It can help to streamlinethe development process of SCTs. Initial findings are promising, and there is a need for generatingSCTs using large language models and conducting research to assess the quality of SCTs
publication.page.subject
Script concordance test , Clinical reasoning , Medical education , Artificial intelligence , ChatGPT , Automatic item generation
Citation
Revista Española de Educación Médica. Vol. 5 Núm. 3 (2024)
URI
http://hdl.handle.net/10201/146547
item.page.embargo
Collections
Revista Española de Educación Médica Vol. 5 Nº 3 (2024)
Ir a Estadísticas