Publication:
A Prompt for Generating Script Concordance Test UsingChatGPT, Claude, and Llama Large Language ModelChatbots

dc.contributor.authorKıyak, Yavuz Selim
dc.contributor.authorEmekli, Emre
dc.date.accessioned2024-11-20T19:40:24Z
dc.date.available2024-11-20T19:40:24Z
dc.date.issued2024
dc.description.abstractMedical education always evolves to incorporate more tools for specific needs in assessing clinicalreasoning skills. Among these tools, Script Concordance Test (SCT) has a particular importancedue to its focus on assessing decision-making in uncertain clinical situations. However,development of SCT items is effortful. Artificial intelligence tools, such as large language models,offer significant benefits. These models are already used for generating multiple-choice questions,and their use in generating SCTs offers great promise. However, this requires well-designedprompts to generate SCTs. This article proposes a generic prompt for the ChatGPT-4, Claude 3,Llama 3, and ChatGPT-4o large language model chatbots to generate SCTs, which can be tailoredto various fields of medicine and different stages of medical education. It can help to streamlinethe development process of SCTs. Initial findings are promising, and there is a need for generatingSCTs using large language models and conducting research to assess the quality of SCTses
dc.formatapplication/pdfes
dc.format.extent8es
dc.identifier.citationRevista Española de Educación Médica. Vol. 5 Núm. 3 (2024)es
dc.identifier.doihttps://doi.org/10.6018/edumed.612381
dc.identifier.issn2660-8529
dc.identifier.urihttp://hdl.handle.net/10201/146547
dc.languageenges
dc.publisherUniversidad de Murcia. Servicio de publicacioneses
dc.relationSin financiación externa a la Universidades
dc.rightsinfo:eu-repo/semantics/openAccesses
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 Internacional*
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/*
dc.subjectScript concordance testes
dc.subjectClinical reasoninges
dc.subjectMedical educationes
dc.subjectArtificial intelligencees
dc.subjectChatGPTes
dc.subjectAutomatic item generationes
dc.subject.otherCDU::0 - Generalidades.::00 - Ciencia y conocimiento. Investigación. Cultura. Humanidades.es
dc.titleA Prompt for Generating Script Concordance Test UsingChatGPT, Claude, and Llama Large Language ModelChatbotses
dc.typeinfo:eu-repo/semantics/articlees
dspace.entity.typePublicationes
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Manuscript_SCT_v2.pdf
Size:
235.63 KB
Format:
Adobe Portable Document Format
Description:
English
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
2.26 KB
Format:
Item-specific license agreed upon to submission
Description: