Browsing by Subject "Automatic item generation"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Publication
    Open Access
    A ChatGPT Prompt for Writing Case-Based Multiple-ChoiceQuestions
    (Universidad de Murcia. Servicio de publicaciones, 2023) Selim Kiyak, Yavuz
    he significant challenge faced by medical schools is the effortful process of writing a highquantity of high-quality case-based multiple-choice questions (MCQs) to assess the higher-orderskills of medical students. The demand for a high volume of MCQs in education has led to thedevelopment of Automatic Item Generation (AIG), specifically template-based AIG, whichinvolves creating cognitive and item models by subject matter experts to generate hundreds ofMCQs at once using software. It demonstrated significant success in various languages and evenbeing incorporated into national medical licensure exams. However, this method still heavilydepends on the efforts of subject matter experts. This paper introduces a detailed ChatGPT promptfor quickly generating case-based MCQs and provides important research questions for futureexploration into ChatGPT's potential in generating items, signaling the beginning of the artificialintelligence era in medical education, encouraging health professions education researchers todelve deeper into its potential.
  • Thumbnail Image
    Publication
    Open Access
    A Prompt for Generating Script Concordance Test UsingChatGPT, Claude, and Llama Large Language ModelChatbots
    (Universidad de Murcia. Servicio de publicaciones, 2024) Kıyak, Yavuz Selim; Emekli, Emre
    Medical education always evolves to incorporate more tools for specific needs in assessing clinicalreasoning skills. Among these tools, Script Concordance Test (SCT) has a particular importancedue to its focus on assessing decision-making in uncertain clinical situations. However,development of SCT items is effortful. Artificial intelligence tools, such as large language models,offer significant benefits. These models are already used for generating multiple-choice questions,and their use in generating SCTs offers great promise. However, this requires well-designedprompts to generate SCTs. This article proposes a generic prompt for the ChatGPT-4, Claude 3,Llama 3, and ChatGPT-4o large language model chatbots to generate SCTs, which can be tailoredto various fields of medicine and different stages of medical education. It can help to streamlinethe development process of SCTs. Initial findings are promising, and there is a need for generatingSCTs using large language models and conducting research to assess the quality of SCTs