Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
The Use of Generative AI Tools in Assessing Open-ended Text-based Examinations
(NSBM Green University.
NSBM Green University.
Stockholms universitet, Samhällsvetenskapliga fakulteten, Institutionen för data- och systemvetenskap.ORCID-id: 0000-0003-1153-1870
Antal upphovsmän: 32025 (Engelska)Ingår i: The International Conference on Education: Pioneering Education’s Future (ADU_ICEDU2024) / [ed] Dr. Mohammad Fteiha; Prof. Ghanem Albustami, Abu Dhabi University , 2025, s. 26-26Konferensbidrag, Muntlig presentation med publicerat abstract (Övrigt vetenskapligt)
Abstract [en]

With the increasing interest and enrollment of students in higher education, academics must spend significant time providing feedback and evaluations. This study attempts to study the use of generative artificial intelligence (GenAI) tools in assessment and giving feedback. The primary aim is to examine how effective GenAI tools are in evaluating and providing feedback, especially for open-ended text-based questions. A case study was conducted using 50 students who follow a foundation program in computing at a leading university in Sri Lanka. A proctored online examination was set up in a controlled environment, and answers were evaluated using ChatGPT, Gemini, and manual methods. The evaluation was carried out using common rubrics in all three methods mentioned above, and marks generated and given were compared using all three evaluation methods. Interestingly, the results show that compared to ChatGPT and Gemini, evaluation results are much closer to the marks manually given by using manual marking. The ChatGPT and Gemini as GenAI tools generated answers are also closer to each other. The findings prove that we can use GenAI tools effectively to evaluate structured examinations and provide feedback based on pre-defined rubrics. This will reduce the significant time taken for the evaluation and improve the productivity of academics.

Ort, förlag, år, upplaga, sidor
Abu Dhabi University , 2025. s. 26-26
Nyckelord [en]
AI-based Evaluation, GenAI tools, Open-ended Examinations, Online Examinations
Nationell ämneskategori
Systemvetenskap, informationssystem och informatik med samhällsvetenskaplig inriktning
Forskningsämne
data- och systemvetenskap
Identifikatorer
URN: urn:nbn:se:su:diva-237975OAI: oai:DiVA.org:su-237975DiVA, id: diva2:1928280
Konferens
International Conference on Education (ADU_ICEDU2024), 2 October 2024, Abu Dhabi, United Arab Emirates.
Tillgänglig från: 2025-01-16 Skapad: 2025-01-16 Senast uppdaterad: 2025-01-17Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Person

Hansson, Henrik

Sök vidare i DiVA

Av författaren/redaktören
Hansson, Henrik
Av organisationen
Institutionen för data- och systemvetenskap
Systemvetenskap, informationssystem och informatik med samhällsvetenskaplig inriktning

Sök vidare utanför DiVA

GoogleGoogle Scholar

urn-nbn

Altmetricpoäng

urn-nbn
Totalt: 145 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf