Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The Use of Generative AI Tools in Assessing Open-ended Text-based Examinations
(NSBM Green University.
NSBM Green University.
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.ORCID iD: 0000-0003-1153-1870
Number of Authors: 32025 (English)In: The International Conference on Education: Pioneering Education’s Future (ADU_ICEDU2024) / [ed] Dr. Mohammad Fteiha; Prof. Ghanem Albustami, Abu Dhabi University , 2025, p. 26-26Conference paper, Oral presentation with published abstract (Other academic)
Abstract [en]

With the increasing interest and enrollment of students in higher education, academics must spend significant time providing feedback and evaluations. This study attempts to study the use of generative artificial intelligence (GenAI) tools in assessment and giving feedback. The primary aim is to examine how effective GenAI tools are in evaluating and providing feedback, especially for open-ended text-based questions. A case study was conducted using 50 students who follow a foundation program in computing at a leading university in Sri Lanka. A proctored online examination was set up in a controlled environment, and answers were evaluated using ChatGPT, Gemini, and manual methods. The evaluation was carried out using common rubrics in all three methods mentioned above, and marks generated and given were compared using all three evaluation methods. Interestingly, the results show that compared to ChatGPT and Gemini, evaluation results are much closer to the marks manually given by using manual marking. The ChatGPT and Gemini as GenAI tools generated answers are also closer to each other. The findings prove that we can use GenAI tools effectively to evaluate structured examinations and provide feedback based on pre-defined rubrics. This will reduce the significant time taken for the evaluation and improve the productivity of academics.

Place, publisher, year, edition, pages
Abu Dhabi University , 2025. p. 26-26
Keywords [en]
AI-based Evaluation, GenAI tools, Open-ended Examinations, Online Examinations
National Category
Information Systems, Social aspects
Research subject
Computer and Systems Sciences
Identifiers
URN: urn:nbn:se:su:diva-237975OAI: oai:DiVA.org:su-237975DiVA, id: diva2:1928280
Conference
International Conference on Education (ADU_ICEDU2024), 2 October 2024, Abu Dhabi, United Arab Emirates.
Available from: 2025-01-16 Created: 2025-01-16 Last updated: 2025-01-17Bibliographically approved

Open Access in DiVA

No full text in DiVA

Authority records

Hansson, Henrik

Search in DiVA

By author/editor
Hansson, Henrik
By organisation
Department of Computer and Systems Sciences
Information Systems, Social aspects

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 139 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf