Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Automatic question-answer pairs generation using pre-trained large language models in higher education
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.ORCID iD: 0000-0003-2054-0971
2024 (English)In: Computers and Education: Artificial Intelligence, E-ISSN 2666-920X, Vol. 6, article id 100252Article in journal (Refereed) Published
Abstract [en]

The process of manually generating question and answer (QA) pairs for assessments is known to be a time-consuming and energy-intensive task for teachers, specifically in higher education. Several studies have proposed various methods utilising pre-trained large language models for the generation of QA pairs. However, it is worth noting that these methods have primarily been evaluated on datasets that are not specifically educational in nature. Furthermore, the evaluation metrics and strategies employed in these studies differ significantly from those typically used in educational contexts. The present discourse fails to present a compelling case regarding the efficacy and practicality of stated methods within the context of higher education. This study aimed to examine multiple QA pairs generation approaches in relation to their performance and the efficacy and constraints within the context of higher education. The various approaches encompassed in this study comprise pipeline, joint, multi-task approach. The performance of these approaches under consideration was assessed on three datasets related to distinct courses. The evaluation integrates three automated methods, teacher assessments, and real-world educational evaluations to provide a comprehensive analysis. The comparison of various approaches was conducted by directly assessing their performance using the average scores of different automatic metrics on three datasets. The results of the teachers and real educational evaluation indicate that the assessments generated were beneficial in enhancing the understanding of concepts and overall performance of students. The implications of the findings from this study hold significant importance in enhancing the efficacy of QA pair generation tools within the context of higher education.

Place, publisher, year, edition, pages
2024. Vol. 6, article id 100252
Keywords [en]
Pre-trained language model, Question-answer pairs generation, Higher education, Automatic evaluation, Real-educational evaluation
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:su:diva-232297DOI: 10.1016/j.caeai.2024.100252Scopus ID: 2-s2.0-85195464342OAI: oai:DiVA.org:su-232297DiVA, id: diva2:1888261
Available from: 2024-08-12 Created: 2024-08-12 Last updated: 2026-03-18Bibliographically approved

Open Access in DiVA

fulltext(3640 kB)325 downloads
File information
File name FULLTEXT01.pdfFile size 3640 kBChecksum SHA-512
c48cd9c23fb3a1d09a9d84f28afac3da704f055a26ac2e98a3bcc338280233cc067950b2b2ab1366dec5df904491c3b66cee8f3b9d02c82d8013c253b14f52ec
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopushttps://doi.org/10.1016/j.caeai.2024.100252

Authority records

Afzaal, Muhammad

Search in DiVA

By author/editor
Afzaal, Muhammad
By organisation
Department of Computer and Systems Sciences
In the same journal
Computers and Education: Artificial Intelligence
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 325 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 340 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf