Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Explainable AI for Data-Driven Feedback and Intelligent Action Recommendations to Support Student Self-Regulation
Stockholms universitet, Samhällsvetenskapliga fakulteten, Institutionen för data- och systemvetenskap.ORCID-id: 0000-0003-2054-0971
2024 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Self-regulated learning (SRL) is a cognitive ability with demonstrable significance in facilitating students’ ability to effectively strategize, monitor, and assess their own learning actions. Studies have indicated that a lack of selfregulated learning skills negatively impacts students’ academic performance. Effective data-driven feedback and action recommendations are considered crucial for SRL and significantly influence student learning and performance. However, the task of delivering personalised feedback to every student poses a significant challenge for teachers. Moreover, the task of identifying appropriate learning activities and resources for individualised recommendations poses a significant challenge for teachers, given the large number of students enrolled in most courses.

To address these challenges, several studies have examined how learning analytics-based dashboards can support students’ self-regulation. These dashboards offered several visualisations (as feedback) on student success and failure. However, while such feedback may be beneficial, it does not offer insightful information or actionable recommendations to help students improve academically. Explainable artificial intelligence (xAI) approaches have been proposed to explain such feedback and generate insights from predictive models, with a focus on the relevant actions a student needs to take to improve in ongoing courses. Such intelligent activities could be offered to students as data-driven behavioural change recommendations.

This thesis offers an xAI-based approach that predicts course performance and computes informative feedback and actionable recommendations to promote student self-regulation. Unlike previous research, this thesis integrates a predictive approach with an xAI approach to analyse and manipulate students’ learning trajectories. The aim is to offer detailed, data-driven actionable feedback to students by providing in-depth insights and explanations for the predictions provided by the approach. The technique provides students with more practical and useful knowledge compared to the predictions alone.

The proposed approach was implemented in the form of a dashboard to support self-regulation by students in university courses, and it was evaluated to determine its effects on the students’ academic performance. The results revealed that the dashboard significantly enhanced students’ learning achievements and improved their self-regulated learning skills. Furthermore, it was found that the recommendations generated by the proposed approach positively affected students’ performance and assisted them in self-regulation.

sted, utgiver, år, opplag, sider
Stockholm: Department of Computer and Systems Sciences, Stockholm University , 2024. , s. 109
Serie
Report Series / Department of Computer & Systems Sciences, ISSN 1101-8526 ; 24-007
Emneord [en]
Self-regulated learning, Explainable artificial intelligence, Counterfactual explanations, Intelligent recommendations, Self-regulation, Informative feedback
HSV kategori
Forskningsprogram
data- och systemvetenskap
Identifikatorer
URN: urn:nbn:se:su:diva-232365ISBN: 978-91-8014-883-2 (tryckt)ISBN: 978-91-8014-884-9 (digital)OAI: oai:DiVA.org:su-232365DiVA, id: diva2:1889043
Disputas
2024-09-30, L30, NOD-huset, Borgarfjordsgatan 12, Kista, 13:00 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2024-09-05 Laget: 2024-08-14 Sist oppdatert: 2024-08-28bibliografisk kontrollert
Delarbeid
1. A Systematic Review of Software for Learning Analytics in Higher Education
Åpne denne publikasjonen i ny fane eller vindu >>A Systematic Review of Software for Learning Analytics in Higher Education
2024 (engelsk)Inngår i: International Journal of Emerging Technologies in Learning (iJET), ISSN 1868-8799, Vol. 19, nr 7, s. 17-43Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Learning analytics (LA) is an important area of research in technology-enhanced learning that has emerged during the last decade. In earlier years, several systematic reviews have been conducted that focused on the theories behind LA or on empirical studies that utilised LA-based methods to improve learning and teaching processes in higher education. However, to date, there has been no systematic review of papers that have adopted a software perspective to report on the many forms of learning analytics software (LAS) that have been developed, despite these being used more frequently than before in higher education to support learning and teaching processes. To fill this gap, this paper presents a systematic review of LAS with the aim of critically scrutinising the ways in which the use of interactive software in real-world settings may both support students in improving their academic performance and assist teachers in various pedagogical practices. A thematic analysis of 75 articles was conducted, resulting in the identification of three categories of LAS: at-risk student identification software; self-regulation software; and collaborative learning software. For each of these categories, we analysed (i) the embedded functionality; (ii) the stakeholder (teacher and student) for which the functionality is intended; (iii) the analytical and visualisation approaches implemented; and (iv) the limitations of the software that require future attention. Based on the findings of our review, we propose future directions for the development of LAS.

Emneord
learning analytics, learning analytics software, systematic review, identification of at-risk students, computer-supported collaborative learning, self-regulated learning
HSV kategori
Identifikatorer
urn:nbn:se:su:diva-232298 (URN)10.3991/ijet.v19i07.50313 (DOI)
Tilgjengelig fra: 2024-08-12 Laget: 2024-08-12 Sist oppdatert: 2025-04-10bibliografisk kontrollert
2. Generation of Automatic Data-Driven Feedback to Students Using Explainable Machine Learning
Åpne denne publikasjonen i ny fane eller vindu >>Generation of Automatic Data-Driven Feedback to Students Using Explainable Machine Learning
Vise andre…
2021 (engelsk)Inngår i: Artificial Intelligence in Education: 22nd International Conference, AIED 2021, Utrecht, The Netherlands, June 14–18, 2021, Proceedings, Part II / [ed] Ido Roll; Danielle McNamara; Sergey Sosnovsky; Rose Luckin; Vania Dimitrova, Springer , 2021, s. 37-42Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

This paper proposes a novel approach that employs learning analytics techniques combined with explainable machine learning to provide automatic and intelligent actionable feedback that supports students self-regulation of learning in a data-driven manner. Prior studies within the field of learning analytics predict students’ performance and use the prediction status as feedback without explaining the reasons behind the prediction. Our proposed method, which has been developed based on LMS data from a university course, extends this approach by explaining the root causes of the predictions and automatically provides data-driven recommendations for action. The underlying predictive model effectiveness of the proposed approach is evaluated, with the results demonstrating 90 per cent accuracy.

sted, utgiver, år, opplag, sider
Springer, 2021
Serie
Lecture Notes in Computer Science (LNCS), ISSN 0302-9743, E-ISSN 1611-3349 ; 12749
Emneord
Learning analytics, Explainable machine learning, Feedback provision, Recommendations generation, Dashboard
HSV kategori
Forskningsprogram
data- och systemvetenskap
Identifikatorer
urn:nbn:se:su:diva-200483 (URN)10.1007/978-3-030-78270-2_6 (DOI)978-3-030-78270-2 (ISBN)
Konferanse
22nd International Conference, AIED 2021, Utrecht, The Netherlands, June 14–18, 2021
Tilgjengelig fra: 2022-01-05 Laget: 2022-01-05 Sist oppdatert: 2024-08-14bibliografisk kontrollert
3. Explainable AI for Data-Driven Feedback and Intelligent Action Recommendations to Support Students Self-Regulation
Åpne denne publikasjonen i ny fane eller vindu >>Explainable AI for Data-Driven Feedback and Intelligent Action Recommendations to Support Students Self-Regulation
Vise andre…
2021 (engelsk)Inngår i: Frontiers in Artificial Intelligence, E-ISSN 2624-8212, Vol. 4, artikkel-id 723447Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Formative feedback has long been recognised as an effective tool for student learning, and researchers have investigated the subject for decades. However, the actual implementation of formative feedback practices is associated with significant challenges because it is highly time-consuming for teachers to analyse students’ behaviours and to formulate and deliver effective feedback and action recommendations to support students’ regulation of learning. This paper proposes a novel approach that employs learning analytics techniques combined with explainable machine learning to provide automatic and intelligent feedback and action recommendations that support student’s self-regulation in a data-driven manner, aiming to improve their performance in courses. Prior studies within the field of learning analytics have predicted students’ performance and have used the prediction status as feedback without explaining the reasons behind the prediction. Our proposed method, which has been developed based on LMS data from a university course, extends this approach by explaining the root causes of the predictions and by automatically providing data-driven intelligent recommendations for action. Based on the proposed explainable machine learning-based approach, a dashboard that provides data-driven feedback and intelligent course action recommendations to students is developed, tested and evaluated. Based on such an evaluation, we identify and discuss the utility and limitations of the developed dashboard. According to the findings of the conducted evaluation, the dashboard improved students’ learning outcomes, assisted them in self-regulation and had a positive effect on their motivation.

Emneord
self-regulated learning, recommender system, automatic data-driven feedback, explainable machine learning-based approach, dashboard, learning analytics, AI
HSV kategori
Forskningsprogram
data- och systemvetenskap
Identifikatorer
urn:nbn:se:su:diva-200479 (URN)10.3389/frai.2021.723447 (DOI)000751704800142 ()
Tilgjengelig fra: 2022-01-05 Laget: 2022-01-05 Sist oppdatert: 2024-08-14bibliografisk kontrollert
4. Informative Feedback and Explainable AI-Based Recommendations to Support Students' Self-regulation
Åpne denne publikasjonen i ny fane eller vindu >>Informative Feedback and Explainable AI-Based Recommendations to Support Students' Self-regulation
2024 (engelsk)Inngår i: Technology, Knowledge and Learning, ISSN 2211-1662, E-ISSN 2211-1670, Vol. 29, nr 1, s. 331-354Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Self-regulated learning is an essential skill that can help students plan, monitor, and reflect on their learning in order to achieve their learning goals. However, in situations where there is a lack of effective feedback and recommendations, it becomes challenging for students to self-regulate their learning. In this paper, we propose an explainable AI-based approach to provide automatic and intelligent feedback and recommendations that can support the self-regulation of students' learning in a data-driven manner, with the aim of improving their performance on their courses. Prior studies have predicted students' performance and have used these predicted outcomes as feedback, without explaining the reasons behind the predictions. Our proposed approach is based on an algorithm that explains the root causes behind a decline in student performance, and generates data-driven recommendations for taking appropriate actions. The proposed approach was implemented in the form of a dashboard to support self-regulation by students on a university course, and was evaluated to determine its effects on the students' academic performance. The results revealed that the dashboard significantly enhanced students' learning achievements and improved their self-regulated learning skills. Furthermore, it was found that the recommendations generated by the proposed approach positively affected students' performance and assisted them in self-regulation

Emneord
Self-regulated learning, Explainable artificial intelligence, Counterfactual explanations, Intelligent recommendations, Self-regulation, Informative feedback
HSV kategori
Identifikatorer
urn:nbn:se:su:diva-217020 (URN)10.1007/s10758-023-09650-0 (DOI)000975441100001 ()2-s2.0-85153386727 (Scopus ID)
Tilgjengelig fra: 2023-05-15 Laget: 2023-05-15 Sist oppdatert: 2025-02-18bibliografisk kontrollert
5. A Transformer-Based Approach for the Automatic Generation of Concept-Wise Exercises to Provide Personalized Learning Support to Students
Åpne denne publikasjonen i ny fane eller vindu >>A Transformer-Based Approach for the Automatic Generation of Concept-Wise Exercises to Provide Personalized Learning Support to Students
2023 (engelsk)Inngår i: Responsive and Sustainable Educational Futures: 18th European Conference on Technology Enhanced Learning, EC-TEL 2023, Aveiro, Portugal, September 4–8, 2023, Proceedings / [ed] Olga Viberg; Ioana Jivet; Pedro J. Muñoz-Merino; Maria Perifanou; Tina Papathoma, Cham: Springer, 2023, s. 16-31Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Providing personalized support to students during courses is essential to facilitate them in their desired learning goals and reduce the dropout rate. Although teachers can play an effective role in providing personalized support, achieving individual-level assistance for massive courses becomes challenging. To overcome this challenge, this paper proposes a transformer-based approach that first models students’ knowledge of various course concepts based on their performance in various assessed tasks. Afterwards, the students’ concept-wise knowledge level derived from the models is combined with the available course material, leading to the generation of personalized concept-wise exercises by employing fine-tuned Text-to-Text Transfer Transformer (T5) architecture. These generated exercises help students to improve their knowledge about different course concepts. The proposed approach has been evaluated with various university courses to determine its quality, utility and effects on students’ academic performance. The evaluation results revealed that teachers and students were satisfied with the quality of the generated exercises, and these were found to be helpful for students to improve their concept-wise understanding. Furthermore, the generated exercises positively impacted students’ academic performance. 

sted, utgiver, år, opplag, sider
Cham: Springer, 2023
Serie
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 14200
HSV kategori
Identifikatorer
urn:nbn:se:su:diva-232364 (URN)10.1007/978-3-031-42682-7_2 (DOI)2-s2.0-85171985863 (Scopus ID)978-3-031-42681-0 (ISBN)978-3-031-42682-7 (ISBN)
Konferanse
18th European Conference on Technology Enhanced Learning, (EC-TEL 2023), Aveiro, Portugal, September 4–8, 2023
Tilgjengelig fra: 2024-08-14 Laget: 2024-08-14 Sist oppdatert: 2024-09-18bibliografisk kontrollert

Open Access i DiVA

Explainable AI for Data-Driven Feedback and Intelligent Action Recommendations to Support Student Self-Regulation(4317 kB)2123 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 4317 kBChecksum SHA-512
e54280b34d8ca43581c065dcf0729df3ab94bd2ea453e185e63adcbf2155b7d9e2e89c46b32aebb1e5f1ac474dbeb560c6e0fab9a1a70e603a7fcbe090c4d7d8
Type fulltextMimetype application/pdf

Person

Afzaal, Muhammad

Søk i DiVA

Av forfatter/redaktør
Afzaal, Muhammad
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 2123 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

isbn
urn-nbn

Altmetric

isbn
urn-nbn
Totalt: 2121 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf