Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Digital technology and assessment validity: Exploring utilisation schemes for a basic spreadsheet tool used in PISA 2022
Stockholm University, Faculty of Humanities, Department of Teaching and Learning.ORCID iD: 0000-0001-9957-3658
Stockholm University, Faculty of Humanities, Department of Teaching and Learning.ORCID iD: 0000-0002-9676-9521
Stockholm University, Faculty of Humanities, Department of Teaching and Learning.ORCID iD: 0000-0003-1975-7778
Number of Authors: 32026 (English)In: Digital Technology and Artificial Intelligence in Mathematics Education Assessment / [ed] Eirini Geraniou; Cosette Crisan; Manolis Mavrikis, Abingdon: Routledge, 2026, p. 37-54Chapter in book (Refereed)
Abstract [en]

With the ongoing digital development of society, an increasing number of digital tools are being utilised when learning mathematics. Therefore, assessment situations should also incorporate digital tools. International large-scale assessments, such as the PISA study, are recent examples of this trend. However, a significant problem – still to be explored – concerns validity issues that emerge when new digital tools are included in assessments. In PISA 2022, digital items that mandated students to sort data and perform calculations directly in a spreadsheet tool were introduced. This study investigates the technical and conceptual aspects students must develop to use this tool productively, the training provided to students, and the implications for assessment validity. By analysing the training in relation to the tool use required to solve the task, we identify a critical conceptual tool-related aspect that is missing. Drawing on the instrumental approach, we argue that this aspect is fundamental to the emergence of an instrumental genesis. The gap between the training provided and what is needed to solve the task is interpreted as a potential compromise to assessment validity, which we further elaborate on in the discussion. This chapter addresses the broader issue of validity related to technology use in large-scale assessments.

Place, publisher, year, edition, pages
Abingdon: Routledge, 2026. p. 37-54
Series
New Perspectives on Research in Mathematics Education – ERME series ; 7
Keywords [en]
Mathematics education, digital assessment, validity, instrumental approach, PISA, spreadsheets
National Category
Didactics
Research subject
Mathematics Education
Identifiers
URN: urn:nbn:se:su:diva-252233DOI: 10.4324/9781003533764-3Scopus ID: 2-s2.0-105029001069ISBN: 978-1-032-87653-5 (print)ISBN: 978-1-032-87652-8 (print)ISBN: 978-1-003-53376-4 (electronic)OAI: oai:DiVA.org:su-252233DiVA, id: diva2:2036725
Available from: 2026-02-09 Created: 2026-02-09 Last updated: 2026-02-11Bibliographically approved
In thesis
1. Students’ mathematical digital competence in assessment: Validity considerations in the instrumental use of spreadsheet tools
Open this publication in new window or tab >>Students’ mathematical digital competence in assessment: Validity considerations in the instrumental use of spreadsheet tools
2026 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This thesis explores the opportunities and challenges of incorporating digital tools into summative assessments in mathematics. While technological developments have led to an increasing integration of digital tools into mathematics teaching and learning, there is a lack of understanding of how specific tools can be responsibly incorporated into assessments without compromising their validity. Accordingly, the aim of this thesis is to investigate and discuss what is assessed and what key considerations emerge when integrating digital tools into summative digital assessment of mathematics. Focusing on spreadsheet tools, the thesis employs an instrumental theoretical approach and the concept of instrumental genesis to analyze students’ techniques and mental schemes. Michael Kane’s argument-based validation framework is used to evaluate the plausibility of validity claims. The four studies included draw on both numerical and non-numerical data. Study I examines test developers’ perspectives on digital mathematics assessments, suggesting that digital test formats can enhance validity by enabling new constructs, while simultaneously introducing validity threats, particularly in the presentation of mathematical reasoning. Study II examines students’ interactions with spreadsheet tools, showing that prior tool knowledge cannot be assumed and that opportunities for practice are vital for assessment validity. Study III uses PISA 2022 data to analyze the technical and conceptual demands of spreadsheet tool use, demonstrating that technical skills alone are insufficient; productive tool use also requires conceptual understanding of both the tool use and related mathematics. Study IV, also using PISA 2022 data and applying explanatory item-response modeling, demonstrates that spreadsheet tool items are generally more challenging than items without such functionality and that students’ familiarity with spreadsheets may reduce the likelihood of a correct response. Overall, the thesis concludes that assessment validity depends on the alignment between learning and assessment, including opportunities to develop both technical and conceptual aspects of digital tool use. Achieving a relevant balance between tool authenticity and accessibility emerges as a central design challenge for valid digital mathematics assessment.

Place, publisher, year, edition, pages
Stockholm: Department of Teaching and Learning, Stockholm University, 2026. p. 95
Keywords
Mathematics education, digital summative assessment, validity, argument-based validation, instrumental approach, mathematical digital competence in assessment, PISA, spreadsheet tools, digital tool use
National Category
Didactics
Research subject
Mathematics Education
Identifiers
urn:nbn:se:su:diva-252246 (URN)978-91-8107-516-8 (ISBN)978-91-8107-517-5 (ISBN)
Public defence
2026-03-27, G-salen, Svante Arrhenius väg 22 C, and online via Zoom, public link is available at the department website, Stockholm, 14:00 (English)
Opponent
Supervisors
Funder
Swedish Research Council, 2021-00540
Available from: 2026-03-04 Created: 2026-02-11 Last updated: 2026-02-24Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Winnberg, MattiasSollerman, SamuelVan Steenbrugge, Hendrik

Search in DiVA

By author/editor
Winnberg, MattiasSollerman, SamuelVan Steenbrugge, Hendrik
By organisation
Department of Teaching and Learning
Didactics

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 138 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf