Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Discrimination with unidimensional and multidimensional item response theory models for educational data
Stockholms universitet, Samhällsvetenskapliga fakulteten, Statistiska institutionen.ORCID-id: 0000-0003-2889-0263
Stockholms universitet, Samhällsvetenskapliga fakulteten, Statistiska institutionen.ORCID-id: 0000-0003-4161-7851
2022 (engelsk)Inngår i: Communications in statistics. Simulation and computation, ISSN 0361-0918, E-ISSN 1532-4141, Vol. 51, nr 6, s. 2992-3012Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Achievement tests are used to characterize the proficiency of higher-education students. Item response theory (IRT) models are applied to these tests to estimate the ability of students (as latent variable in the model). In order for quality IRT parameters to be estimated, especially ability parameters, it is important that the appropriate number of dimensions is identified. Through a case study, based on a statistics exam for students in higher education, we show how dimensions and other model parameters can be chosen in a real situation. Our model choice is based both on empirical and on background knowledge of the test. We show that dimensionality influences the estimates of the item-parameters, especially the discrimination parameter which provides information about the quality of the item. We perform a simulation study to generalize our conclusions. Both the simulation study and the case study show that multidimensional models have the advantage to better discriminate between examinees. We conclude from the simulation study that it is safer to use a multidimensional model compared to a unidimensional if it is unknown which model is the correct one.

sted, utgiver, år, opplag, sider
2022. Vol. 51, nr 6, s. 2992-3012
Emneord [en]
Achievement tests, Discrimination, Multidimensional four parameter logistic model, Multidimensional graded response model, Multidimensional item response theory
HSV kategori
Forskningsprogram
statistik
Identifikatorer
URN: urn:nbn:se:su:diva-177401DOI: 10.1080/03610918.2019.1705344ISI: 000504938300001Scopus ID: 2-s2.0-85078600822OAI: oai:DiVA.org:su-177401DiVA, id: diva2:1382776
Tilgjengelig fra: 2020-01-05 Laget: 2020-01-05 Sist oppdatert: 2022-09-27bibliografisk kontrollert
Inngår i avhandling
1. Achievement tests and optimal design for pretesting of questions
Åpne denne publikasjonen i ny fane eller vindu >>Achievement tests and optimal design for pretesting of questions
2019 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Achievement tests are used to measure the students' proficiency in a particular knowledge. Computerized achievement tests (e.g. GRE and SAT) are usually based on questions available in an item bank to measure the proficiency of students. An item bank is a large collection of items with known characteristics (e.g. difficulty). Item banks are continuously updated and revised with new items in place of obsolete, overexposed or flawed items over time. This thesis is devoted to updating and maintaining the item bank with high-quality questions and better estimations of item parameters (item calibration). 

The thesis contains four manuscripts. One paper investigates the impact of student ability dimensionality on the estimated parameters and the other three deal with item calibration.

In the first paper, we investigate how the ability dimensionality influences the estimates of the item-parameters. By a case and simulation study, we found that a multidimensional model better discriminates among the students.

The second paper describes a method for optimal item calibration by efficiently selecting the examinees based on their ability levels. We develop an algorithm which selects intervals for the students' ability levels for optimal calibration of the items. We also develop an equivalence theorem for item calibration to verify the optimal design.  

The algorithm developed in Paper II becomes complicated with the increase of number of calibrated items. So, in Paper III we develop a new exchange algorithm based on the equivalence theorem developed in Paper II.

Finally, the fourth paper generalizes the exchange algorithm described in Paper III by assuming that the students have multidimensional abilities to answer the questions.

sted, utgiver, år, opplag, sider
Department of Statistics, Stockholm University, 2019. s. 26
Emneord
Achievement test, Equivalence theorem, Exchange algorithm, Item calibration, Item response theory model, Optimal experimental design
HSV kategori
Forskningsprogram
statistik
Identifikatorer
urn:nbn:se:su:diva-174079 (URN)978-91-7797-879-4 (ISBN)978-91-7797-880-0 (ISBN)
Disputas
2019-11-15, William-Olssonsalen, Geovetenskapens hus, Svante Arrhenius väg 14, floor 1, Stockholm, 10:00 (engelsk)
Opponent
Veileder
Merknad

At the time of the doctoral defense, the following papers were unpublished and had a status as follows: Paper 1: Manuscript. Paper 3: Manuscript. Paper 4: Manuscript.

Tilgjengelig fra: 2019-10-23 Laget: 2019-10-02 Sist oppdatert: 2022-02-26bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Person

ul Hassan, MahmoodMiller, Frank

Søk i DiVA

Av forfatter/redaktør
ul Hassan, MahmoodMiller, Frank
Av organisasjonen
I samme tidsskrift
Communications in statistics. Simulation and computation

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 336 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf