Sep 22 – 25, 2024
Noto (SR)
Europe/Rome timezone

Test length doesn’t matter: An intelligent procedure for item selection in Item Response Theory

Sep 24, 2024, 12:00 PM
10m
Aula Magna Giavanti

Aula Magna Giavanti

Mini-talks Mini-talks

Speaker

Ottavia M. Epifania (University of Padova)

Description

Item Response Theory (IRT) provides the ideal framework for generating short test forms (STFs) from item banks or from full-length tests thanks to the possibility of obtaining detailed information on the precision with which each item measures the latent trait. As such, the most precise items can be selected for inclusion in the STF and the number of items can be minimized while the measurement precision can be maximized. The usual procedure for developing STFs is based on the visual inspection of item and test information functions (IIFs and TIFs) to find the items that best contribute to make up a STF with the desired characteristics. This contribution presents a new procedure that aims at automating this process by defining a target TIF and finding the items from the item bank that best recover it. The algorithm directly compares the distance between the target TIF and a temporary TIF obtained by adding an item at a time. The items are chosen according to their closeness to the location on the latent trait where the distance between the target and the temporary TIFs is maximized. The algorithm stops when the addition of a new item does not reduce the distance between target and temporary TIFs. The procedure can be applied both when the length of the STF is defined a priori and when the aim is to find the optimal number of items. The results of the application of this procedure are presented.

Primary authors

Ottavia M. Epifania (University of Padova) Prof. Pasquale Anselmi (Università di Padova) Prof. Egidio Robusto (Università di Padova)

Presentation materials

There are no materials yet.