Content area

Abstract

Stochastic curtailment (SC) is a statistical procedure that was originally developed to enhance the efficiency of clinical trials. It has been applied to psychological testing, but to sequential mastery testing only (Finkelman, 2008, 2010). This study adapted the method to detect low-precision examinees (i.e., examinees whose final standard error of measurement (FSEM) at the end of a full-length test could not reach the pre-specified SEM termination level) in measurement computerized adaptive tests (CATs). Using central limit approximations, the study developed a method to estimate the distribution of test information at maximum test length and the corresponding FSEM. The study also developed a hypothesis testing procedure to implement SC. Using monte-carlo simulations, the study found that (1) the FSEM estimation procedure performed well in the middle range of 𝜃 values but less so at extreme 𝜃 values; (2) the SC procedure had good predictive accuracy, with excellent performance on positive predictive values and good performance on true positive rates and false positive rates; (3) the reduction in test length was substantial. Overall, the study showed that SC is a promising procedure to identify low-precision examinees and enhance efficiency in measurement CATs. A guide on implementing SC is provided.

Details

1010268
Title
Stochastic Curtailment: A New Approach to Improve Efficiency in Computerized Adaptive Tests
Number of pages
169
Publication year
2024
Degree date
2024
School code
0130
Source
DAI-B 86/2(E), Dissertation Abstracts International
ISBN
9798383703953
Committee member
Li, Xiao'ou; Wang, Chun; Marcoulides, Katerina M.
University/institution
University of Minnesota
Department
Psychology
University location
United States -- Minnesota
Degree
Ph.D.
Source type
Dissertation or Thesis
Language
English
Document type
Dissertation/Thesis
Dissertation/thesis number
31331107
ProQuest document ID
3095883270
Document URL
https://www.proquest.com/dissertations-theses/stochastic-curtailment-new-approach-improve/docview/3095883270/se-2?accountid=208611
Copyright
Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works.
Database
ProQuest One Academic