Modeling Item Responses When Different Subjects Employ Different Solution Strategies.
EDUCATIONAL TESTING SERVICE PRINCETON NJ
Pagination or Media Count:
A model is presented for item responses when different examinees employ different strategies to arrive at their answers, and when only those answers, not choice of strategy or subtask results, can be observed. Using substantive theory to differentiate the likelihoods of response vectors under a fixed set of solution strategies, the authors model responses in terms of item parameters associated with each strategy, proportions of the population employing each, and the distributions of examinee parameters within each. Posterior distributions can then be obtained for each examinee, giving the probabilities that they employed each of the strategies and their proficiency under each. The ideas are illustrated with a conceptual example about response strategies for spatial rotation items, and a numerical example resolving a population of examinees into subpopulations of valid responders and random guessers. Keywords Item response theory Linear logistic test model Mixture models.
- Statistics and Probability