Accession Number : AD1030353

Title :   Effectiveness of Intelligent Tutoring Systems: A Meta Analytic Review

Descriptive Note : Technical Report,01 Mar 2016,01 Mar 2016

Corporate Author : Institute for Defense Analyses Alexandria United States

Personal Author(s) : Kulik,James A ; Fletcher,J D

Full Text :

Report Date : 01 Feb 2017

Pagination or Media Count : 41

Abstract : This review describes a meta-analysis of findings from 50 controlled evaluations of intelligent computer tutoring systems. The median effect of intelligent tutoring in the 50 evaluations was to raise test scores 0.66 standard deviations over conventional levels, or from the 50th to the 75th percentile. However, the amount of improvement found in an evaluation depended to a great extent on whether improvement was measured on locally developed or standardized tests, suggesting that alignment of test and instructional objectives is a critical determinant of evaluation results. The review also describes findings from two groups of evaluations that did not meet all of the selection requirements for the meta-analysis: six evaluations with nonconventional control groups and four with flawed implementations of intelligent tutoring systems. Intelligent tutoring effects in these evaluations were small, suggesting that evaluation results are also affected by the nature of control treatments and the adequacy of program implementations.

Descriptors :   computer simulations , databases , educational technology , military training , regression analysis , experimental design , test and evaluation , instructions , education

Subject Categories : Computer Programming and Software

Distribution Statement : APPROVED FOR PUBLIC RELEASE