Applying the Internal Referencing Strategy to the Evaluation of Transfer of Training in Field Settings.
AIR FORCE INST OF TECH WRIGHT-PATTERSON AFB OH
Pagination or Media Count:
Training evaluation is the determination of the effectiveness of a training program. While training researchers and practitioners generally prefer the use of an experimental research design to infer training effectiveness, practical constraints inherent in field settings often require that they employ a less rigorous quasi-experimental design. This paper evaluates a managerial training program in a field setting using the Internal Referencing Strategy IRS, a quasi-experimental research design that infers training effectiveness when trainee pretest-posttest change on training-relevant test items is greater than pretest-posttest change on training-irrelevant test items. One hundred and eighty-two managers experienced a managerial training course and provided pretest and posttest data. Trainee learning was assessed using a 20-item multiple choice knowledge test and trainee transfer of training was assessed using a 15-item behavioral questionnaire. An analysis of the evaluative data provided some evidence of learning, and demonstrated transfer of training after items exhibiting ceiling effects were excluded from the analysis. Implications regarding the use of the IRS approach in training evaluation are discussed.
- Administration and Management
- Personnel Management and Labor Relations