Title page for ETD etd-05182007-214843


Type of Document Master's Thesis
Author Findlay, Rolanda A.
Author's Email Address rfindlay@vt.edu
URN etd-05182007-214843
Title The Development of a Hybrid Scoring Key for a Situational Judgment Test Designed for Training Evaluation
Degree Master of Science
Department Psychology
Advisory Committee
Advisor Name Title
Hauenstein, Neil M. A. Committee Chair
Cooper, Lee D. Committee Member
Foti, Roseanne J. Committee Member
Keywords
  • Scoring Key
  • Training Evaluation
  • Situational Judgment Test
Date of Defense 2007-04-20
Availability restricted
Abstract
As a low fidelity work simulation, Situational Judgment Tests (SJTs) are an affordable and practical way of empirically linking training and on-the-job performance, thereby providing a viable means of evaluating training effectiveness. An issue, when utilizing SJTs, is deciding the appropriate manner in which the SJT should be scored. Traditional SJT scoring methodologies, while successfully utilized for selection and prediction, pose specific challenges when applied to a SJT designed to evaluate the effectiveness of a training program.

This study discusses the shortcomings of traditional SJT scoring methodologies when used in the evaluation context. To overcome these challenges, an innovative scoring methodology, the Hybrid methodology, is presented. This study provides the detailed description of the Hybrid scoring key creation, and compares the Hybrid scoring key with two traditional scoring keys (Subject Matter Expert (SME) and Respondent-based scoring keys). Responses from a military training program are utilized to illustrate the distinctive effects of using the three different scoring approaches. The superiority of the hybrid scoring key, due to increased confidence in the key’s accuracy, and findings regarding training evaluation are discussed. Future research directions and practical applications of the research are also discussed.

Files
  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
[VT] RFindlay_thesis.pdf 371.82 Kb 00:01:43 00:00:53 00:00:46 00:00:23 00:00:01
[VT] indicates that a file or directory is accessible from the Virginia Tech campus network only.

Browse All Available ETDs by ( Author | Department )

dla home
etds imagebase journals news ereserve special collections
virgnia tech home contact dla university libraries

If you have questions or technical problems, please Contact DLA.