Type of Document Master's Thesis Author Findlay, Rolanda A. Author's Email Address firstname.lastname@example.org URN etd-05182007-214843 Title The Development of a Hybrid Scoring Key for a Situational Judgment Test Designed for Training Evaluation Degree Master of Science Department Psychology Advisory Committee
Advisor Name Title Hauenstein, Neil M. A. Committee Chair Cooper, Lee D. Committee Member Foti, Roseanne J. Committee Member Keywords
- Scoring Key
- Training Evaluation
- Situational Judgment Test
Date of Defense 2007-04-20 Availability restricted AbstractAs a low fidelity work simulation, Situational Judgment Tests (SJTs) are an affordable and practical way of empirically linking training and on-the-job performance, thereby providing a viable means of evaluating training effectiveness. An issue, when utilizing SJTs, is deciding the appropriate manner in which the SJT should be scored. Traditional SJT scoring methodologies, while successfully utilized for selection and prediction, pose specific challenges when applied to a SJT designed to evaluate the effectiveness of a training program.
This study discusses the shortcomings of traditional SJT scoring methodologies when used in the evaluation context. To overcome these challenges, an innovative scoring methodology, the Hybrid methodology, is presented. This study provides the detailed description of the Hybrid scoring key creation, and compares the Hybrid scoring key with two traditional scoring keys (Subject Matter Expert (SME) and Respondent-based scoring keys). Responses from a military training program are utilized to illustrate the distinctive effects of using the three different scoring approaches. The superiority of the hybrid scoring key, due to increased confidence in the key’s accuracy, and findings regarding training evaluation are discussed. Future research directions and practical applications of the research are also discussed.
Filename Size Approximate Download Time (Hours:Minutes:Seconds)
28.8 Modem 56K Modem ISDN (64 Kb) ISDN (128 Kb) Higher-speed Access RFindlay_thesis.pdf 371.82 Kb 00:01:43 00:00:53 00:00:46 00:00:23 00:00:01indicates that a file or directory is accessible from the Virginia Tech campus network only.
If you have questions or technical problems, please Contact DLA.