Title page for ETD etd-11202009-224547


Type of Document Dissertation
Author McGill, Michael T.
Author's Email Address mcgillm@vt.edu
URN etd-11202009-224547
Title An Investigation of Unidimensional Testing Procedures under Latent Trait Theory using Principal Component Analysis
Degree PhD
Department Educational Leadership and Policy Studies
Advisory Committee
Advisor Name Title
Skaggs, Gary E. Committee Co-Chair
Wolfe, Edward W. Committee Co-Chair
Miyazaki, Yasuo Committee Member
Morgan, John P. Committee Member
Keywords
  • Unidimensionality
  • Principal Component Analysis
  • Dimensionality
  • Measurement
  • IRT
  • Item Resonse THeory
  • Rasch
Date of Defense 2009-10-28
Availability unrestricted
Abstract
There are several generally accepted rules for detecting unidimensionality, but none are well tested. This simulation study investigated well-known methods, including but not limited to, the Kaiser (k>1) Criterion, Percentage of Measure Validity (greater than 50%, 40%, or 20%), Ratio of Eigenvalues, and Kelley method, and compares these methods to each other and a new method proposed by the author (McGill method) for assessing unidimensionality. After applying principal component analysis (PCA) to the residuals of a Latent Trait Test Theory (LTTT) model, this study was able to address three purposes: determining the Type I error rates associated with various criterion values, for assessing unidimensionality; determining the Type II error rates and statistical power associated with various rules of thumb when assessing dimensionality; and, finally, determining whether more suitable criterion values could be established for the methods of the study by accounting for various characteristics of the measurement context. For those methods based on criterion values, new modified values are proposed. For those methods without criterion values for dimensionality decisions, criterion values are modeled and presented.

The methods compared in this study were investigated using PCA on residuals from the Rasch model. The sample size, test length, ability distribution variability, and item distribution variability were varied and the resulting Type I and Type II error rates of each method were examined.

The results imply that certain conditions can cause improper diagnoses as to the dimensionality of instruments. Adjusted methods are suggested to induce a more stable condition relative to the Type I and Type II error rates. The nearly ubiquitous Kaiser method was found to be biased towards signaling multidimensionality whether it exists or not. The modified version of the Kaiser method and the McGill method, proposed by the author were shown to be among the best at detecting unidimensionality when it was present. In short, methods that take into account changes in variables such as sample size, test length, item variability, and person variability are better than methods that use a single, static criterionvalue in decision making with respect to dimensionality.

Files
  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  Lastone.pdf 2.01 Mb 00:09:18 00:04:47 00:04:11 00:02:05 00:00:10

Browse All Available ETDs by ( Author | Department )

dla home
etds imagebase journals news ereserve special collections
virgnia tech home contact dla university libraries

If you have questions or technical problems, please Contact DLA.