Title page for ETD etd-11182009-110003


Type of Document Dissertation
Author Harrell, Leigh Michelle
Author's Email Address leighh@vt.edu
URN etd-11182009-110003
Title Accuracy of Global Fit Indices as Indictors of Multidimensionality in Multidimensional Rasch Analysis
Degree PhD
Department Educational Leadership and Policy Studies
Advisory Committee
Advisor Name Title
Skaggs, Gary E. Committee Chair
Wolfe, Edward W. Committee Co-Chair
Miyazaki, Yasuo Committee Member
Terrell, George R. Committee Member
Keywords
  • confirmatory factor analysis
  • Rasch analysis
  • model selection
  • global fit indices
  • BIC
  • AIC
Date of Defense 2009-10-28
Availability unrestricted
Abstract
Most research on confirmatory factor analysis using global fit indices (AIC, BIC, AICc, and CAIC) has been in the structural equation modeling framework. Little research has been done concerning application of these indices to item response models, especially within the framework of multidimensional Rasch analysis. The results of two simulations studies that investigated how sample size, between-dimension correlation, and test length affect the accuracy of these indices in model recovery using a multidimensional Rasch analysis are described in this dissertation. The first study analyzed dichotomous data, with model-to-data misfit as an additional independent variable. The second study analyzed polytomous data, with rating scale structure as an additional independent variable. The interaction effect between global fit index and between-dimension correlation had very large effect sizes in both studies. At higher values of between-dimension correlation, AIC indicated the correct two-dimension generating structure slightly more often than does the BIC or CAIC. The correlation by test length interaction had an odds ratio indicating practical importance in the polytomous study but not the dichotomous study. The combination of shorter tests and higher correlations resulted in a difficult-to-detect distinction being modeled with less statistical information. The correlation by index interaction in the dichotomous study had an odds ratio indicating practical importance. As expected, the results demonstrated that violations of the Rasch model assumptions are magnified at higher between-dimension correlations. Recommendations for practitioners working with highly correlated multidimensional data include creating moderate length (roughly 40 items) instruments, minimizing data-to-model misfit in the choice of model used for confirmatory factor analysis (MRCMLM or other MIRT models), and making decisions based on multiple global indices instead of depending on one index in particular.
Files
  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  Harrell_LM_D_2009.pdf 425.28 Kb 00:01:58 00:01:00 00:00:53 00:00:26 00:00:02

Browse All Available ETDs by ( Author | Department )

dla home
etds imagebase journals news ereserve special collections
virgnia tech home contact dla university libraries

If you have questions or technical problems, please Contact DLA.