Title page for ETD etd-07312007-170614


Type of Document Master's Thesis
Author Rose, Richard Travis
Author's Email Address rtrose@vt.edu
URN etd-07312007-170614
Title MacVisSTA: A System for Multimodal Analysis of Human Communication and Interaction
Degree Master of Science
Department Computer Science
Advisory Committee
Advisor Name Title
Quek, Francis K. H. Committee Chair
Fox, Edward Alan Committee Member
North, Christopher L. Committee Member
Keywords
  • Imagery and Video Analysis
  • Information Access
  • Visualization
Date of Defense 2007-07-27
Availability unrestricted
Abstract
The study of embodied communication requires access to multiple data sources such as multistream video and audio, various derived and meta-data such as gesture, head, posture, facial expression and gaze information. This thesis presents the data collection, annotation, and analysis for multiple participants engaged in planning meetings. In support of the analysis tasks, this thesis presents the multimedia Visualization for Situated Temporal Analysis for Macintosh (MacVisSTA) system. It supports the analysis of multimodal human communication through the use of video, audio, speech transcriptions, and gesture and head orientation data. The system uses a multiple linked representation strategy in which different representations are linked by the current time focus. MacVisSTA supports analysis of the synchronized data at varying timescales for coarse-to-fine observational studies. The hybrid architecture may be extended through plugins. Finally, this effort has resulted in encoding of behavioral and language data, enabling collaborative research and embodying it with the aid of, and interface to, a database management system.
Files
  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  20080809-rtrose-thesis.pdf 3.37 Mb 00:15:35 00:08:00 00:07:00 00:03:30 00:00:17

Browse All Available ETDs by ( Author | Department )

dla home
etds imagebase journals news ereserve special collections
virgnia tech home contact dla university libraries

If you have questions or technical problems, please Contact DLA.