Type of Document Dissertation Author Lee, Joo Hong URN etd-09062012-201814 Title Hybrid Parallel Computing Strategies for Scientific Computing Applications Degree PhD Department Electrical and Computer Engineering Advisory Committee
Advisor Name Title Plassmann, Paul E. Committee Chair Abbott, A. Lynn Committee Member Beattie, Christopher A. Committee Member Jones, Mark T. Committee Member Martin, Thomas L. Committee Member Keywords
- Parallel Programming
- GPU Acceleration
- Scientific Computing
- Biological Systems Simulation
- Hybrid Algorithms
- Parallel Monte Carlo Algorithms
- Hybrid Computing
- Radiative Heat Transfer
- Multi-threaded Software Performance
Date of Defense 2012-08-29 Availability unrestricted AbstractMulti-core, multi-processor, and Graphics Processing Unit (GPU) computer architectures pose significant challenges with respect to the efficient exploitation of parallelism for large-scale, scientific computing simulations. For example, a simulation of the human tonsil at the cellular level involves the computation of the motion and interaction of millions of cells over extended periods of time. Also, the simulation of Radiative Heat Transfer (RHT) effects by the Photon Monte Carlo (PMC) method is an extremely computationally demanding problem. The PMC method is example of the Monte Carlo simulation method⎯an approach extensively used in wide of application areas. Although the basic algorithmic framework of these Monte Carlo methods is simple, they can be extremely computationally intensive. Therefore, an efficient parallel realization of these simulations depends on a careful analysis of the nature these problems and the development of an appropriate software framework. The overarching goal of this dissertation is develop and understand what the appropriate parallel programming model should be to exploit these disparate architectures, both from the metric of efficiency, as well as from a software engineering perspective.
In this dissertation we examine these issues through a performance study of PathSim2, a software framework for the simulation of large-scale biological systems, using two different parallel architectures⎯distributed and shared memory. First, a message-passing implementation of a multiple germinal center simulation by PathSim2 is developed and analyzed for distributed memory architectures. Second, a germinal center simulation is implemented on shared memory architecture with two parallelization strategies based on Pthreads and OpenMP.
Finally, we present work targeting a complete hybrid, parallel computing architecture. With this work we develop and analyze a software framework for generic Monte Carlo simulations implemented on multiple, distributed memory nodes consisting of a multi-core architecture with attached GPUs. This simulation framework is divided into two asynchronous parts: (a) a threaded, GPU-accelerated pseudo-random number generator (or producer), and (b) a multi-threaded Monte Carlo application (or consumer). The advantage of this approach is that this software framework can be directly used within any Monte Carlo application code, without requiring application-specific programming of the GPU. We examine this approach through a performance study of the simulation of RHT effects by the PMC method on a hybrid computing architecture. We present a theoretical analysis of our proposed approach, discuss methods to optimize performance based on this analysis, and compare this analysis to experimental results obtained from simulations run on two different hybrid, parallel computing architectures.
Filename Size Approximate Download Time (Hours:Minutes:Seconds)
28.8 Modem 56K Modem ISDN (64 Kb) ISDN (128 Kb) Higher-speed Access Lee_J_D_2012.pdf 3.01 Mb 00:13:56 00:07:10 00:06:16 00:03:08 00:00:16
If you have questions or technical problems, please Contact DLA.