A Bridging Model for Parallel Computation

A Bridging Model for Parallel Computation

August 1990 | Leslie G. Valiant
The article introduces the Bulk-Synchronous Parallel (BSP) model as a potential bridge between software and hardware for parallel computation, similar to the von Neumann model for sequential computation. The author argues that the BSP model can facilitate the widespread adoption of parallel computing by providing a standard that is efficient in both high-level language implementation and hardware implementation. The BSP model is characterized by three key attributes: components performing processing and memory functions, a router for point-to-point message delivery, and a synchronization mechanism that ensures regular intervals for global checks. The model is designed to be flexible, allowing for single and multiple instruction streams, and can be implemented on various technologies, including packet-switching networks and optical crossbars. The article provides quantitative results demonstrating the efficiency of the BSP model in implementing high-level language features, algorithms, and hardware simulations, with a focus on achieving optimal simulations within constant multiplicative factors. The BSP model is particularly advantageous for programs with sufficient parallel slackness, where the number of virtual processors is larger than the number of physical processors, and it can support automatic memory and communication management through hashing and replication techniques. The author concludes that the BSP model is a promising candidate for bridging the gap between software and hardware in parallel computing, offering a practical and efficient solution for a wide range of computational tasks.The article introduces the Bulk-Synchronous Parallel (BSP) model as a potential bridge between software and hardware for parallel computation, similar to the von Neumann model for sequential computation. The author argues that the BSP model can facilitate the widespread adoption of parallel computing by providing a standard that is efficient in both high-level language implementation and hardware implementation. The BSP model is characterized by three key attributes: components performing processing and memory functions, a router for point-to-point message delivery, and a synchronization mechanism that ensures regular intervals for global checks. The model is designed to be flexible, allowing for single and multiple instruction streams, and can be implemented on various technologies, including packet-switching networks and optical crossbars. The article provides quantitative results demonstrating the efficiency of the BSP model in implementing high-level language features, algorithms, and hardware simulations, with a focus on achieving optimal simulations within constant multiplicative factors. The BSP model is particularly advantageous for programs with sufficient parallel slackness, where the number of virtual processors is larger than the number of physical processors, and it can support automatic memory and communication management through hashing and replication techniques. The author concludes that the BSP model is a promising candidate for bridging the gap between software and hardware in parallel computing, offering a practical and efficient solution for a wide range of computational tasks.
Reach us at info@study.space
Understanding A bridging model for parallel computation