Introduction to Parallel Computing: From Algorithms to Programming on State-of-the-Art Platforms

✍ Scribed by Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič

• Publisher: Springer International Publishing
• Year: 2018
• Tongue: English
• Leaves: 263
• Series: Undergraduate Topics in Computer Science
• Edition: 1st ed.
• Category: Library

✦ Synopsis

Advancements in microprocessor architecture, interconnection technology, and software development have fueled rapid growth in parallel and distributed computing. However, this development is only of practical benefit if it is accompanied by progress in the design, analysis and programming of parallel algorithms.

This concise textbook provides, in one place, three mainstream parallelization approaches, Open MPP, MPI and OpenCL, for multicore computers, interconnected computers and graphical processing units. An overview of practical parallel computing and principles will enable the reader to design efficient parallel programs for solving various computational problems on state-of-the-art personal computers and computing clusters.

Topics covered range from parallel algorithms, programming tools, OpenMP, MPI and OpenCL, followed by experimental measurements of parallel programs’ run-times, and by engineering analysis of obtained results for improved parallel execution performances.

Many examples and exercises support the exposition.

✦ Table of Contents

Front Matter ....Pages i-xii
Front Matter ....Pages 1-1
Why Do We Need Parallel Programming (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 3-7
Overview of Parallel Systems (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 9-44
Front Matter ....Pages 45-45
Programming Multi-core and Shared Memory Multiprocessors Using OpenMP (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 47-86
MPI Processes and Messaging (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 87-132
OpenCL for Massively Parallel Graphic Processors (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 133-196
Front Matter ....Pages 197-198
Engineering: Parallel Computation of the Number (\pi ) (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 199-209
Engineering: Parallel Solution of 1-D Heat Equation (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 211-222
Engineering: Parallel Implementation of Seam Carving (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 223-240
Final Remarks and Perspectives (Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič)....Pages 241-242
Back Matter ....Pages 243-256

✦ Subjects

Computer Science; Programming Techniques; Processor Architectures; Control Structures and Microprogramming; Numeric Computing