Algorithmic Differentiation of Pragma-Defined Parallel Regions: Differentiating Computer Programs Containing OpenMP

✍ Scribed by Michael Förster (auth.)

• Publisher: Vieweg+Teubner Verlag
• Year: 2014
• Tongue: English
• Leaves: 411
• Edition: 1
• Category: Library

✦ Synopsis

Numerical programs often use parallel programming techniques such as OpenMP to compute the program's output values as efficient as possible. In addition, derivative values of these output values with respect to certain input values play a crucial role. To achieve code that computes not only the output values simultaneously but also the derivative values, this work introduces several source-to-source transformation rules. These rules are based on a technique called algorithmic differentiation. The main focus of this work lies on the important reverse mode of algorithmic differentiation. The inherent data-flow reversal of the reverse mode must be handled properly during the transformation. The first part of the work examines the transformations in a very general way since pragma-based parallel regions occur in many different kinds such as OpenMP, OpenACC, and Intel Phi. The second part describes the transformation rules of the most important OpenMP constructs.

✦ Table of Contents

Front Matter....Pages I-XI
Motivation and Introduction....Pages 1-59
Source Transformation of Pure Parallel Regions....Pages 61-136
Exclusive Read Analysis....Pages 137-186
Source Transformation of OpenMP Constructs....Pages 187-268
Experimental Results....Pages 269-329
Conclusions....Pages 331-335
Back Matter....Pages 337-405

✦ Subjects

Mathematics of Computing; Computing Methodologies; Appl.Mathematics/Computational Methods of Engineering