High Performance Parallel Runtimes: Design and Implementation

Michael Klemm; Jim Cownie

Published by De Gruyter Oldenbourg 2021

High Performance Parallel Runtimes

Design and Implementation

Michael Klemm and Jim Cownie

In the series De Gruyter Textbook

https://doi.org/10.1515/9783110632729

Overview
Contents

About this book

This book focuses on the theoretical and practical aspects of parallel programming systems for today's high performance multi-core processors and discusses the efficient implementation of key algorithms needed to implement parallel programming models. Such implementations need to take into account the specific architectural aspects of the underlying computer architecture and the features offered by the execution environment.

This book briefly reviews key concepts of modern computer architecture, focusing particularly on the performance of parallel codes as well as the relevant concepts in parallel programming models. The book then turns towards the fundamental algorithms used to implement the parallel programming models and discusses how they interact with modern processors.

While the book will focus on the general mechanisms, we will mostly use the Intel processor architecture to exemplify the implementation concepts discussed but will present other processor architectures where appropriate. All algorithms and concepts are discussed in an easy to understand way with many illustrative examples, figures, and source code fragments.

The target audience of the book is students in Computer Science who are studying compiler construction, parallel programming, or programming systems. Software developers who have an interest in the core algorithms used to implement a parallel runtime system, or who need to educate themselves for projects that require the algorithms and concepts discussed in this book will also benefit from reading it.

You can find the source code for this book at https://github.com/parallel-runtimes/lomp.

Source code downloads with code examples used throughout the book. Cover all implementation aspects of such programming systems.

Author / Editor information

Michael Klemm, München

Jim Cownie, Bristol UK

Topics

Frontmatter Publicly Available Download PDF	I
Foreword Publicly Available Download PDF	V
Preface Publicly Available Download PDF	IX
Contents Publicly Available Download PDF	XI
List of figures Publicly Available Download PDF	XVII
Listings Publicly Available Download PDF	XIX
List of tables Publicly Available Download PDF	XXIII
Glossary Publicly Available Download PDF	XXV
1 Setting the stage Requires Authentication Unlicensed Licensed Download PDF	1
2 Parallel programming models and concepts Requires Authentication Unlicensed Licensed Download PDF	11
3 Many-core and multi-core computer architectures Requires Authentication Unlicensed Licensed Download PDF	48
4 Compiler and runtime interaction Requires Authentication Unlicensed Licensed Download PDF	90
5 Fundamental parallel runtime mechanisms Requires Authentication Unlicensed Licensed Download PDF	127
6 Mutual exclusion and atomicity Requires Authentication Unlicensed Licensed Download PDF	146
7 Barriers and reductions Requires Authentication Unlicensed Licensed Download PDF	194
8 Scheduling parallel loops Requires Authentication Unlicensed Licensed Download PDF	228
9 Runtime support for task-parallel models Requires Authentication Unlicensed Licensed Download PDF	259
10 Summary and final thoughts Requires Authentication Unlicensed Licensed Download PDF	304
Bibliography Requires Authentication Unlicensed Licensed Download PDF	307
Index Requires Authentication Unlicensed Licensed Download PDF	315
List of acronyms Requires Authentication Unlicensed Licensed Download PDF	327

(Deutsch)

Language: English
Publisher: De Gruyter Oldenbourg
Audience: Students, software developers
Pages
- Front matter: 28
- Main content: 328
Keywords: Runtimes; Compiler; Programming

eBook

Published: February 8, 2021
ISBN: 9783110632729

Paperback

Published: February 8, 2021
ISBN: 9783110632682