Fair Scheduling in High Performance Computing Environments

✍ Scribed by Art Sedighi, Milton Smith

• Publisher: Springer International Publishing
• Year: 2019
• Tongue: English
• Leaves: 136
• Edition: 1st ed.
• Category: Library

✦ Synopsis

This book introduces a new scheduler to fairly and efficiently distribute system resources to many users of varying usage patterns compete for them in large shared computing environments. The Rawlsian Fair scheduler developed for this effort is shown to boost performance while reducing delay in high performance computing workloads of certain types including the following four types examined in this book:

i. Class A – similar but complementary workloads

ii. Class B – similar but steady vs intermittent workloads

iii. Class C – Large vs small workloads

iv. Class D – Large vs noise-like workloads

This new scheduler achieves short-term fairness for small timescale demanding rapid response to varying workloads and usage profiles. Rawlsian Fair scheduler is shown to consistently benefit workload Classes C and D while it only benefits Classes A and B workloads where they become disproportionate as the number of users increases.

A simulation framework, dSim, simulates the new Rawlsian Fair scheduling mechanism. The dSim helps achieve instantaneous fairness in High Performance Computing environments, effective utilization of computing resources, and user satisfaction through the Rawlsian Fair scheduler.

✦ Table of Contents

Front Matter ....Pages i-xi
Introduction (Art Sedighi, Milton Smith)....Pages 1-5
Financial Market Risk (Art Sedighi, Milton Smith)....Pages 7-15
Scheduling in High Performance Computing (Art Sedighi, Milton Smith)....Pages 17-22
Fairshare Scheduling (Art Sedighi, Milton Smith)....Pages 23-28
Multi-Criteria Scheduling: A Mathematical Model (Art Sedighi, Milton Smith)....Pages 29-37
Simulation and Methodology (Art Sedighi, Milton Smith)....Pages 39-46
DSIM (Art Sedighi, Milton Smith)....Pages 47-50
Simulation Scenarios (Art Sedighi, Milton Smith)....Pages 51-62
Overview of Results (Art Sedighi, Milton Smith)....Pages 63-70
Class A Results and Analysis (Art Sedighi, Milton Smith)....Pages 71-84
Class B Results and Analysis (Art Sedighi, Milton Smith)....Pages 85-99
Class C Results and Analysis (Art Sedighi, Milton Smith)....Pages 101-109
Class D Results and Simulations (Art Sedighi, Milton Smith)....Pages 111-122
Conclusion (Art Sedighi, Milton Smith)....Pages 123-124
Back Matter ....Pages 125-132

✦ Subjects

Computer Science; Algorithm Analysis and Problem Complexity; Information Systems and Communication Service; Processor Architectures