A Course in In-Memory Data Management: The Inner Mechanics of In-Memory Databases

✍ Scribed by Hasso Plattner (auth.)

• Publisher: Springer Berlin Heidelberg
• Year: 2013
• Tongue: English
• Leaves: 298
• Category: Library

✦ Synopsis

Recent achievements in hardware and software development, such as multi-core CPUs and DRAM capacities of multiple terabytes per server, enabled the introduction of a revolutionary technology: in-memory data management. This technology supports the flexible and extremely fast analysis of massive amounts of enterprise data. Professor Hasso Plattner and his research group at the Hasso Plattner Institute in Potsdam, Germany, have been investigating and teaching the corresponding concepts and their adoption in the software industry for years.

This book is based on the first online course on the openHPI e-learning platform, which was launched in autumn 2012 with more than 13,000 learners. The book is designed for students of computer science, software engineering, and IT related subjects. However, it addresses business experts, decision makers, software developers, technology experts, and IT analysts alike. Plattner and his group focus on exploring the inner mechanics of a column-oriented dictionary-encoded in-memory database. Covered topics include - amongst others - physical data storage and access, basic database operators, compression mechanisms, and parallel join algorithms. Beyond that, implications for future enterprise applications and their development are discussed. Readers are lead to understand the radical differences and advantages of the new technology over traditional row-oriented disk-based databases.

✦ Table of Contents

Front Matter....Pages i-xxiii
Introduction....Pages 1-3
Front Matter....Pages 5-5
New Requirements for Enterprise Computing....Pages 7-14
Enterprise Application Characteristics....Pages 15-18
Changes in Hardware....Pages 19-28
A Blueprint of SanssouciDB....Pages 29-33
Front Matter....Pages 35-35
Dictionary Encoding....Pages 37-42
Compression....Pages 43-54
Data Layout in Main Memory....Pages 55-62
Partitioning....Pages 63-67
Front Matter....Pages 69-69
Delete....Pages 71-73
Insert....Pages 75-81
Update....Pages 83-87
Tuple Reconstruction....Pages 89-93
Scan Performance....Pages 95-98
Select....Pages 99-103
Materialization Strategies....Pages 105-112
Parallel Data Processing....Pages 113-120
Indices....Pages 121-129
Join....Pages 131-139
Aggregate Functions....Pages 141-143
Front Matter....Pages 69-69
Parallel Select....Pages 145-148
Workload Management and Scheduling....Pages 149-152
Parallel Join....Pages 153-155
Parallel Aggregation....Pages 157-160
Front Matter....Pages 161-161
Differential Buffer....Pages 163-166
Insert-Only....Pages 167-174
The Merge Process....Pages 175-183
Logging....Pages 185-192
Recovery....Pages 193-195
On-the-Fly Database Reorganization....Pages 197-203
Front Matter....Pages 205-205
Implications on Application Development....Pages 207-214
Database Views....Pages 215-218
Handling Business Objects....Pages 219-221
Bypass Solution....Pages 223-228
Back Matter....Pages 229-297

✦ Subjects

Business Information Systems; Database Management; Data Mining and Knowledge Discovery; Information Systems Applications (incl. Internet)