Foundations of Scalable Systems

✍ Scribed by Ian Gorton

• Publisher: O'Relly
• Year: 2022
• Tongue: English
• Leaves: 230
• Category: Library

✦ Table of Contents

Preface
Why Scalability?
Who This Book Is For
What You Will Learn
I. Scalability in Modern Software Systems
1. Introduction to Scalable Systems
What is Scalability?
System scale in early 2020’s: Examples
How Did We Get Here? A Brief History of System Growth
Scalability Basic Design Principles
Scalability and Costs
Scalability and Architecture Trade-offs
Performance
Availability
Security
Manageability
Summary and Further Reading
References
2. Distributed Systems Architectures: An Introduction
Basic System Architecture
Scale Out
Scaling the Database with Caching
Distributing the Database
Multiple Processing Tiers
Increasing Responsiveness
Systems and Hardware Scalability
Summary and Further Reading
3. Distributed Systems Essentials
Communications Basics
Communications Hardware
Communications Software
Remote Method Invocation
Partial Failures
Consensus in Distributed Systems
Time in Distributed Systems
Summary and Further Reading
4. An Overview of Concurrent Systems
Why Concurrency?
Threads
Order of Thread Execution
Problems with Threads
Race Conditions
Deadlocks
Thread States
Thread Coordination
Thread Pools
Barrier Synchronization
Thread-Safe Collections
Summary and Further Reading
5. Application Services
Service Design
Application Programming Interface (API)
Designing Services
State Management
Applications Servers
Horizontal Scaling
Load Balancing
Load Distribution Policies
Health Monitoring
Elasticity
Session Affinity
Summary and Further Reading
6. Distributed Caching
Application Caching
Web Caching
Cache-Control
Expires and Last-Modified
Etag
Summary and Further Reading
7. Asynchronous Messaging
Introduction to Messaging
Messaging Primitives
Message Persistence
Publish-Subscribe
Message Replication
Example: RabbitMQ
Messages, Exchanges, and Queues
Distribution and Concurrency
Data Safety and Performance Trade-offs
Availability and Performance Trade-offs
Messaging Patterns
Competing Consumers
Exactly-Once Processing
Poison Messages
Summary and Further Reading
8. Serverless Processing Systems
The Attractions of Serverless
Google App Engine
The Basics
GAE Standard Environment
AutoScaling
AWS Lambda
Lambda Function Lifecycle
Execution Considerations
Scalability
Case Study: Balancing Throughput and Costs
Choosing Parameter Values
GAE Autoscaling Parameter Study Design
Results
Summary and Further Reading
About the Author