Table of Contents
Preface
Background
What is DevOps?
DevOps and continuous delivery
DevOps and Agile
DevOps and testing
TESTING IN A DEVOPS CULTURE
Establishing your context
Start with a test strategy retrospective
Agile testing assessment
DevOps in your organisation
Collaboration beyond development
Blazing a trail
Paths for testing
Choose your map
Resistance
TESTING IN DEVELOPMENT
Feedback in development
Automation
Exploration
Test practices in development
Deployment pipeline
Feature toggles
Bug bash
Crowdsourced testing
TESTING IN PRODUCTION
Feedback in production
Monitoring and alerting
Analytics events
Logging
Customer feedback
Test practices in production
A/B testing
Beta testing
Monitoring as testing
Exposure control
Canary release
Staged rollout
Dogfooding
Dark launching
TESTING IN DEVOPS ENVIRONMENTS
Platform evolution
Infrastructure as code
Configuration management
Containers
Cloud
Test practices for environments
Environment management
Infrastructure testing
Destructive testing
INDUSTRY EXAMPLES
King: AI in testing
Capital One: Hygieia delivery pipeline dashboard
The Guardian: Testing in production
Bank of New Zealand: A/B testing
Etsy: Monitoring as testing
Spotify: Using Docker
PagerDuty: Failure Fridays
TEST STRATEGY IN DEVOPS
Risk workshop
Rethinking the test pyramid
Finding balance in exploration
Testing vs Tester
Documenting a strategy
Conclusion
References
About the Author