Building Resilient Distributed Systems

Table of contents

1. Brief Table of Contents (Not Yet Final)
2. Preface
   1. Who This Book Is For
   2. What You Will Learn
   3. Navigating The Book
      1. Part 1: Technical
      2. Part 2: People, Process, and Culture
3. 1. What Is Resiliency?
   1. What Is Resilience?
      1. Technology
      2. Social
   2. Why Resilience Matters
   3. What Is A Distributed System?
      1. How Distributed Systems Can Fail (Us)
      2. Two Golden Rules Of Distributed Systems
   4. The Human Factor
   5. The Sociotechnical System
      1. The Hexagonal Model For Sociotechnical systems
   6. The Four Concepts Of Resilience
      1. Robustness
      2. Rebound
      3. Graceful Extensibility
      4. Sustained Adaptability
   7. How Resilient Do You Need To Be?
   8. Summary
4. 2. Timeouts
   1. The Problem With Time
   2. Why Timeout at all?
   3. Finding The Sweet Spot
   4. Analyzing Existing Response Times
      1. Tail Latencies
      2. Tight Latency Bounds
   5. How Many Requests Can You Handle?
   6. Using User Expectations
   7. Fault Injection and Testing Timeouts
   8. Timeouts and Call Chains
   9. Timeout Propagation
      1. Clock Skew And Timeouts
   10. Other Considerations
   11. Case Study: AdvertCorp
       1. Overload
       2. Customer-driven Denial Of Service
       3. Page Load Times
       4. Missing Timeouts
       5. A Confluence Of Events
   12. Conclusion
5. 3. Retries and Idempotency
   1. Should You Always Retry?
      1. A Better Type Of Error
   2. How Many Retries Are Appropriate?
      1. Fixed Retry Count
      2. Dynamic Retry Limit
   3. Delays Between Retries
      1. Exponential Back-off
      2. Jitter
   4. Is Retrying Safe?
   5. Idempotency
      1. Making Operations Idempotent
      2. Real World Examples
   6. Conclusion
   7. Further Reading