I Heart Logs

Table of contents

1. Preface
   1. Conventions Used in This Book
   2. Safari® Books Online
   3. How to Contact Us
2. 1. Introduction
   1. What Is a Log?
   2. Logs in Databases
   3. Logs in Distributed Systems
      1. Variety of Log-Centric Designs
      2. An Example
      3. Logs and Consensus
   4. Changelog 101: Tables and Events Are Dual
   5. What’s Next
3. 2. Data Integration
   1. Data Integration: Two Complications
      1. Data is More Diverse
      2. The Explosion of Specialized Data Systems
   2. Log-Structured Data Flow
   3. My Experience at LinkedIn
   4. Relationship to ETL and the Data Warehouse
   5. ETL and Organizational Scalability
   6. Where Should We Put the Data Transformations?
   7. Decoupling Systems
   8. Scaling a Log
4. 3. Logs and Real-Time Stream Processing
   1. Data Flow Graphs
   2. Logs and Stream Processing
   3. Reprocessing Data: The Lambda Architecture and an Alternative
      1. What is a Lambda Architecture and How Do I Become One?
      2. What’s Good About This?
      3. And the Bad...
      4. An Alternative
   4. Stateful Real-Time Processing
   5. Log Compaction
5. 4. Building Data Systems with Logs
   1. Unbundling?
   2. The Place of the Log in System Architecture
   3. Conclusion
6. A. References
   1. Academic Papers, Systems, Talks, and Blogs
   2. Enterprise Software
   3. Open Source