Chapter 2. Getting data from clients: data ingestion

This chapter covers

  • Learning about the collection tier
  • Understanding the data collection patterns
  • Taking the collection tier to the next level
  • Protecting against data loss

On to our first tier: the collection tier is our entry point for bringing data into our streaming system. Figure 2.1 shows a slightly modified version of our blueprint, with focus on the collection tier.

Figure 2.1. Architectural blueprint with emphasis on the collection tier

This tier is where data comes into the system and starts its journey; from here it will progress through the rest of the system. In the coming ...

Get Streaming Data now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.