In this section, we will learn about what all architectural patterns are possible to build a scalable, sustainable, and robust real–time solution.
A high–level NRT solution recipe looks very straight and simple, with a data collection funnel, a distributed processing engine, and a few other ingredients like in–memory cache, stable storage, and dashboard plugins.
At a high level, the basic analytics process can be segmented into three shards, which are depicted well in previous figure:
- Real–time data collection of the streaming data
- Distributed high–performance computation on flowing data ...