Chapter 14 DW 2.0 and the granularity manager

Nearly all of the data that passes from external sources to the Interactive Sector, or occasionally directly into the Integrated Sector, passes through an ETL process, for good reason. But on rare occasions, there is need for another type of process to move data from external sources.

THE GRANULARITY MANAGER

This type of processor is called a granularity manager. The granularity manager does something quite different from what an ETL program does.

Consider what an ETL process does. Figure 14.1 depicts normal ETL processing at a conceptual level.

Figure 14.1 represents the customary storage of different kinds of data by subject area following normal ETL processing. ETL reads a source record and then ...

Get DW 2.0: The Architecture for the Next Generation of Data Warehousing now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.