Hadoop architecture in detail

We have now detailed each of the components in Hadoop in detail in the previous section. Now, it's time to discuss the Hadoop 2.x architecture in detail, looking at each of its components and sub-components.

The next figure delves into each component and sub-component in the Hadoop 2.x architecture in detail:

Figure 12: Low-level Hadoop 2.x conceptual architecture

The primary challenge that Hadoop 2.x solved over the Hadoop1 framework was around removing a single point of failure, which was the NameNode in Hadoop 1.x.

This has been achieved by the inclusion of the YARN framework as part of Hadoop 2.x. As seen ...

Get Data Lake for Enterprises now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.