Apache Atlas high-level architecture

Here is the high-level architecture of Atlas:

Atlas has an extensible API that can support integration with different sources of metadata. As of this writing, Atlas can manage metadata for the following sources:

  • HBase
  • Hive
  • Sqoop
  • Storm
  • Kafka

For each source, Atlas has a well-defined type. For example, for hive table, Atlas defines the type as hive_table.

The preceding applications section defines the consumers of the metadata that Atlas stores.

Kafka and the API together make up the integration layer of Apache Atlas. The API Interface layer provides the consumers of the metadata with the ability to easily ...

Get Architecting Data-Intensive Applications now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.