Here is the high-level architecture of Atlas:
Atlas has an extensible API that can support integration with different sources of metadata. As of this writing, Atlas can manage metadata for the following sources:
- HBase
- Hive
- Sqoop
- Storm
- Kafka
For each source, Atlas has a well-defined type. For example, for hive table, Atlas defines the type as hive_table.
The preceding applications section defines the consumers of the metadata that Atlas stores.
Kafka and the API together make up the integration layer of Apache Atlas. The API Interface layer provides the consumers of the metadata with the ability to easily ...