7 Metadata layer architecture

This chapter covers

  • Understanding data platform technical metadata vs. business metadata
  • Leveraging metadata to simplify data platform management
  • Architecting the optimal metadata layer
  • Designing a metadata model with multiple domains
  • Understanding metadata layer implementation options
  • Evaluating commercial and open source metadata options

In this chapter, we’ll help you get a clear understanding of what we mean by data platform internal metadata and why it is important to the operation of a data platform.

We’ll cover the difference between configuration and activity metadata and how each can be used, using examples of a data platform with growing complexity. We will show why the metadata layer should become ...

Get Designing Cloud Data Platforms now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.