3

Designing and Implementing the Data Exploration Layer

In Chapter 2, Implementing a Partition Strategy, you learned to implement a partition strategy for different types of data and workloads in Azure, how to partition files based on their format, size, and frequency of access, and how to use tools such as Azure Data Factory (ADF) and Azure Databricks to perform partitioning operations. Additionally, you learned how to partition data for Azure Synapse Analytics, a unified analytics platform that combines data warehousing and big data processing. Finally, you learned how to identify when partitioning is needed in Azure Data Lake Storage Gen2, a scalable and secure data lake service to determine the optimal partitioning strategy for your data ...

Get Azure Data Engineer Associate Certification Guide - Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.