Preface

Every company today is a data company regardless of the industry. Innovative companies use data to analyze the past, predict what will happen, and react to what is happening now. Data engineers are some of the most critical employees at companies today. They are essential for collecting, cleaning, and maintaining trusted datasets that analysts, data scientists, and reporting tools use to provide insights.

This book will teach you to leverage the Scala programming language on the Spark framework and the latest cloud technologies to build continuous and triggered data pipelines. You will do this by setting up a data engineering environment for local development and scalable distributed cloud deployments, using data engineering best practices, ...

Get Data Engineering with Scala and Spark now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.