Book description
While many companies ponder implementation details such as distributed processing engines and algorithms for data analysis, this practical book takes a much wider view of big data development, starting with initial planning and moving diligently toward execution. Authors Ted Malaska and Jonathan Seidman guide you through the major components necessary to start, architect, and develop successful big data projects.
Everyone from CIOs and COOs to lead architects and developers will explore a variety of big data architectures and applications, from massive data pipelines to web-scale applications. Each chapter addresses a piece of the software development life cycle and identifies patterns to maximize long-term success throughout the life of your project.
- Start the planning process by considering the key data project types
- Use guidelines to evaluate and select data management solutions
- Reduce risk related to technology, your team, and vague requirements
- Explore system interface design using APIs, REST, and pub/sub systems
- Choose the right distributed storage system for your big data system
- Plan and implement metadata collections for your data architecture
- Use data pipelines to ensure data integrity from source to final storage
- Evaluate the attributes of various engines for processing the data you collect
Publisher resources
Table of contents
- Preface
- 1. Key Data Project Types and Considerations
- 2. Evaluating and Selecting Data Management Solutions
- 3. Managing Risk in Data Projects
- 4. Interface Design
- 5. Distributed Storage Systems
- 6. The Meta of Enterprise Data
- 7. Ensuring Data Integrity
- 8. Data Processing
- Index
Product information
- Title: Foundations for Architecting Data Solutions
- Author(s):
- Release date: September 2018
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781492038740
You might also like
book
Foundations of Scalable Systems
In many systems, scalability becomes the primary driver as the user base grows. Attractive features and …
book
Deciphering Data Architectures
Data fabric, data lakehouse, and data mesh have recently appeared as viable alternatives to the modern …
book
Building a Scalable Data Warehouse with Data Vault 2.0
The Data Vault was invented by Dan Linstedt at the U.S. Department of Defense, and the …
audiobook
Fundamentals of Data Engineering
Data engineering has grown rapidly in the past decade, leaving many software engineers, data scientists, and …