Practical Lakehouse Architecture

Chapter 9. Lakehouse of the Future

Congratulations! You’ve reached the last chapter of this book. I hope you now understand lakehouse architecture, its core concepts, and the different technology options available for implementing a lakehouse.

In the previous chapter, we discussed how to build a lakehouse in the real-world. In this chapter, I will discuss some of the alternative, unconventional, and futuristic approaches to building a lakehouse. I’ve handpicked a few technologies, products, and design approaches that I think will shape the future of lakehouse design and its adoption by the data community. While some have already become mainstream, some are still in experimental mode.

In this chapter, we will explore:

• Different approaches like data mesh, HTAP, and Zero ETL, in combination with lakehouse architecture, to implement data platforms

• Interoperability features and upcoming file and table formats

• Managed platforms that can simplify lakehouse implementations in public and private clouds

• Use of AI in a lakehouse

As the data world changes rapidly, some of these design patterns and methodologies might become the standard approach for implementing data platforms, while others might not attract many takers. In either case, I felt it a good idea to conclude this book by exploring the endless future possibilities that technological advancements can offer.

Warehouse to Lakehouse: What’s Next?

Like modern technologies, modern architectures also evolve with time. In the ...