Machine Learning Model Serving Patterns and Best Practices

Part 2:Patterns and Best Practices of Model Serving

In this part, we explore some patterns of serving machine learning models and demonstrate how these patterns can be used through examples. 

This part contains the following chapters:

• Chapter 3, Stateless Model Serving
• Chapter 4, Continuous Model Evaluation
• Chapter 5, Keyed Prediction
• Chapter 6, Batch Model Serving
• Chapter 7, Online Learning Model Serving
• Chapter 8, Two-Phase Model Serving
• Chapter 9, Pipeline Pattern Model Serving
• Chapter 10, Ensemble Model Serving Pattern
• Chapter 11, Business Logic Pattern