Azure OpenAI Service for Cloud Native Applications

Azure OpenAI Service for Cloud Native Applications

by Adrián González Sánchez
Released July 2024
Publisher(s): O'Reilly Media, Inc.
ISBN: 9781098154998

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Buy on Amazon Buy on ebooks.com
Start your free trial

Book description

Get the details, examples, and best practices you need to build generative AI applications, services, and solutions using the power of Azure OpenAI Service. With this comprehensive guide, Microsoft AI specialist Adrián González Sánchez examines the integration and utilization of Azure OpenAI Service—using powerful generative AI models such as GPT-4 and GPT-4o—within the Microsoft Azure cloud computing platform.

To guide you through the technical details of using Azure OpenAI Service, this book shows you how to set up the necessary Azure resources, prepare end-to-end architectures, work with APIs, manage costs and usage, handle data privacy and security, and optimize performance. You'll learn various use cases where Azure OpenAI Service models can be applied, and get valuable insights from some of the most relevant AI and cloud experts.

Ideal for software and cloud developers, product managers, architects, and engineers, as well as cloud-enabled data scientists, this book will help you:

  • Learn how to implement cloud native applications with Azure OpenAI Service
  • Deploy, customize, and integrate Azure OpenAI Service with your applications
  • Customize large language models and orchestrate knowledge with company-owned data
  • Use advanced roadmaps to plan your generative AI project
  • Estimate cost and plan generative AI implementations for adopter companies

Publisher resources

View/Submit Errata

Table of contents

  1. Preface
    1. How This Book Is Organized
    2. Conventions Used in This Book
    3. Using Code Examples
    4. O’Reilly Online Learning
    5. How to Contact Us
    6. Acknowledgments
  2. Introduction
  3. 1. Introduction to Generative AI and Azure OpenAI Service
    1. What Is Artificial Intelligence?
      1. Current Level of AI Adoption
      2. The Many Technologies of AI
      3. Typical AI Use Cases
      4. Types of AI Learning Approaches
    2. About Generative AI
      1. Primary Capabilities of Generative AI
      2. Relevant Industry Actors
      3. The Key Role of Foundation Models
      4. Road to Artificial General Intelligence
    3. Microsoft, OpenAI, and Azure OpenAI Service
      1. The Rise of AI Copilots
      2. Azure OpenAI Service Capabilities and Use Cases
      3. LLM Tokens as the New Unit of Measure
    4. Conclusion
  4. 2. Designing Cloud Native Architectures for Generative AI
    1. Modernizing Applications for Generative AI
    2. Cloud Native Development with Azure OpenAI Service
      1. Microservice-Based Apps and Containers
      2. Serverless Workflows
      3. Azure-Based Web Development and CI/CD
    3. Understanding the Azure Portal
    4. General Azure OpenAI Service Considerations
      1. Available Azure OpenAI Service Models
      2. Architectural Elements of Generative AI Systems
    5. Conclusion
  5. 3. Implementing Cloud Native Generative AI with Azure OpenAI Service
    1. Defining the Knowledge Scope of Azure OpenAI Service–Enabled Apps
    2. Generative AI Modeling with Azure OpenAI Service
      1. Azure OpenAI Service Building Blocks
      2. Potential Implementation Approaches
      3. Approach Comparison and Final Recommendation
      4. AI Performance Evaluation Methods
    3. Conclusion
  6. 4. Additional Cloud and AI Capabilities
    1. Plug-ins
    2. LLM Development, Orchestration, and Integration
      1. LangChain
      2. Semantic Kernel
      3. LlamaIndex
      4. Bot Framework
      5. Power Platform, Microsoft Copilot, and AI Builder
    3. Databases and Vector Stores
      1. Vector Search from Azure AI Search
      2. Vector Search from Cosmos DB
      3. Azure Databricks Vector Search
      4. Redis Databases on Azure
      5. Other Relevant Databases (Including Open Source)
    4. Additional Microsoft Building Blocks for Generative AI
      1. Azure AI Document Intelligence (formerly Azure Form Recognizer) for OCR
      2. Microsoft Fabric’s Lakehouse
      3. Microsoft Azure AI Speech
      4. Microsoft Azure API Management
      5. Ongoing Microsoft Open Source and Research Projects
    5. Conclusion
  7. 5. Operationalizing Generative AI Implementations
    1. The Art of Prompt Engineering
    2. Generative AI and LLMOps
      1. Prompt Flow and Azure ML
      2. Securing LLMs
      3. Managing Privacy and Compliance
    3. Responsible AI and New Regulations
      1. Relevant Regulatory Context for Generative AI Systems
      2. Company-Level AI Governance Resources
      3. Technical-Level Responsible AI Tools
    4. Conclusion
  8. 6. Elaborating Generative AI Business Cases
    1. Premortem, or What to Consider Before Implementing a Generative AI Project
    2. Defining Implementation Approach, Resources, and Project Roadmap
      1. Defining Project Workstreams
      2. Identifying Required Resources
      3. Estimating Duration and Effort
      4. Creating a “Living” Roadmap
    3. Creating Usage Scenarios
    4. Calculating Cost and Potential ROI
    5. Conclusion
  9. 7. Exploring the Big Picture
    1. What’s Next? The Evolution Toward Microsoft Copilot
    2. Expert Insights for the Generative AI Era
      1. David Carmona: AI Adoption and the Future of Generative AI
      2. Brendan Burns: The Role of Cloud Native for Generative AI Developments
      3. John Maeda: About AI Design and Orchestration
      4. Sarah Bird: Responsible AI for LLMs and Generative AI
      5. Tim Ward: The Impact of Data Quality on LLM Implementations
      6. Seth Juarez: From Generative AI Models to a Full LLM Platform
      7. Saurabh Tiwary: The New Microsoft Copilot Era
    3. Conclusion
  10. Appendix. Other Learning Resources
    1. Relevant O’Reilly Books for Your Upskilling Journey
    2. Other Resources and Repositories
  11. Index
  12. About the Author

Product information

  • Title: Azure OpenAI Service for Cloud Native Applications
  • Author(s): Adrián González Sánchez
  • Release date: July 2024
  • Publisher(s): O'Reilly Media, Inc.
  • ISBN: 9781098154998