Responsible AI in the Enterprise

Responsible AI in the Enterprise

by Adnan Masood, Heather Dawe
Released July 2023
Publisher(s): Packt Publishing
ISBN: 9781803230528

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Build and deploy your AI models successfully by exploring model governance, fairness, bias, and potential pitfalls Purchase of the print or Kindle book includes a free PDF eBook

Key Features

  • Learn ethical AI principles, frameworks, and governance
  • Understand the concepts of fairness assessment and bias mitigation
  • Introduce explainable AI and transparency in your machine learning models

Book Description

Responsible AI in the Enterprise is a comprehensive guide to implementing ethical, transparent, and compliant AI systems in an organization. With a focus on understanding key concepts of machine learning models, this book equips you with techniques and algorithms to tackle complex issues such as bias, fairness, and model governance.

Throughout the book, you’ll gain an understanding of FairLearn and InterpretML, along with Google What-If Tool, ML Fairness Gym, IBM AI 360 Fairness tool, and Aequitas. You’ll uncover various aspects of responsible AI, including model interpretability, monitoring and management of model drift, and compliance recommendations. You’ll gain practical insights into using AI governance tools to ensure fairness, bias mitigation, explainability, privacy compliance, and privacy in an enterprise setting. Additionally, you’ll explore interpretability toolkits and fairness measures offered by major cloud AI providers like IBM, Amazon, Google, and Microsoft, while discovering how to use FairLearn for fairness assessment and bias mitigation. You’ll also learn to build explainable models using global and local feature summary, local surrogate model, Shapley values, anchors, and counterfactual explanations.

By the end of this book, you’ll be well-equipped with tools and techniques to create transparent and accountable machine learning models.

What you will learn

  • Understand explainable AI fundamentals, underlying methods, and techniques
  • Explore model governance, including building explainable, auditable, and interpretable machine learning models
  • Use partial dependence plot, global feature summary, individual condition expectation, and feature interaction
  • Build explainable models with global and local feature summary, and influence functions in practice
  • Design and build explainable machine learning pipelines with transparency
  • Discover Microsoft FairLearn and marketplace for different open-source explainable AI tools and cloud platforms

Who this book is for

This book is for data scientists, machine learning engineers, AI practitioners, IT professionals, business stakeholders, and AI ethicists who are responsible for implementing AI models in their organizations.

Table of contents

  1. Responsible AI in the Enterprise
  2. Foreword
  3. Foreword 2
  4. Contributors
  5. About the authors
  6. About the reviewers
  7. Preface
    1. Who this book is for
      1. Essential chapters tailored to distinct AI-related positions
    2. What this book covers
    3. To get the most out of this book
    4. Download the example code files
    5. Conventions used
    6. Get in touch
    7. Share Your Thoughts
    8. Download a free PDF copy of this book
  8. Part 1: Bigot in the Machine – A Primer
  9. Chapter 1: Explainable and Ethical AI Primer
    1. The imperative of AI governance
    2. Key terminologies
      1. Explainability
      2. Interpretability
      3. Explicability
      4. Safe and trustworthy
      5. Fairness
      6. Ethics
      7. Transparency
      8. Model governance
    3. Enterprise risk management and governance
      1. Tools for enterprise risk governance
      2. AI risk governance in the enterprise
      3. Perpetuating bias – the network effect
      4. Transparency versus black-box apologetics – advocating for AI explainability
      5. The AI alignment problem
    4. Summary
    5. References and further reading
  10. Chapter 2: Algorithms Gone Wild
    1. AI in hiring and recruitment
    2. Facial recognition
    3. Bias in large language models (LLMS)
      1. Hidden cost of AI safety – low wages and psychological impact
    4. AI-powered inequity and discrimination
    5. Policing and surveillance
    6. Social media and attention engineering
    7. The environmental impact
    8. Autonomous weapon systems and military
    9. The AIID
    10. Summary
    11. References and further reading
  11. Part 2: Enterprise Risk Observability Model Governance
  12. Chapter 3: Opening the Algorithmic Black Box
    1. Getting started with interpretable methods
    2. The business case for explainable AI
    3. Taxonomy of ML explainability methods
    4. Shapley Additive exPlanations
      1. How is SHAP different from Shapley values?
      2. A working example of SHAP
    5. Local Interpretable Model-Agnostic Explanations
      1. A working example of LIME
      2. Feature importance
      3. Anchors
      4. PDPs
      5. Counterfactual explanations
    6. Summary
    7. References and further reading
  13. Chapter 4: Robust ML – Monitoring and Management
    1. An overview of ML attacks and countermeasures
    2. Model and data security
      1. Privacy and compliance
      2. Attack prevention and monitoring
      3. Ethics and responsible AI
    3. The ML life cycle
      1. Adopting an ML life cycle
      2. MLOps and ModelOps
      3. Model drift
      4. Data drift
      5. Concept drift
    4. Monitoring and mitigating drift in ML models
      1. Simple data drift detection using Python data drift detector
      2. Housing price data drift detection using Evidently
      3. Analyzing data drift using Azure ML
    5. Summary
    6. References and further reading
  14. Chapter 5: Model Governance, Audit, and Compliance
    1. Policies and regulations
      1. United States
      2. European Union
      3. United Kingdom
      4. Singapore
      5. United Arab Emirates
      6. Toronto Declaration – protecting the right to equality in ML
    2. Professional bodies and industry standards
      1. Microsoft’s Responsible AI framework
      2. IEEE Global Initiative for Ethical Considerations in AI and Autonomous Systems
      3. ISO/IEC’s standards for AI
      4. OECD AI Principles
      5. The University of Oxford’s recommendations for AI governance
      6. PwC’s Responsible AI Principles/Toolkit
      7. Alan Turing Institute guide to AI ethics
    3. Technology toolkits
      1. Microsoft Fairlearn
      2. IBM’s AI Explainability 360 open source toolkit
      3. Credo AI Lens toolkit
      4. PiML – the integrated Python toolbox for interpretable ML
      5. FAT Forensics – algorithmic fairness, accountability, and transparency toolbox
      6. Aequitas – the Bias and Fairness Audit Toolkit
      7. AI trust, risk, and security management
    4. Auditing checklists and measures
      1. Datasheets for datasets
      2. Model cards for model reporting
    5. Summary
    6. References and further reading
  15. Chapter 6: Enterprise Starter Kit for Fairness, Accountability, and Transparency
    1. Getting started with enterprise AI governance
      1. AI STEPS FORWARD – AI governance framework
      2. Implementing AI STEPS FORWARD in an enterprise
      3. The strategic principles of AI STEPS FORWARD
      4. AI STEPS FORWARD in enterprise governance
      5. The AI STEPS FORWARD maturity model
      6. Risk management in AI STEPS FORWARD
      7. Measures and metrics of AI STEPS FORWARD
      8. AI STEPS FORWARD – taxonomy of components
      9. Salient capabilities for AI Governance
    2. The indispensable role of the C-suite in fostering responsible AI adoption
      1. An AI Center of Excellence
    3. The role of internal AI boards in enterprise AI governance
      1. Healthcare systems
      2. Retail and e-commerce systems
      3. Financial services
      4. Predictive analytics and forecasting
      5. Cross-industry applications of AI
      6. Establishing repeatable processes, controls, and assessments for AI systems
    4. Ethical AI upskilling and education
    5. Summary
    6. References and further reading
  16. Part 3: Explainable AI in Action
  17. Chapter 7: Interpretability Toolkits and Fairness Measures – AWS, GCP, Azure, and AIF 360
    1. Getting started with hyperscaler interpretability toolkits
    2. Google Vertex Explainable AI
      1. Model interpretability in Vertex AI – feature attribution and example-based explanations
      2. Integration with Google Colab and other notebooks
      3. Simplified deployment
      4. Explanations are comprehensive and multimodal
    3. AWS Sagemaker Clarify
    4. Azure Machine Learning model interpretability
      1. Azure’s responsible AI offerings
      2. Responsible AI scorecards
      3. Open source offerings – the responsible AI toolbox
    5. Open source toolkits and lenses
      1. IBM AI Fairness 360
      2. Aequitas – Bias and Fairness Audit Toolkit
    6. PETs
      1. Differential privacy
      2. Homomorphic encryption
      3. Secure multiparty computation
      4. Federated learning
      5. Data anonymization
      6. Data perturbation
    7. Summary
    8. References and further reading
  18. Chapter 8: Fairness in AI Systems with Microsoft Fairlearn
    1. Getting started with fairness
    2. Fairness metrics
    3. Fairness-related harms
    4. Getting started with Fairlearn
    5. Summary
    6. References and further reading
  19. Chapter 9: Fairness Assessment and Bias Mitigation with Fairlearn and the Responsible AI Toolbox
    1. Fairness metrics
      1. Demographic parity
      2. Equalized odds
      3. Simpson’s paradox and the risks of multiple testing
    2. Bias and disparity mitigation with Fairlearn
      1. Fairness in real-world scenarios
      2. Mitigating correlation-related bias
    3. The Responsible AI Toolbox
      1. The Responsible AI dashboard
    4. Summary
    5. References and further reading
  20. Chapter 10: Foundational Models and Azure OpenAI
    1. Foundation models
      1. Bias in foundation models
      2. The AI alignment challenge – investigating GPT-4’s power-seeking behavior with ARC
    2. Enterprise use of foundation models and bias remediation
      1. Biases in GPT3
    3. Azure OpenAI
      1. Access to Azure OpenAI
      2. The Code of Conduct
      3. Azure OpenAI Service content filtering
      4. Use cases and governance
      5. What not to do – limitations and potential risks
    4. Data, privacy, and security for Azure OpenAI Service
      1. AI governance for the enterprise use of Azure OpenAI
    5. Getting started with Azure OpenAI
      1. Consuming the Azure OpenAI GPT3 model using the API
    6. Azure OpenAI Service models
      1. Code generation models
      2. Embedding models
    7. Summary
    8. References and further reading
  21. Index
    1. Why subscribe?
  22. Other Books You May Enjoy
    1. Packt is searching for authors like you
    2. Share Your Thoughts
    3. Download a free PDF copy of this book

Product information

  • Title: Responsible AI in the Enterprise
  • Author(s): Adnan Masood, Heather Dawe
  • Release date: July 2023
  • Publisher(s): Packt Publishing
  • ISBN: 9781803230528