Book description
AI has acquired startling new language capabilities in just the past few years. Driven by the rapid advances in deep learning, language AI systems are able to write and understand text better than ever before. This trend enables the rise of new features, products, and entire industries. Through the visually educational nature of this book, Python developers will learn the practical tools and concepts they need to use these capabilities today.
You'll learn how to use the power of pre-trained large language models for use cases like copywriting and summarization; create semantic search systems that go beyond keyword matching; build systems that classify and cluster text to enable scalable understanding of large numbers of text documents; and use existing libraries and pre-trained models for text classification, search, and clusterings.
This book also shows you how to:
- Build advanced LLM pipelines to cluster text documents and explore the topics they belong to
- Build semantic search engines that go beyond keyword search with methods like dense retrieval and rerankers
- Learn various use cases where these models can provide value
- Understand the architecture of underlying Transformer models like BERT and GPT
- Get a deeper understanding of how LLMs are trained
- Optimize LLMs for specific applications with methods such as generative model fine-tuning, contrastive fine-tuning, and in-context learning
Jay Alammar is Director and Engineering Fellow at Cohere (pioneering provider of large language models as an API).
Maarten Grootendorst is a Senior Clinical Data Scientist at Netherlands Comprehensive Cancer Organization (IKNL).
Publisher resources
Table of contents
- Preface
-
1. An Introduction to Large Language Models
- What Is Language AI?
- A Recent History of Language AI
- The Moving Definition of a “Large Language Model”
- The Training Paradigm of Large Language Models
- Large Language Model Applications: What Makes Them So Useful?
- Responsible LLM Development and Usage
- Limited Resources Are All You Need
- Interfacing with Large Language Models
- Generating Your First Text
- Summary
- 2. Tokens and Embeddings
- 3. Looking Inside Large Language Models
- 4. Text Classification
- 5. Text Clustering and Topic Modeling
- 6. Prompt Engineering
- 7. Advanced Text Generation Techniques and Tools
- 8. Semantic Search and Retrieval-Augmented Generation (RAG)
- 9. Multimodal Large Language Models
- 10. Creating Text Embedding Models
- 11. Fine-Tuning Representation Models for Classification
-
12. Fine-Tuning Generation Models
- The Three LLM Training Steps: Pre-training, Supervised Fine-Tuning, and Preference Tuning
- Supervised Fine-Tuning (SFT)
- Instruction Tuning with QLoRA
- Evaluating Generative Models
- Preference-Tuning / Alignment / RLHF
- Automating Preference Evaluation Using Reward Models
- Preference Tuning with DPO
- Summary
- Afterword
- About the Authors
Product information
- Title: Hands-On Large Language Models
- Author(s):
- Release date: September 2024
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781098150969
You might also like
book
Modern Generative AI with ChatGPT and OpenAI Models
Harness the power of AI with innovative, real-world applications, and unprecedented productivity boosts, powered by the …
book
Designing Large Language Model Applications
Transformer-based language models are powerful tools for solving a variety of language tasks and represent a …
book
Quick Start Guide to Large Language Models: Strategies and Best Practices for Using ChatGPT and Other LLMs
The advancement of Large Language Models (LLMs) has revolutionized the field of Natural Language Processing in …
book
Deep Learning for Coders with fastai and PyTorch
Deep learning is often viewed as the exclusive domain of math PhDs and big tech companies. …