Video description
Whether you need to automatically judge the sentiment of a user review, summarize long documents, translate text, or build a chatbot, you need the best language model available. In 2018, pretty much every NLP benchmark was crushed by novel transformer-based architectures, replacing long-standing architectures based on recurrent neural networks. In short, if you’re into NLP, you need transformers.
But to use transformers, you need to know what they are, what transformer-based architectures look like, and how you can implement them in your projects.
Aurélien Géron (Kiwisoft) dives into recurrent neural networks and their limits, the invention of the transformer, attention mechanisms, the transformer architecture, subword tokenization using SentencePiece, self-supervised pretraining—learning from huge corpora, one-size-fits-all language models, BERT and GPT 2, and how to use these language models in your projects using TensorFlow.
What you'll learn
- Understand transformers and modern language models and how they can tackle complex NLP tasks
- Identify what tools to use and what the code looks like
Product information
- Title: Natural language processing using transformer architectures
- Author(s):
- Release date: February 2020
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 0636920373582
You might also like
book
Natural Language Processing with PyTorch
Natural Language Processing (NLP) provides boundless opportunities for solving problems in artificial intelligence, making products such …
video
Introduction to Transformer Models for NLP: Using BERT, GPT, and More to Solve Modern Natural Language Processing Tasks
10+ Hours of Video Instruction Learn how to apply state-of-the-art transformer-based models including BERT and GPT …
video
AI Catalyst Conference: NLP with ChatGPT (and other Large Language Models): Transformer Architectures from Development to Deployment
3 Hours of Video Discover the astounding state-of-the-art in Natural Language Processing (NLP) that is enabled …
book
Transformers for Natural Language Processing - Second Edition
OpenAI's GPT-3, ChatGPT, GPT-4 and Hugging Face transformers for language tasks in one book. Get a …