Deep Learning with TensorFlow, Keras, and PyTorch

Deep Learning with TensorFlow, Keras, and PyTorch

by Jon Krohn
Released February 2020
Publisher(s): Pearson
ISBN: 0136617611

Watch it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Video description

7+ Hours of Video Instruction

An intuitive, application-focused introduction to deep learning and TensorFlow, Keras, and PyTorch

Overview

Deep Learning with TensorFlow, Keras, and PyTorch LiveLessons is an introduction to deep learning that brings the revolutionary machine-learning approach to life with interactive demos from the most popular deep learning library, TensorFlow, and its high-level API, Keras, as well as the hot new library PyTorch. Essential theory is whiteboarded to provide an intuitive understanding of deep learning’s underlying foundations; i.e., artificial neural networks. Paired with tips for overcoming common pitfalls and hands-on code run-throughs provided in Python-based Jupyter notebooks, this foundational knowledge empowers individuals with no previous understanding of neural networks to build powerful state-of-the-art deep learning models.

About the Instructor
Jon Krohn is the Chief Data Scientist at the machine learning company untapt. He presents a popular series of tutorials published by Addison-Wesley and is the author of the acclaimed book Deep Learning Illustrated. Jon teaches his deep learning curriculum in-classroom at the New York City Data Science Academy. He holds a doctorate in neuroscience from Oxford University, lectures at Columbia University, and carries out machine vision research at Columbia’s Irving Medical Center.

Skill Level
  • Intermediate
Learn How To
  • Build deep learning models in all the major libraries: TensorFlow, Keras, and PyTorch
  • Understand the language and theory of artificial neural networks
  • Excel across a broad range of computational problems including machine vision, natural language processing, and reinforcement learning
  • Create algorithms with state-of-the-art performance by fine-tuning model architectures
  • Self-direct and complete your own Deep Learning projects
Who Should Take This Course
  • Software engineers, data scientists, analysts, and statisticians with an interest in deep learning.
  • Code examples are provided in Python, so familiarity with it or another object-oriented programming language would be helpful.
  • Previous experience with statistics or machine learning is not necessary.
Course Requirements

Some experience with any of the following are an asset, but none are essential:
  • Object-oriented programming, specifically Python
  • Simple shell commands; e.g., in Bash
  • Machine learning or statistics
Lesson Descriptions

Lesson 1: Introduction to Deep Learning and Artificial Intelligence
The first lesson starts off by giving the viewer an overview of what neural networks are, how they’re related to machine learning (ML) and artificial intelligence (AI), as well as the breadth of transformative applications deep learning has supplied. Subsequently, Jon leverages visual analogies to describe what deep learning is and why it’s a uniquely powerful approach. You use an interactive tool to observe for yourself in real-time how a deep learning network learns, and Jon goes over how to run the code examples he provides throughout these LiveLessons before building an introductory neural network with you.

Lesson 2: How Deep Learning Works
The lesson begins with a discussion of the main families of deep neural networks and their applications. The heart of the lesson is a high-level overview of the essential theory that underlies deep learning. To bring this theory to life, Jon shows you deep learning in action via a web application called the TensorFlow Playground. He introduces the archetypal deep learning data sets, and then you build a deep neural network together to tackle a classic machine vision problem.

Lesson 3: High-Performance Deep Learning Networks
The previous lesson covered the principal foundations of deep learning and enabled you to construct a deep network. This lesson builds upon those theoretical foundations by covering weight initialization, unstable gradients, batch normalization, how to avoid overfitting, and more sophisticated learning optimizers. This additional theory enables you to build a state-of-the-art deep learning model using TensorFlow’s Keras API. In addition, you and Jon tackle a regression problem with deep learning for the first time, having focused on classification problems only up until this point. In order to make sense of the outputs from these sophisticated models, the TensorBoard result-visualization tool is added to your arsenal at the end of the lesson.

Lesson 4: Convolutional Neural Networks
Up to this point you have relied exclusively on dense nets to solve the machine learning problems. In this lesson, you dig into the theory of convolutional layers and then stack them together with Keras in TensorFlow in order to build your first convolutional neural network. Jon wraps up the lesson by discussing model architectures.

Lesson 5: Moving Forward with Your Own Deep Learning Projects
In Lesson 5, Jon compares and contrasts all the leading Deep Learning libraries and provides detailed hands-on examples of how to use PyTorch ‚Äì the hot new library on the block ‚Äì to build deep learning models. He concludes these LiveLessons by providing a framework for optimally tuning any model’s hyperparameters before leaving you with advice on how to build your own deep learning project, including datasets and resources for further self-study.

About Pearson Video Training

Pearson publishes expert-led video tutorials covering a wide selection of technology topics designed to teach you the skills you need to succeed. These professional and personal technology videos feature world-leading author instructors published by your trusted technology brands: Addison-Wesley, Cisco Press, Pearson IT Certification, Prentice Hall, Sams, and Que Topics include: IT Certification, Network Security, Cisco Technology, Programming, Web Development, Mobile Development, and more. Learn more about Pearson Video training at http://www.informit.com/video.

Table of contents

  1. Introduction
    1. Deep Learning with TensorFlow, Keras, and PyTorch: Introduction
  2. Lesson 1: Introduction to Deep Learning and Artificial Intelligence
    1. Topics
    2. 1.1 Neural Networks, Machine Learning, and Artificial Intelligence--Part 1
    3. 1.2 Neural Networks, Machine Learning, and Artificial Intelligence--Part 2
    4. 1.3 A Visual Introduction to Deep Learning--Part 1
    5. 1.4 A Visual Introduction to Deep Learning--Part 2
    6. 1.5 TensorFlow Playground--Visualizing a Deep Net in Action
    7. 1.6 Running the Hands-On Code Examples in Jupyter Notebooks
    8. 1.7 An Introductory Neural Network with TensorFlow and Keras--Part 1
    9. 1.8 An Introductory Neural Network with TensorFlow and Keras--Part 2
  3. Lesson 2: How Deep Learning Works
    1. Topics
    2. 2.1 Neural Units--Part 1
    3. 2.2 Neural Units--Part 2
    4. 2.3 Neural Networks--Part 1
    5. 2.4 Neural Networks--Part 2
    6. 2.5 Training Deep Neural Networks--Part 1
    7. 2.6 Training Deep Neural Networks--Part 2
    8. 2.7 Training Deep Neural Networks--Part 3
    9. 2.8 An Intermediate Neural Net with TensorFlow and Keras
  4. Lesson 3: High-Performance Deep Learning Networks
    1. Topics
    2. 3.1 Weight Initialization
    3. 3.2 Unstable Gradients and Batch Normalization
    4. 3.3 Model Generalization--Avoiding Overfitting
    5. 3.4 Fancy Optimizers
    6. 3.5 A Deep Neural Net with TensorFlow and Keras
    7. 3.6 Regression Models
    8. 3.7 TensorBoard and the Interpretation of Model Outputs
  5. Lesson 4: Convolutional Neural Networks
    1. Topics
    2. 4.1 Convolutional Layers
    3. 4.2 A ConvNet with TensorFlow and Keras
    4. 4.3 Machine Vision Applications
  6. Lesson 5: Moving Forward with Your Own Deep Learning Projects
    1. Topics
    2. 5.1 Comparison of the Leading Deep Learning Libraries
    3. 5.2 Deep Learning with PyTorch--Part 1
    4. 5.3 Deep Learning with PyTorch--Part 2
    5. 5.4 Hyperparameter Tuning
    6. 5.5 Datasets for Deep Learning and Resources for Self-Study
  7. Summary
    1. Deep Learning with TensorFlow, Keras, and PyTorch: Summary

Product information

  • Title: Deep Learning with TensorFlow, Keras, and PyTorch
  • Author(s): Jon Krohn
  • Release date: February 2020
  • Publisher(s): Pearson
  • ISBN: 0136617611