Grokking Deep Learning

Chapter 5. Learning multiple weights at a time: generalizing gradient descent

In this chapter

• Gradient descent learning with multiple inputs
• Freezing one weight: what does it do?
• Gradient descent learning with multiple outputs
• Gradient descent learning with multiple inputs and outputs
• Visualizing weight values
• Visualizing dot products

“You don’t learn to walk by following rules. You learn by doing and by falling over.”

Richard Branson, http://mng.bz/oVgd

Gradient descent learning with multiple inputs

Gradient descent also works with multiple inputs

In the preceding chapter, you learned how to use gradient descent to update a weight. In this chapter, we’ll more or less reveal how the same techniques can be used to update a network that ...