Training an embedding

The embedding can be trained with a model the one shown here: 

As shown in the preceding image, the target word is predicted based on context or history. The prediction is based on the Softmax classifier. The hidden layer learns the embedding as a compact representation.  Note that this is not a full deep learning model, but it still works well. Here is a low dimensional visualization of the embedding:

Low dimensional visualization of the embedding using Softmax classifier

This visualization is generated using TensorBoard. ...

Get Deep Learning for Computer Vision now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.