Recall from Chapter 10, The Perceptron that while some Boolean functions such as AND, OR, and NAND can be approximated by the perceptron, the linearly inseparable function XOR cannot, as shown in the following plots:
Let's review XOR in more detail to develop an intuition of the power of ANN. In contrast to AND, which outputs 1 when both of its inputs are equal to 1, and OR, which outputs 1 when at least one of the inputs are equal to 1, the output of XOR is 1 when exactly one of its inputs is equal to 1. We can view XOR as outputting 1 when two conditions are true. The first condition is that at least one of ...
