Sean

One way of breaking open the artificial neural network piñata and getting at all the candy inside is to understand ReLU as a switch.
With an electrical switch n volts in gives n volts out when on, a 45 degree line when graphed. I’m not going to explain off.
The dot product (weighted sum) of a number of dot products is still a dot product.
A pa…[Read more]