LETTER A 👁 163 views

Activation Function

Function that determines the output of a neuro, non-linearity to the network.

The nervous networks without activation functions could only do linear processes; functions such as ReLU, Sigmoid and Softmax allow the network to learn complex images.
Preparing the interactive experiment…