Activation Function
Function that determines the output of a neuro, non-linearity to the network.
The nervous networks without activation functions could only do linear processes; functions such as ReLU, Sigmoid and Softmax allow the network to learn complex images.
Interactive experiment preparing...