R Harfi 👁 23 views

ReLU

Common activation function, which reset negative inputs, pass as positives.

ReLU is one of the most widely used activation functions in deep networks due to ease of calculation and reduction of gradyan loss.