Activation function translates the inputs into outputs. Activation function decides whether a neuron should be activated or not by calculating the weighted sum and further adding bias with it. The purpose of the activation function is to introduce non-linearity into the output of a neuron.
There can be many Activation functions like :
* Linear or Identity
* Unit or Binary Step
* Sigmoid or Logistic
* Tanh
* ReLU
* Softmax
