* Stochastic Gradient Descent : Here, we use only a single training example for calculation of gradient and parameters.
* Batch Gradient Descent : We calculate the gradient for the whole dataset and perform the update at each iteration.
* Mini-batch Gradient Descent : It’s a variant of Stochastic Gradient Descent and here instead of single training example, mini-batch of samples is used.
