Batch gradient descent is a method of performing gradient descent in which the parameters are updated using the average of the all the gradients the training set.