A cost function is an algorithm that allows us to quantify how "wrong" a model or algorithm is. The cost function represents the error in the machine learning model and ideally should be 0 when the model is perfect.
The goal of using a cost function is to minimize the error, or the "cost", of a model by adjusting its parameters or making other changes to improve its predictions.
Types