Eroxl's Notes
Overfitting

Overfitting happens when an algorithm only learns to fit the training data but doesn’t actually understand anything about underlying input-output, the algorithm basically just memorizes the training data. This is the opposite problem to underfitting.

The following is an example of an algorithm that generated an overfit function to the training data and a properly fit function

Overfit Function

Y axisX axis00-4-4-2-22244-20-202020Expression 1Expression 2Expression 3Expression 4Expression 5Expression 6Expression 7Expression 8

Properly Fit Function

Y axisX axis00-4-4-2-22244-20-202020Expression 1Expression 2Expression 3Expression 4Expression 5Expression 6Expression 7Expression 8