One of the most interesting concepts that are very important today and very easy to visualize is "overfitting". The green classifier below presents a clear example of overfitting [Edit: "the green classifier is given by the very wiggly line separating red and blue data points" - Nick Cox].
From Wikipedia: