When first understanding estimators and their error, it's useful to understand two sources of error: bias and variance. The below image does a great job illustrating this while highlighting tradeoffs between these two sources of error.

The bullseye is the true value the estimator is trying to estimate and each dot represents and estimate of that value. Ideally you have low bias and low variance, but the other dart boards represent less than ideal estimators.