The Bias–Variance Trade-off

The best model is rarely the one with the lowest training error. A decision between bias and variance needs to be made