See Overfitting and underfitting

A learning algorithm with low bias (it is more flexible), which however has a lot of variance, as it fits the idiosyncrasies of the data; it fits the noise.

guard against overfitting with prior knowledge (inductive bias)