Risk

cosmos 10th April 2019 at 10:58am

Risk is the expected value of the loss (see Introduction to supervised learning theory). Synonymous with Generalization error

Sometimes, risk is actually defined as the expected value of the loss for some estimator, minus the expected value of the loss for the Bayes estimator (what we call Bayes risk).

Excess risk is sometimes defined as the risk minus the minimum risk within some Hypothesis class.


Informal notion of risk

Danger, etc.