A thing that does best in {its average case}.
See minimax_and_bayes_estimator.pdf for a formal description of a Bayes optimal decision rule (in the context of Parametric statistical inference as an example), which underlies the general concept of Bayes optimality, as found in several areas of applications.