Jensen's inequality

cosmos 4th November 2016 at 2:43pm

video

Let ff be a Convex function, f0f'' \geq 0

Let XX be a Random variable

Then,

f(E[X])E[f(X)]f(\mathbb{E}[X]) \leq \mathbb{E}[f(X)]

where E\mathbb{E} denotes Expectation

Picture

(this is a nice case, one can imagine less intuitive cases, but the inequality is still true).

Further, if f(X)>0f''(X) > 0 (ff is strictly convex), then

f(E[X])=E[f(X)]X=E[X]f(\mathbb{E}[X]) = \mathbb{E}[f(X)] \Leftrightarrow X = \mathbb{E}[X] w.p. 11

If f0f'' \leq 0 (ff is concave)

f(E[X])E[f(X)]f(\mathbb{E}[X]) \geq \mathbb{E}[f(X)]

etc.