a.k.a. McDiarmid's inequality
Let Z1,...,Zm∈Z (remember for random variables ∈ is interpreted as they take values in, or the codomain of the r.v. is ) be m i.i.d. Random variables, and let h:Zm→R be a function satisfying, for every k∈{1,...,m} and for all z1,...,zm,zk′∈Z:
- ∣h(z1,...,zk−1,zk,zk+1,...,zm)−h(z1,...,zk−1,zk,zk+1′,...,zm)∣≤c
so changing any of the arguments of h doesn't change the output much.. Then,
P(h(Z1,...,Zm)≥Eh(Z1,...,Zm)+t)≤exp(−mc22t2)
or, equivalently, with probability at least 1−δ we have
- h(Z1,...,Zm)≤Eh(Z1,...,Zm)+c√2mlogδ1
See version using variance here