Balls and bins

cosmos 29th May 2018 at 5:00pm
Doob martingale

An example of a Doob martingale. Suppose that we throw mm balls into nn bins independently and uniformly at random. This is one of the most-studied random experiments and we usually ask questions about the expected maximum load or the expected number of empty bins.

Here we consider the expected number of empty bins. Let XiX_i be the random variable representing the bin into which the ii-th ball falls. Let YY be a random variable representing the number of empty bins. Then the sequence of random variables

Zi=E[YX1,,Xi] Z_i=E[Y \,|\, X_1,\ldots,X_i]

is a martingale. Clearly ZiZ_i is a function of the X1,,XiX_1,\ldots,X_i’s and has bounded expectation. Furthermore

E[Zi+1X1,,Xi]=E[E[YX1,,Xi,Xi+1] E[Z_{i+1} \,|\, X_1,\ldots,X_i] =E[E[Y \,|\, X_1,\ldots,X_i,X_{i+1}] \,|\, X1,,Xi]=E[YX1,,Xi]=Zi.X_1,\ldots,X_i] = E[Y \,|\, X_1,\ldots,X_i] = Z_i.

We can view ZiZ_i as an estimate of YY after having observed the outcomes X1,,XiX_1,\ldots,X_i. At the beginning Z0Z_0 is a crude estimate, simply the expectation of YY. As we add more balls to the bins, ZiZ_i’s give improved estimates of YY, and at the end we get the exact value Zm=YZ_m=Y.