Draft of 'Softmax'

cosmos 13th September 2016 at 1:33pm

A Layers for deep learning, that consists on exponentiating all vector elements and normalize them to so sum to unity.

σ(y)eyieyi\mathbf{\sigma}(\mathbf{y}) \equiv \frac{e^\mathbf{y}}{\sum_i e^{y_i}}

where the mathematical operations are element-wise.