See Neural network Gaussian process
A Correspondence Between Random Neural Networks and Statistical Field Theory
Exponential expressivity in deep neural networks through transient chaos
Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice
See more at Statistical mechanics of neural networks