Statistical physics deals with the description of systems for which a deterministic description is either useless or impossible, so that one uses a statistical description.
Here a deterministic description is understood in the context of the relevant physical description. For example Schrodinger's equation is deterministic, if the relevant physical description is the wavefunction. It is non-deterministic if one takes position and/or velocity as the relevant physical descriptions. However, it is known that one can't describe quantum mechanical evolution purely with a statistical theory of position and velocity, without sacrificing some rather well-established physical principles or predictions.
If the system is effectively classical (either because it is macroscopic, or for some other reason, that is probably ultimately related to Quantum decoherence), the need for a statistical description arises when the system is sufficiently chaotic. Most often this requires the system to: have many components and/or be coupled to a system with many components.
For this reason, statistical physics is mostly applied to the description of systems of many particles in a gas, liquid or solid; or to one or a few particles coupled to one such large system.
There are two main branches of statistical physics:
Equilibrium statistical physics deals with such systems at equilibrium, that is, when the relevant macroscopic averages of the statistical description don't change with time. In practice, one often has two approaches:
Non-equilibrium statistical physics deals with such a system out of equilibrium, so that averages can change in time. This is much harder to do in full generality, as systems offer much more diversity out of equilibrium, as may be expected. One often has three approaches:
Thermodemonics https://fqxi.org/community/articles/display/234?fbclid=IwAR3ueguT_2YeeO_EolzFaU28l1-SPglHJtKbV1vFYyfyIYVeQZw8nSCpfM0
See also Complex systems, and Sloppy systems
Entropy, Order Parameters, and Complexity
Long-range interacting systems
Bangalore School on Statistical Physics - V (video lectures)
Bangalore School on Statistical Physics - VI (I'm on the 1st lecture on Long-range interacting systems
See about disordered systems in Condensed matter physics, as these are interesting systems studied using statistical physics.
Indian Statistical Physics Community Meeting 2016
Interesting papers on statistical physics and complex systems
Non‐equilibrium thermodynamics: foundations, scope, and extension to the meso‐scale
Non-equilibrium thermodynamics - de Groot and Mazur
Statistical Mechanics II course
Sethan's Statistical Mechanics: Entropy, Order Parameters, and Complexity
MIT 8.333 Statistical Mechanics I
MIT 8.334 Statistical Mechanics II
Statistical physics, Optimization, Inference and Message-Passing algorithms
Foundations of statistical mechanics
What Is a Macrostate? Subjective Observations and Objective Dynamics
The Backwards Arrow of Time of the Coherently Bayesian Statistical Mechanic
Ludwig Bltzmann and entropy Lots os stuff about entropy..
Philosophy of statistical physics
Probability in physics: stochastic, statistical, quantum
Book: Ensemble modeling : inference from small-scale properties to large-scale systems
https://physics.stackexchange.com/questions/92558/probability-of-finding-n-particles-in-a-volume-v