Reinforcement learning: An Introduction by Richard Sutton and Andrew Barto
Most famous book on Reinforcement learning, by two of the fathers of the field. 2nd version is being finished.