examples

• Simplest approach: Discretization of space – Curse of dimensionality

Problem set up, focus on continuous state space, but discrete action set. Need a model, which can be theoretically derived, or learnt.

Learning algorithm, assuming we can approximate the value function as a linear function of a set of features of the state $s$ (as in Linear regression)

Fitted value iteration

Linear quadratic regulation (LQR)