Bellman Equation

The Bellman equation:

$$U(s)=R(s)+\gamma \underset{a\in A(s)}{\max }\sum _{s^{\prime }}P(s^{\prime }|s,a)U(s^{\prime })$$