Every-Visit Monte Carlo: average the returns following every visit to a state in an episode; count for each subset of the episode that state appears in.
Every-Visit Monte Carlo: average the returns following every visit to a state in an episode; count for each subset of the episode that state appears in.