Tutorial

1. Autonomous vehicle
   1. Camera (vision), LIDAR (depth), fuel & oil volume / temperature gauges, accelerometer, GPS
   2. Accelerate vehicle, brake vehicle, start engine, stop engine, blink indicator lights
   3. Car roads with at most only basic information about the road (dimensions, lanes, traffic lights, connections)
2. Inaccessible (there is some level of delay between sensors and computation, and not all information about road conditions, other drivers, etc is available), dynamic (other vehicles on the road can act in their own way), non-episodic (..), stochastic (we cannot know for certain if the engine won’t hit some sort of fault, there may be an incident on the road, etc), continuous (possible actions constantly change depending on road conditions)
3. Chess AI, accessible, deterministic, episodic, dynamic, continuous
4. .
   1. an,an,an,an,ae
   2. an,an,an,ae,ae,ae,ae,an,an,ae and ae,ae,ae,ae,an,an,an,ae,ae,an,an,an,an
   3. No, as it would have to go south after going north on the right side of the board.
   4. Minimum is -10 as it could get stuck in the top left area after crossing the circle. The maximum is 10 as it could just reach the goal.
   5. 0.5×0.5×1×((0.5×0.5)+(0.5×0.5)) = 0.12