Markov Property

The Markov Property / Markov Assumption (Limited Horizon) is that we do not factor the history of previous states / transitions depend only on current state: $P(X_t|X_1,\dots ,X_{t-1})\approx P(X_t|X_{t-1})$