A Stochastic process where the Random variables depend only the previous variable. More precisely, each random variable is independent of all the others, given its immediate predecessor, it thus satisfies the Markov property. For Continuous-time stochastic process, the definition needs to be tackled more carefully.
Chapman-Kolmogorov equation
Visualization: http://setosa.io/ev/markov-chains/