This could have gone in the Programmer's Symposium as well, but I'll ask here since it is really about the underlying math. For some background, a Markov chain is a sequence of things where the ...