Chapman-Kolmogorov equations (Markov chain)

Several comments:
I don't see how you get from before "Hence" to the formula after.
Since Qi,jQ_{i,j} is a probability it must be in the [0,1][0,1] range, but I don't see how this can be true for arbitrary Pi,jP_{i,j} -- e.g. when Pi,j=23P_{i,j}=\frac{2}{3}
 
Top