Home /
Expert Answers /
Statistics and Probability /
q1-for-the-following-markov-chains-partition-the-state-space-into-a-set-of-transient-states-and-a-pa500
(Solved): Q1. For the following Markov chains, partition the state space into a set of transient states and a ...
Q1. For the following Markov chains, partition the state space into a set of transient states and a union
of irreducible closed sets.
(a) P=[[(1)/(2),(1)/(2),0,0,0,0],[(1)/(2),(1)/(2),0,0,0,0],[0,0,(1)/(3),(2)/(3),0,0],[0,0,(2)/(3),(1)/(3),0,0],[(1)/(6),(1)/(6),(1)/(6),(1)/(6),(1)/(6),(1)/(6)],[(1)/(6),(1)/(6),(1)/(6),(1)/(6),(1)/(6),(1)/(6)]]
(b) P=[[0.7,0,0,0,0.3,0,0],[0.1,0.2,0.3,0.4,0,0,0],[0,0,0.5,0.3,0.2,0,0],[0,0,0,0.5,0,0.5,0],[0.6,0,0,0,0.4,0,0],[0,0,0,0,0,0.2,0.8],[0,0,0,0.1,0,0,0]]
(c) P=[[(1)/(2),(1)/(2),0,0,0,0],[(1)/(3),(2)/(3),0,0,0,0],[0,0,(1)/(8),0,(7)/(8),0],[(1)/(4),(1)/(4),0,0,(1)/(4),(1)/(4)],[0,0,(3)/(4),0,(1)/(4),0],[0,(1)/(5),0,(1)/(5),(1)/(5),(2)/(5)]]