(Solved):
Draw the transition diagram for a Markov chain whose transition matrix is P=1/21/3000 ...
Draw the transition diagram for a Markov chain whose transition matrix is P=???1/21/3000?001/401/2?01/31/401/2?1/21/31/400?001/410???? and then determine the proportion of time it spends at each state in the long run. (For convenience, label the states ?,?,x,y,z in order.)