Problem 4: Consider an
n
state system model with state transitions as shown in the accompanying figure and let
p=(1)/(2)
. The system starts at state 0 . Find the expected number of steps it takes to go to state
for a)
q=1
. b)
q=(1)/(2)
.