To compute the steady state vector, solve the following linear system for Pi, the steady-state vector of the Markov chain: (Q | e)TPi=b Appending e to Q, and a final 1 to the end of the zero-vector on the right-hand side ensures that the solution vector Pi has ...