In each of the graphs pictured, assume that each arrow leaving a vertex has an equal chance of being followed. Hence if there are thee arrows leaving a vertex then there is a 1/3 chance of each being followed.
- For each of the six pictures, find the Markov transition matrix.
- State if the Markov chain given by this matrix is irreducible.
- If the Matrix is irreducible, state if it is aperiodic.
