SOLVED:Which of the following matrices are transition matrices for regular Markov chains? (a) 𝐏=( .5 .5 .5 .5). (b) 𝐏=( .5 .5 1 0). (c) 𝐏=( 1 / 3 0 2 / 3 0 1 0 0 1 / 5 4 / 5) (d) 𝐏=( 0 1 1 0). (e) 𝐏=( 1 / 2 1 / 2 0 0 1 / 2 1 / 2 1 / 3 1 / 3 1 / 3)

Let P^(1) and P^(2) denote transition probability matrices for ergodic Markov chains having the same state space. Let π^1 and π^2 denote the stationary (limiting) probability vectors for the two chains. Consider a process defined as follows: (i) X0=1. A coin is then flipped and if it comes up heads, then the remaining states X1, …are obtained from the transition probability matrix P^(1) and if tails from the matrix P^(2). Is {Xn, n ⩾0} a Markov chain? If p=P{ coin comes up heads }, what is limn

SOLVED: Given the following (one-step) transition matrices of a Markov chain, determine the classes of the Markov chain and whether they are recurrent; State(a) P=3 LoState01 0 0 ! 0 1(b) P=