Done (a), please help with (c). Thanks 1. Discussion and Quiz question Two dogs, Hinkler and Moke, have three fleas...
1. Discussion and Quiz question Two dogs, Hinkler and Moke, have three fleas between them Every day, dog. On each day, which flea jumps is random, and all three fleas have the same probability of jumping, regardless of which dogs the fleas are on Define Xn to be the number of fleas on Moke after n days. Then (Xn, n = 0, 1, 2, ...) forms a Markov chain with state space S = {0,1,2,3}. Initially, all three fleas are on Hinkler, meaning that Xo 0. (and only one) flea jumps from the dog it is currently on and lands on the other one (a) Some of the entries of the transition matrix, P, are shown. Find the rest 0 /3 P = 0 1/3 2/3 0 (b) Confirm to yourself that this Markov chain is a birth-death chain (c) Find the equilibrium distribution (s) distribution (TO, T1, T2, T3). Is there a unique equilibrium TT = or more than one? Hint: use the Detailed Balance Equations. -0ldl
1. Discussion and Quiz question Two dogs, Hinkler and Moke, have three fleas between them Every day, dog. On each day, which flea jumps is random, and all three fleas have the same probability of jumping, regardless of which dogs the fleas are on Define Xn to be the number of fleas on Moke after n days. Then (Xn, n = 0, 1, 2, ...) forms a Markov chain with state space S = {0,1,2,3}. Initially, all three fleas are on Hinkler, meaning that Xo 0. (and only one) flea jumps from the dog it is currently on and lands on the other one (a) Some of the entries of the transition matrix, P, are shown. Find the rest 0 /3 P = 0 1/3 2/3 0 (b) Confirm to yourself that this Markov chain is a birth-death chain (c) Find the equilibrium distribution (s) distribution (TO, T1, T2, T3). Is there a unique equilibrium TT = or more than one? Hint: use the Detailed Balance Equations. -0ldl