Question 4 9 marks Consider the process {XEN where Xn is the outcome of a die...
Consider the process E here Xn is the outcome of a die on the nth roll at XnEN is a Markov chain. (b) Determine the state space S and the transition matrix P (with, as usual, reasoning Consider the process E here Xn is the outcome of a die on the nth roll at XnEN is a Markov chain. (b) Determine the state space S and the transition matrix P (with, as usual, reasoning
Consider the Markov chain X0,X1,X2,... on the state space S = {0,1} with transition matrix P= (a) Show that the process defined by the pair Zn := (Xn−1,Xn), n ≥ 1, is a Markov chain on the state space consisting of four (pair) states: (0,0),(0,1),(1,0),(1,1). (b) Determine the transition probability matrix for the process Zn, n ≥ 1.
Q5. Consider a Markov chain {Xn|n ≥ 0} with state space S = {0, 1, · · · } and transition matrix (pij ). Find (in terms QA for appropriate A) P{ max 0≤k≤n Xk ≤ m|X0 = i} . Q6. (Flexible Manufacturing System). Consider a machine which can produce three types of parts. Let Xn denote the state of the machine in the nth time period [n, n + 1) which takes values in {0, 1, 2, 3}. Here...
Consider a process {Xn, n = 0,1, ... }, which takes on the values 0,1, or 2. Suppose P{Xn+1 = ||Xn = i, Xn-1 = in-1,..., X0 = i +0} = when n is even when n is odd where - P = - Phl = 1, i = 0,1,2. Is {Xn, n = 0,1,... } a time-homogeneous Markov chain? If not, then show how, by enlarging the state space, we may transform it into a time- homogeneous Markov chain.
Question 5 9 marks Consider a Markov chain {YTheN with state space S = {1,2,3,4), initial distribution Po (0.25,0.25, 0.5,0), and transition matrix 1/3 2/3 0 0 p 1/6 1/2 1/30 0 4/9 4/9 1/9 0 0 5/6 1/6 2(a) Find the equilibrium probability distribution T (b) Find the probability P(-1%-3. Ya-1). Question 5 9 marks Consider a Markov chain {YTheN with state space S = {1,2,3,4), initial distribution Po (0.25,0.25, 0.5,0), and transition matrix 1/3 2/3 0 0 p...
Let p E [0,1] with pメ, and let (Xn)n=o b l e the Markov chain on with initia [0,1] given by distribution δο and transition matrix 11: Z Z ify=x-1 p 0 otherwise. Use the strong law of large numbers to show that each state is transient. Hint: consider another Markov chain with additional structure but with the same distribution and transition matrix Let p E [0,1] with pメ, and let (Xn)n=o b l e the Markov chain on with...
Consider a two state Markov chain with one-step transition matrix on the states 1,21, , 0<p+q<2. 91-9 ' Show, by induction or otherwise, that the n-step transition matrix is Ptg -99 Based upon the above equation, what is lim-x P(Xn-2K-1). How about limn→x P(Xn-
Let Xn be a Markov chain with state space {0,1,2}, the initial probability vector and one step transition matrix a. Compute. b. Compute. 3. Let X be a Markov chain with state space {0,1,2}, the initial probability vector - and one step transition matrix pt 0 Compute P-1, X, = 0, x, - 2), P(X, = 0) b. Compute P( -1| X, = 2), P(X, = 0 | X, = 1) _ a. 3. Let X be a Markov chain...
9. Consider the Branching Process {Xn,n = 0,1,2,3,...} where Xn is the population size at the nth generation. Assume P(Xo = 1) = 1 and that the probability generating function of the offspring distribution is common A(z) (z3322z + 4) 10 (а) If gn 3 P(X, — 0) for n %3D 0, 1,..., write down an equation relating ^n+1 and qn. 0,1,2 Hence otherwise, evaluate qn for n= or (b) Find the extinction probability q = lim00 n 6 marks]...
Suppose that we have a finite irreducible Markov chain Xn with stationary distribution π on a state space S. (a) Consider the sequence of neighboring pairs, (X0, X1), (X1, X2), (X2, X3), . . . . Show that this is also a Markov chain and find the transition probabilities. (The state space will be S ×S = {(i,j) : i,j ∈ S} and the jumps are now of the form (i, j) → (k, l).) (b) Find the stationary distribution...