Question

0.5 0. and a probability Bonus. Consider a Markor chain with two states, an initial probability vector of po- transition matr

0 0
Add a comment Improve this question Transcribed image text
Answer #1

(a). v = P.p0 = (9/20,11/20)T.

(b). The steady state vector v is given by Pv = v or, (P-I2)v = 0. To solve this equation, we have to reduce P-I2 to its RREF which is

1

-4/5

0

0

Now, if v = (v1,v2)T, then the equation (P-I2)v = 0 is equivalent to v1-4v2/5 = 0 or, v1 = 4v2/5. Then v = (4v2/5,v2)T .

If 4v2/5 + v2 = 1, then v2* (9/5) = 1 or, v2 = 5/9 so that v1 = (4/5)*(5/9) = 5=4/9. and v =(v1,v2)T = ( 4/9,5/9)T.

Thus, v = ( 4/9,5/9)T.

Add a comment
Know the answer?
Add Answer to:
0.5 0. and a probability Bonus. Consider a Markor chain with two states, an initial probability v...
Your Answer:

Post as a guest

Your Name:

What's your source?

Earn Coins

Coins can be redeemed for fabulous gifts.

Not the answer you're looking for? Ask your own homework help question. Our experts will answer your question WITHIN MINUTES for Free.
Similar Homework Help Questions
ADVERTISEMENT
Free Homework Help App
Download From Google Play
Scan Your Homework
to Get Instant Free Answers
Need Online Homework Help?
Ask a Question
Get Answers For Free
Most questions answered within 3 hours.
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT