Question

John finds a bill on his desk. He has three options: ignore it and leave it on his own desk, move the bill over to his wife Mary's desk, or pay the bill immediately. The probability that he leaves it on his own desk is 0.2. The probability that he moves it to Mary's desk is 0.7. The probablity that he pays the bill immediately is 0.1 Similarly, if Mary finds a bill on her desk she can choose to leave it on her own desk, put it on John's desk, or pay it immediately. The probability that it remains on her desk is 0.6. The probability she moves it to John's desk is 0.1. The probability she pays it immediately is 0.3. Once a bill is paid it will not return to either of the desks. Assume this is a Markov Chain process. Set up the transition matrix and use it to answer the following questions.(Give your answers correct to three decimal places (a) Find the probability a bill now on John's desk will be paid within two days (b) What is the probability a bill now on John's desk will be on Mary's desk 3 days later? c) On average, how many days will pass before a billplaced on John's desk is paid? days

Answer 1

ven ha Lat J on Johni clut 6 6 0:3 MB rCon Johni duk coll| |rd in 2。 on 2n dolog (0.2(01)), d ho, put t on miou 0.02-to-11 O-나 = 0.33 alor da tate Can hoppon in Scanned with CamScanner cs

下hn leave, day clak on 1 day 2 and lotitin mau 7 0052 Scanned with CamScanner