Question

Let X and Y be two random variables defined on sets X and y, respectively. Let Z-X + Y be a new random variable (a) Show that if X and Y are independent, then H (ZlX) = H(Y), and conclude that H (Z) > max(H(X), H(Y)) for independent X and Y. (b) Give an example of random variables for which H(Z) < H(X) and H(Z)くHO ). (c) Compare H(Z) and H(X,Y). (d) Under what conditions does H(Z) = H(X) + H(Y)?

H(X) means entropy of X.

I have some questions when solving this problem.

(a) Refer to similar questions, H(Z|X)=H(Y|X) if Z=X+Y, I want to know whether we can simplify H(X|Z)?

(b) if Px(X=0)=0.5, Px(X=1)=0.5, Py(Y=0)=0.5, Py(Y=-1)=0.5, if they are not independent, can I just give random variable Z with its probability distribution as P(Z=0)=1, P(Z=1)=0, P(Z=-1)=0.

(c)Plus, I also want to know the answer to the original problem with 4 questions.

0 0
Add a comment Improve this question Transcribed image text
Know the answer?
Add Answer to:
H(X) means entropy of X. I have some questions when solving this problem. (a) Refer to...
Your Answer:

Post as a guest

Your Name:

What's your source?

Earn Coins

Coins can be redeemed for fabulous gifts.

Not the answer you're looking for? Ask your own homework help question. Our experts will answer your question WITHIN MINUTES for Free.
Similar Homework Help Questions
ADVERTISEMENT
Free Homework Help App
Download From Google Play
Scan Your Homework
to Get Instant Free Answers
Need Online Homework Help?
Ask a Question
Get Answers For Free
Most questions answered within 3 hours.
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT