100% satisfaction guarantee Immediately available after payment Both online and in PDF No strings attached
logo-home
Probabilistic Machine Learning An Introduction 1st Edition By Kevin P. Murphy (Solution Manual) $18.49   Add to cart

Exam (elaborations)

Probabilistic Machine Learning An Introduction 1st Edition By Kevin P. Murphy (Solution Manual)

 260 views  4 purchases
  • Course
  • Probabilistic Machine Learning An Introduction, 1e
  • Institution
  • Probabilistic Machine Learning An Introduction, 1e

Probabilistic Machine Learning An Introduction, 1e Kevin P. Murphy (Solution Manual) Probabilistic Machine Learning An Introduction, 1e Kevin P. Murphy (Solution Manual)

Preview 4 out of 57  pages

  • August 12, 2023
  • 57
  • 2023/2024
  • Exam (elaborations)
  • Questions & answers
  • Probabilistic Machine Learning An Introduction, 1e
  • Probabilistic Machine Learning An Introduction, 1e
avatar-seller
tutorsection
Full Solution Manual for
“Probabilistic Machine Learning: An Introduction”
Kevin Murphy
1 1 Solutions
2 Part I
Foundations
3 2 Solutions
2.1 Conditional independence
PRIVATE
1. Bayes’ rule gives
P(HjE1;E2) =P(E1;E2jH)P(H)
P(E1;E2)(1)
Thus the information in (ii) is sufficient. In fact, we don’t need P(E1;E2)because it is equal to the
normalization constant (to enforce the sum to one constraint). (i) and (iii) are insufficient.
2. Now the equation simplifies to
P(HjE1;E2) =P(E1jH)P(E2jH)P(H)
P(E1;E2)(2)
so (i) and (ii) are obviously sufficient. (iii) is also sufficient, because we can compute P(E1;E2)using
normalization.
2.2 Pairwise independence does not imply mutual independence
We provide two counter examples.
LetX1andX2be independent binary random variables, and X3=X1X2, whereis the XOR
operator. We have p(X3jX1;X2)6=p(X3), sinceX3can be deterministically calculated from X1andX2. So
the variablesfX1;X2;X3gare not mutually independent. However, we also have p(X3jX1) =p(X3), since
withoutX2, no information can be provided to X3. SoX1?X3and similarly X2?X3. HencefX1;X2;X3g
are pairwise independent.
Here is a different example. Let there be four balls in a bag, numbered 1 to 4. Suppose we draw one at
random. Define 3 events as follows:
•X1: ball 1 or 2 is drawn.
•X2: ball 2 or 3 is drawn.
•X3: ball 1 or 3 is drawn.
We havep(X1) =p(X2) =p(X3) = 0:5. Also,p(X1;X2) =p(X2;X3) =p(X1;X3) = 0:25. Hence
p(X1;X2) =p(X1)p(X2), and similarly for the other pairs. Hence the events are pairwise independent.
However,p(X1;X2;X3) = 06= 1=8 =p(X1)p(X2)p(X3).
2.3 Conditional independence iff joint factorizes
PRIVATE
Independency)Factorization. Let g(x;z) =p(xjz)andh(y;z) =p(yjz). IfX?YjZthen
p(x;yjz) =p(xjz)p(yjz) =g(x;z)h(y;z) (3)
4

The benefits of buying summaries with Stuvia:

Guaranteed quality through customer reviews

Guaranteed quality through customer reviews

Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.

Quick and easy check-out

Quick and easy check-out

You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.

Focus on what matters

Focus on what matters

Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!

Frequently asked questions

What do I get when I buy this document?

You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.

Satisfaction guarantee: how does it work?

Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.

Who am I buying these notes from?

Stuvia is a marketplace, so you are not buying this document from us, but from seller tutorsection. Stuvia facilitates payment to the seller.

Will I be stuck with a subscription?

No, you only buy these notes for $18.49. You're not tied to anything after your purchase.

Can Stuvia be trusted?

4.6 stars on Google & Trustpilot (+1000 reviews)

72042 documents were sold in the last 30 days

Founded in 2010, the go-to place to buy study notes for 14 years now

Start selling
$18.49  4x  sold
  • (0)
  Add to cart