TEST BANK FOR Information, Theory, Coding and Cryptography 3rd Edition By Ranjan Bose Converted

SOLUTIONS FOR CHAPTER 1 Q.1.1 DMS with source probabilities : {0.30 0.25 0.20 0.15 0.10} Entropy H(X) = Σi i i p p log 1 = 0.30 log 1/0.30 + 0.25 log 1/0.25 + …………… = 2.228 bits Q.1.2 Define D(p ⎜⎜q) = Σi i i i p q p log (1) pi, qi – probability distributions of discrete source X. D(p ⎜⎜q) = Σi i i i p q p log ≤ Σ ⎟ ⎟⎠ ⎞ ⎜ ⎜⎝ ⎛ − i i i i p q P 1 [using identity ln x ≤ x – 1] = 0 ) ( = − Σi i i q p ∴ D(p ⎜⎜q...