Electrical Communications Systems

Spring 2009

---

Assignment 1

• Problems
• 1.5
• 1.11
• 1.15
• 2.3
• 2.14
• 2.22
• XTRA Credit
• For a binary digital source, prove (theoretically) that the maximum source entropy occurs when both messages are equiprobable. What is the maximum value of the source entropy?
• Demonstrate this concept graphically when the digital source generates 3 possible messages.