Readers are provided once again with instructive mix of mathematics, physics, statistics, and information theory. All the important topics in information theory is discussed in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. Historical notes that follow each chapter recap the main points. Second Edition Features: * Chapters reorganized to improve teaching * 200 new problems * New material on source coding, portfolio theory, and the feedback capacity * Updated references Now current and enhanced, Second Edition Elements of Information Theory remains the ideal textbook for upper level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications.