Cover of Elements of Information Theory

Elements of Information Theory

The latest edition of this classic is updated with new problem sets and material

The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory.

Read more

All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points.

The Second Edition features:

* Chapters reorganized to improve teaching

* 200 new problems

* New material on source coding, portfolio theory, and feedback capacity

* Updated references

Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications. An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department.

Audience
adult
Length
epic · 748 pages

Click a tag to see books like this one that share it. Point at it (on a phone, tap it) for less of it instead.

Read it? Sign in to help tag it.

Liked Elements of Information Theory? Here’s where I’d start.

These suit anyone who liked Elements of Information Theory. Sign in and mark a few books for picks shaped around your own taste.

  1. Information Theory, Inference and Learning Algorithms Shares machine learning, computer science, math
  2. An Introduction to Information Theory: Symbols, Signals and Noise Shares math, computer science, information theory
  3. The Mathematical Theory of Communication Shares math, mathematics, science
  4. Probabilistic Graphical Models: Principles and Techniques Shares machine learning, math, computer science

“People who read Elements of Information Theory tend to reach for these next.”

  1. Visual Complex Analysis
  2. Quantum Computation and Quantum Information
  3. Probability Theory: The Logic of Science
  4. Linear Algebra Done Right

“If you want more of the same (science about technology), start with these.”

  1. From Mathematics to Generic Programming
  2. An Introduction to Programming in Go
  3. Real World OCaml: Functional programming for the masses
  4. Handbook of Applied Cryptography

“If it was the math that hooked you, try one of these.”

  1. Pattern Recognition and Machine Learning
  2. Basic Category Theory for Computer Scientists
  3. In Pursuit of the Traveling Salesman: Mathematics at the Limits of Computation
  4. Discrete Mathematics and Its Applications

“These start from a similar idea, even if they go somewhere else with it.”

  1. Pattern Classification
  2. Probability, Random Variables and Stochastic Processes with Errata Sheet
  3. Mathematics of Classical and Quantum Physics
  4. Diplomacy: Theory and Practice