Information Theory, Inference and Learning Algorithms Illustrated Edition

This is a really good book. It serves as a good introduction to Information theory but it has enough depth and cover enough material be to interesting and insightful even to someone who has already studies the subject in depth. This book is fairly high level and though I found it very interesting and insightful it does not have enough practical information to be useful (on its own) for solving problems in information theory or writing learning algorithms.

Read the book is like talking to a teacher. I can feel the soul of the author. (He had passed away). The book contains solutions to selected problems that are convenient to me for self-study.

Highly recommended. Very coherent and readable. Unique angle of view. The author didn't try to scare the reader away like a lot of other authors did.

Other reviewers have provided all the details you need to know before buying.Just to chime in that this is one of the best technical books I have ever read.It brims with insight and beautiful illustrations of ideas both old and novel.Although you can find a free copy online, do consider getting the print version.It is a great tome to have, and Dr. MacKay certainly deserves the royalties.

As a grad student in optimization with a background in physics, I really enjoy the multi-disciplinary approach of this book. Connections between different fields are frequent throughout the book. However, I often am frustrated with the book's style. Often, something that needs further explanation or clarification does not receive it, and I am forced to "google" the explanation that should be there but isn't.

First of all, the shipping is fast and the price is low. It is a new book but the price is lower than the used one. Second, the book itself is worth reading for fun. It combines so many interesting topics in an unified framework: Bayesian framework, from information theory to neuro network.

The hardcover is much better than the soft cover. Mackay was a visionary, can't wait to read the book.

Coverage or detail? One may not be used to getting both. This book actually uses a detailed description of those questions "left for the reader" as a way to reinforce its pedagogy. I just love this book.