Subjects / Information theory
Best books to learn Information theory, in order
Information theory rests on one idea, entropy, that reframes everything after it, so it must be built carefully first. A good path starts with probability and Shannon's definition of information, then develops source coding and compression, and reaches channel capacity and error-correcting codes last, where the elegant theorem that reliable communication is possible over a noisy channel finally lands.
Reading paths for information theory
Learn information theory: the best books to read in order
Beginner8books108 hrs4 stages
Popular information theory books
Related reading
Frequently asked questions
- How should I approach learning information theory?
- Information theory rests on one idea, entropy, that reframes everything after it, so it must be built carefully first. A good path starts with probability and Shannon's definition of information, then develops source coding and compression, and reaches channel capacity and error-correcting codes last, where the elegant theorem that reliable communication is possible over a noisy channel finally lands.
- What's a good book to start information theory with?
- A strong starting point is The Information by James Gleick. The ordered reading paths above show exactly where it fits and what to read next.
- What should I read after information theory?
- Once you have the fundamentals, explore closely related subjects like Inorganic chemistry, Cognitive science, Pharmacology.