Subjects / Information theory

Best books to learn Information theory, in order

Information theory rests on one idea, entropy, that reframes everything after it, so it must be built carefully first. A good path starts with probability and Shannon's definition of information, then develops source coding and compression, and reaches channel capacity and error-correcting codes last, where the elegant theorem that reliable communication is possible over a noisy channel finally lands.

Build your own Information theory list →Browse all paths