Information theory studies the quantification, storage, and communication of information. Free information theory books download ebooks online. Shannons main result, the noisychannel coding theorem showed that, in the. Everyday low prices and free delivery on eligible orders. Buy information theory dover books on mathematics new edition by ash, robert isbn.
Information theory, a mathematical representation of the conditions and parameters affecting the transmission and processing of information. This suggests a need for a book that not only introduces the basic concepts of quantum information theory, but also presents in detail some of the. This note will cover both classical and modern topics, including information entropy, lossless data compression, binary hypothesis testing, channel coding, and lossy data compression. Mathematical foundations of information theory dover. This law is supported by two independent arguments. Among the topics covered are noiseless coding, the discrete memoryless channel, effort correcting codes, information sources, channels with memory, and. Professor emeritus of mathematics at the university of illinois, robert ash is the author of three other dover books. For a scientist investigating bugs, his microscope is his information channel.
Theory information and coding 2nd edition discrete mathematics. Information theory, a mathematical representation of the conditions and. This book is an excellent introduction to the mathematics underlying the theory. After a brief discussion of general families of codes, the author discusses linear codes including the hamming, golary, the reedmuller codes, finite fields, and cyclic codes including the bch, reedsolomon, justesen, goppa, and quadratic residue codes. A mathematical theory of communication harvard university. Indeed, even in shannons day many books and articles appeared that. The mathematical theory of information jan kahre springer. Beginning millions of years ago with ancient ant odometers and moving through time to our modernday quest for new dimensions, it covers 250 milestones in mathematical history. An introduction to information theory dover books on.
Information theory is a broad and deep mathematical theory, with equally. Shannons work defined communication channels and showed how to assign a capacity to. This is a graduatelevel introduction to mathematics of information theory. There is a short and elementary overview introducing the reader to the concept of coding. The first comprehensive introduction to information theory, this book places the work begun by shannon and continued by mcmillan, feinstein, and khinchin on a rigorous mathematical basis. Information theory dover books on mathematics ebook. The books he wrote on mathematical foundations of information theory, statistical mechanics and quantum statistics are still in print in english translations, published by dover. There are excellent textbooks on classical information theory, aimed at students of. This mathematical theory of information is explored in fourteen chapters. The book explains with minimum amount of mathematics what information.
The notion of entropy, which is fundamental to the whole topic of this book. I like the description of channels with memory in particular. For the first time, mathematicians, statisticians, physicists, cyberneticists, and communications engineers are offered a lucid, comprehensive introduction to this rapidly growing field. Like william feller and richard feynman he combines a complete mastery of his subject with an ability to explain clearly without sacrificing mathematical rigour. Symbols, signals and noise dover books on mathematics. Chapter 1, about information the mathematical theory of information. Most closely associated with the work of the american electrical engineer claude shannon in the mid20th century, information theory is chiefly of interest to communication engineers, though some of the concepts have been adopted and used in such fields as psychology and linguistics. Then, following the main results, the channel and source coding. Mathematical foundations of information theory dover books on mathematics khinchin, a.
Developed by claude shannon and norbert wiener in the late 1940s, information theory, or statistical communication theory, deals with the theoretical underpinnings of a wide range of communication devices. It was founded by claude shannon toward the middle of the twentieth century and has since then evolved into a vigorous branch of mathematics fostering. Symbols, signals and noise dover books on mathematics englisch taschenbuch 1. Written for an engineering audience, this book has a threefold purpose. Mathematical foundations of information theory dover books on. Information theory an overview sciencedirect topics. Most closely associated with the work of the american electrical engineer claude shannon in the mid20th century, information theory is chiefly of interest to communication engineers, though some of the concepts have been adopted and used in such fields as. The remainder of the book is devoted to coding theory and is independent of the information theory portion of the book. Information theory is the mathematical treatment of the concepts, parameters and rules governing the transmission of messages through communication systems. A tutorial introduction a tutorial introduction book, band 3. Symbols, signals and noise dover books on mathematics by john r. The branch of applied mathematics and cybernetics related to the mathematical description and estimation of the quality of the transmission, preservation, extraction, and classification of information. Yes, information theory is a branch of mathematics, although its practitioners are often found in departments of electrical and computer engineering or computer science.
1038 733 920 1471 771 950 629 129 1324 310 1195 1479 220 27 48 223 12 157 1365 15 1260 670 530 306 1325 1393 655 490 1329 337 1487 711 1005 387 1353 1116 809 139 844