Information Theory: Coding Theorems for Discrete Memoryless Systems [first 1/3 of the book]

✍ Scribed by Imre Csiszár, János Körner

• Publisher: Academic Press
• Year: 1982
• Tongue: English
• Leaves: 183
• Series: Probability and Mathematical Statistics. A Series of Monographs and Textbooks
• Category: Library

✦ Synopsis

Csiszár and Körner's book is widely regarded as a classic in the field of information theory, providing deep insights and expert treatment of the key theoretical issues. It includes in-depth coverage of the mathematics of reliable information transmission, both in two-terminal and multi-terminal network scenarios. Updated and considerably expanded, this new edition presents unique discussions of information theoretic secrecy and of zero-error information theory, including the deep connections of the latter with extremal combinatorics. The presentations of all core subjects are self contained, even the advanced topics, which helps readers to understand the important connections between seemingly different problems. Finally, 320 end-of-chapter problems, together with helpful solving hints, allow readers to develop a full command of the mathematical techniques. It is an ideal resource for graduate students and researchers in electrical and electronic engineering, computer science and applied mathematics.

✦ Table of Contents

ToC
......Page 7
INTRODUCTION......Page 9
BASIC NOTATIONS AND CONVENTIONS......Page 17
1. Information Measures
in Simple Coding Problems......Page 21
1.
Source Coding and Hypothesis Testing Information Measures......Page 23
2. Types and Typical Sequences
......Page 37
3. Some Formal Properties of Shannon's Information Measures......Page 55
4. Non-Block Source Coding......Page 69
5. Blowing Up Lemma: A Combinatorial Digression......Page 94
2.
Two-Terminal Systems......Page 105
1. The Noisy Channel Coding Problem......Page 107
2. Rate-Distortion Trade-off in Source Coding and the Source-Channel Transmission Problem......Page 131
3. Compulalion of Channel Capacity and Delta-Distortion Rates......Page 145
Blank Page......Page 183
REFERENCES......Page 147
NAME INDEX......Page 159
SUBJECT INDEX......Page 163
INDEX OF SYMBOLS AND ABBREVIATIONS......Page 179