Information Theory: Coding Theorems for Discrete Memoryless Systems

✍ Scribed by Imre Csiszár, János Körner

• Publisher: Cambridge University Press
• Year: 2011
• Tongue: English
• Leaves: 523
• Edition: Second
• Category: Library

✦ Synopsis

Csiszár and Körner's book is widely regarded as a classic in the field of information theory, providing deep insights and expert treatment of the key theoretical issues. It includes in-depth coverage of the mathematics of reliable information transmission, both in two-terminal and multi-terminal network scenarios. Updated and considerably expanded, this new edition presents unique discussions of information theoretic secrecy and of zero-error information theory, including the deep connections of the latter with extremal combinatorics. The presentations of all core subjects are self contained, even the advanced topics, which helps readers to understand the important connections between seemingly different problems. Finally, 320 end-of-chapter problems, together with helpful solving hints, allow readers to develop a full command of the mathematical techniques. It is an ideal resource for graduate students and researchers in electrical and electronic engineering, computer science and applied mathematics.

✦ Table of Contents

Preface to the first edition page ix
Preface to the second edition xi
Basic notation and conventions xii
Introduction xv

Part I Information measures in simple coding problems l
1 Source coding and hypothesis testing; information measures 3
2 Types and typical sequences 16
3 Formal properties of Shannon's information measures 34
4 Non-block source coding 48
5 Blowing up lemma: a combinatorial digression 71

Part II Two-terminal systems 81
6 The noisy channel coding problem 83
7 Rate-distortion trade-off in source coding and the source-channel transmission problem 107
8 Computation of channel capacity and A-distortion rates 120
9 A covering lemma and the error exponent in source coding 132
10 A packing lemma and the error exponent in channel coding 144
11 The compound channel revisited: zero-error information theory and extremal combinatorics 184
12 Arbitrarily varying channels 209

Part III Multi-terminal systems 241
13 Separate coding of correlated sources 243
14 Multiple-access channels 272
15 Entropy and image size characterization 304
16 Source and channel networks 354
17 Information-theoretic security 400

References 461
Name index 478
Index of symbols and abbreviations 482
Subject index 485