Information Theory for Systems Engineers

✍ Scribed by L. P. Hyvärinen (auth.)

• Publisher: Springer-Verlag Berlin Heidelberg
• Year: 1968
• Tongue: English
• Leaves: 215
• Series: Lecture Notes in Operations Research and Mathematical Economics 5
• Edition: 1
• Category: Library

✦ Synopsis

This book is based on lectures given by the author at the IBM European Systems Research Institute (ESRI) in Geneva. Information Theory on the syntactic level, as introduced by Claude Shannon in 1949, has many limitations when applied to information processing by computers. But in spite of some obvious shortcomings, the underlyin~ principles are of fundamental importance for systems engineers in understanding the nature of the problems of handling information, its acquisition, storage, processing, and interpretation. The lectures, as presented in this book, attempt to give an exposition of the lovical foundation and basic principles, and to provide at the same time a basis for further study in more specific areas of this expan1in~ theory, such as coding, detection, pattern recognition, and filtering. Most of the problems in Appendix C are intended as extensions of the text, while calling for actjve participation by the stu1ent. Some other problems are direct applications of the theory to specific situations. Some problems require extensive numerical calculations. It is assumed in those cases that the student has access to a computer and that he is capable of writing the necessary programs. The stu1ent is assumed to have a good command of the calculus, and of the theory of probability as well as statistics. Therefore no basic mathematical concepts are discussed in this IV book. The Fourier transform and some related mathematical concepts are introduced in Appendix A.

✦ Table of Contents

Front Matter....Pages N2-VII
Introduction....Pages 1-11
Noiseless Channels....Pages 12-24
Coding for Noiseless Channels....Pages 25-50
Joint Events, Natural Languages....Pages 51-71
Noisy Channel....Pages 72-87
Error Checking and Correcting Codes....Pages 88-104
Properties of Continuous Channels....Pages 105-123
Detection of Continuous Signals....Pages 124-144
Information Filters....Pages 145-163
Back Matter....Pages 164-209

✦ Subjects

Economics/Management Science, general