Elements of Information Theory

Author: Thomas M. Cover
Publisher: John Wiley & Sons
ISBN: 9781118585771
Release Date: 2012-11-28
Genre: Computers

The latest edition of this classic is updated with new problem sets and material The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory. All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points. The Second Edition features: * Chapters reorganized to improve teaching * 200 new problems * New material on source coding, portfolio theory, and feedback capacity * Updated references Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications. An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department.

Network Information Theory

Author: Abbas El Gamal
Publisher: Cambridge University Press
ISBN: 9781139503143
Release Date: 2011-12-08
Genre: Technology & Engineering

This comprehensive treatment of network information theory and its applications provides the first unified coverage of both classical and recent results. With an approach that balances the introduction of new models and new coding techniques, readers are guided through Shannon's point-to-point information theory, single-hop networks, multihop networks, and extensions to distributed computing, secrecy, wireless communication, and networking. Elementary mathematical tools and techniques are used throughout, requiring only basic knowledge of probability, whilst unified proofs of coding theorems are based on a few simple lemmas, making the text accessible to newcomers. Key topics covered include successive cancellation and superposition coding, MIMO wireless communication, network coding, and cooperative relaying. Also covered are feedback and interactive communication, capacity approximations and scaling laws, and asynchronous and random access channels. This book is ideal for use in the classroom, for self-study, and as a reference for researchers and engineers in industry and academia.

Information Theory Inference and Learning Algorithms

Author: David J. C. MacKay
Publisher: Cambridge University Press
ISBN: 0521642981
Release Date: 2003-09-25
Genre: Computers

Fun and exciting textbook on the mathematics underpinning the most dynamic areas of modern science and engineering.

A First Course in Information Theory

Author: Raymond W. Yeung
Publisher: Springer Science & Business Media
ISBN: 9781441986085
Release Date: 2012-12-06
Genre: Technology & Engineering

This book provides an up-to-date introduction to information theory. In addition to the classical topics discussed, it provides the first comprehensive treatment of the theory of I-Measure, network coding theory, Shannon and non-Shannon type information inequalities, and a relation between entropy and group theory. ITIP, a software package for proving information inequalities, is also included. With a large number of examples, illustrations, and original problems, this book is excellent as a textbook or reference book for a senior or graduate level course on the subject, as well as a reference for researchers in related fields.

Probability and Information

Author: David Applebaum
Publisher: Cambridge University Press
ISBN: 0521555280
Release Date: 1996-07-13
Genre: Computers

This elementary introduction to probability theory and information theory provides a clear and systematic foundation to the subject; the author pays particular attention to the concept of probability via a highly simplified discussion of measures on Boolean algebras. He then applies the theoretical ideas to practical areas such as statistical inference, random walks, statistical mechanics, and communications modeling. Applebaum deals with topics including discrete and continuous random variables, entropy and mutual information, maximum entropy methods, the central limit theorem, and the coding and transmission of information. The author includes many examples and exercises that illustrate how the theory can be applied, e.g. to information technology. Solutions are available by email. This book is suitable as a textbook for beginning students in mathematics, statistics, or computer science who have some knowledge of basic calculus.

Modern Coding Theory

Author: Tom Richardson
Publisher: Cambridge University Press
ISBN: 9781139469647
Release Date: 2008-03-17
Genre: Technology & Engineering

Having trouble deciding which coding scheme to employ, how to design a new scheme, or how to improve an existing system? This summary of the state-of-the-art in iterative coding makes this decision more straightforward. With emphasis on the underlying theory, techniques to analyse and design practical iterative coding systems are presented. Using Gallager's original ensemble of LDPC codes, the basic concepts are extended for several general codes, including the practically important class of turbo codes. The simplicity of the binary erasure channel is exploited to develop analytical techniques and intuition, which are then applied to general channel models. A chapter on factor graphs helps to unify the important topics of information theory, coding and communication theory. Covering the most recent advances, this text is ideal for graduate students in electrical engineering and computer science, and practitioners. Additional resources, including instructor's solutions and figures, available online: www.cambridge.org/9780521852296.

Detection and Estimation for Communication and Radar Systems

Author: Kung Yao
Publisher: Cambridge University Press
ISBN: 9781139619066
Release Date: 2013-01-17
Genre: Technology & Engineering

Covering the fundamentals of detection and estimation theory, this systematic guide describes statistical tools that can be used to analyze, design, implement and optimize real-world systems. Detailed derivations of the various statistical methods are provided, ensuring a deeper understanding of the basics. Packed with practical insights, it uses extensive examples from communication, telecommunication and radar engineering to illustrate how theoretical results are derived and applied in practice. A unique blend of theory and applications and over 80 analytical and computational end-of-chapter problems make this an ideal resource for both graduate students and professional engineers.

Submodular Functions and Optimization

Author: Satoru Fujishige
Publisher: Elsevier
ISBN: 008046162X
Release Date: 2005-07-26
Genre: Mathematics

It has widely been recognized that submodular functions play essential roles in efficiently solvable combinatorial optimization problems. Since the publication of the 1st edition of this book fifteen years ago, submodular functions have been showing further increasing importance in optimization, combinatorics, discrete mathematics, algorithmic computer science, and algorithmic economics, and there have been made remarkable developments of theory and algorithms in submodular functions. The 2nd edition of the book supplements the 1st edition with a lot of remarks and with new two chapters: "Submodular Function Minimization" and "Discrete Convex Analysis." The present 2nd edition is still a unique book on submodular functions, which is essential to students and researchers interested in combinatorial optimization, discrete mathematics, and discrete algorithms in the fields of mathematics, operations research, computer science, and economics. Key features: - Self-contained exposition of the theory of submodular functions. - Selected up-to-date materials substantial to future developments. - Polyhedral description of Discrete Convex Analysis. - Full description of submodular function minimization algorithms. - Effective insertion of figures. - Useful in applied mathematics, operations research, computer science, and economics. - Self-contained exposition of the theory of submodular functions. - Selected up-to-date materials substantial to future developments. - Polyhedral description of Discrete Convex Analysis. - Full description of submodular function minimization algorithms. - Effective insertion of figures. - Useful in applied mathematics, operations research, computer science, and economics.

Information Theory and Statistics

Author: Solomon Kullback
Publisher: Courier Corporation
ISBN: 9780486142043
Release Date: 2012-09-11
Genre: Mathematics

Highly useful text studies logarithmic measures of information and their application to testing statistical hypotheses. Includes numerous worked examples and problems. References. Glossary. Appendix. 1968 2nd, revised edition.

Open Problems in Communication and Computation

Author: Thomas M. Cover
Publisher: Springer Science & Business Media
ISBN: 9781461248088
Release Date: 2012-12-06
Genre: Computers

Thomas M. Cover and B. Gopinatb The papers in this volume are the contributions to a special workshop on problems in communication and computation conducted in the summers of 1984 and 1985 in Morristown, New Jersey, and the summer of 1986 in Palo Alto. California. The structure of this workshop was unique: no recent results. no surveys. Instead. we asked for outstanding open prob~ lems in the field. There are many famous open problems, including the question P = NP?, the simplex conjecture in communication theory, the capacity region of the broadcast channel. and the two·helper problem in information theory. Beyond these well-defined problems are certain grand research goals. What is the general theory of information flow in stochastic networks? What is a comprehensive theory of computational complexity? What about a unification of algorithmic complexity and computational complex ity? Is there a notion of energy-free computation? And if so, where do information theory, communication theory, computer science, and physics meet at the atomic level? Is there a duality between computation and communication? Finally. what is the ultimate impact of algorithmic com plexity on probability theory? And what is its relationship to information theory? The idea was to present problems on the first day. try to solve them on the second day, and present the solutions on the third day. In actual fact, only one problem was solved during the meeting -- El Gamal's prob· lem on noisy communication over a common line.

An Introduction to Information Theory

Author: John R. Pierce
Publisher: Courier Corporation
ISBN: 9780486134970
Release Date: 2012-04-26
Genre: Computers

Covers encoding and binary digits, entropy, language and meaning, efficient encoding and the noisy channel, and explores ways in which information theory relates to physics, cybernetics, psychology, and art. 1980 edition.

A Student s Guide to Coding and Information Theory

Author: Stefan M. Moser
Publisher: Cambridge University Press
ISBN: 9781107601963
Release Date: 2012-01-26
Genre: Technology & Engineering

A concise, easy-to-read guide, introducing beginners to the engineering background of modern communication systems, from mobile phones to data storage. Assuming only basic knowledge of high-school mathematics and including many practical examples and exercises to aid understanding, this is ideal for anyone who needs a quick introduction to the subject.

Multidimensional Signal Image and Video Processing and Coding

Author: John W. Woods
Publisher: Academic Press
ISBN: 9780123814210
Release Date: 2011-05-31
Genre: Computers

This book gives a concise introduction to both image and video processing, providing a balanced coverage between theory, applications and standards. It gives an introduction to both 2-D and 3-D signal processing theory, supported by an introduction to random processes and some essential results from information theory, providing the necessary foundation for a full understanding of the image and video processing concepts that follow. A significant new feature is the explanation of practical network coding methods for image and video transmission. There is also coverage of new approaches such as: super-resolution methods, non-local processing, and directional transforms. This book also has on-line support that contains many short MATLAB programs that complement examples and exercises on multidimensional signal, image, and video processing. There are numerous short video clips showing applications in video processing and coding, plus a copy of the vidview video player for playing .yuv video files on a Windows PC and an illustration of the effect of packet loss on H.264/AVC coded bitstreams. New to this edition: New appendices on random processes, information theory New coverage of image analysis – edge detection, linking, clustering, and segmentation Expanded coverage on image sensing and perception, including color spaces. Now summarizes the new MPEG coding standards: scalable video coding (SVC) and multiview video coding (MVC), in addition to coverage of H.264/AVC. Updated video processing material including new example on scalable video coding and more material on object- and region-based video coding. More on video coding for networks including practical network coding (PNC), highlighting the significant advantages of PNC for both video downloading and streaming. New coverage of super-resolution methods for image and video. Only R&D level tutorial that gives an integrated treatment of image and video processing - topics that are interconnected. New chapters on introductory random processes, information theory, and image enhancement and analysis Coverage and discussion of the latest standards in video coding: H.264/AVC and the new scalable video standard (SVC)