An Information-Theoretic Approach to Neural Computing

1996
ISBN: 978-0-387-94666-5
Verlag: Springer

Buch, Englisch, 262 Seiten, HC runder Rücken kaschiert, Format (B × H): 160 mm x 241 mm, Gewicht: 1270 g

Reihe: Perspectives in Neural Computing

Neural networks provide a powerful new technology to model and control nonlinear and complex systems. In this book, the authors present a detailed formulation of neural networks from the information-theoretic viewpoint. They show how this perspective provides new insights into the design theory of neural networks. In particular they show how these methods may be applied to the topics of supervised and unsupervised learning including feature extraction, linear and non-linear independent component analysis, and Boltzmann machines. Readers are assumed to have a basic understanding of neural networks, but all the relevant concepts from information theory are carefully introduced and explained. Consequently, readers from several different scientific disciplines, notably cognitive scientists, engineers, physicists, statisticians, and computer scientists, will find this to be a very valuable introduction to this topic.

Zielgruppe

Research

Autoren/Hrsg.

Obradovic, Dragan

Deco, Gustavo

Fachgebiete

• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz Wissensbasierte Systeme, Expertensysteme
• Technische Wissenschaften Elektronik | Nachrichtentechnik Elektronik Robotik
• Mathematik | Informatik EDV | Informatik Informatik Mathematik für Informatiker
• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz Fuzzy-Systeme

Inhaltsverzeichnis

1 Introduction.- 2 Preliminaries of Information Theory and Neural Networks.- 2.1 Elements of Information Theory.- 2.2 Elements of the Theory of Neural Networks.- I: Unsupervised Learning.- 3 Linear Feature Extraction: Infomax Principle.- 4 Independent Component Analysis: General Formulation and Linear Case.- 5 Nonlinear Feature Extraction: Boolean Stochastic Networks.- 6 Nonlinear Feature Extraction: Deterministic Neural Networks.- II: Supervised Learning.- 7 Supervised Learning and Statistical Estimation.- 8 Statistical Physics Theory of Supervised Learning and Generalization.- 9 Composite Networks.- 10 Information Theory Based Regularizing Methods.- References.