A Bio-Inspired Approach to Condensing Information

Authors

R. Mathar, A. Schmeink,

Abstract

        In this paper, we consider a class of models that describe parallel observations of a single source by many noisy sensors, lossy quantization at each sensor, and finally information fusion of the quantized data. Certain phenomena in biophysics and neural information processing, but also in detection networks and modern communications can be elucidated by these models. Mutual information is used as an analytical measure of information exchange. We characterize the optimum information fusion rule by maximum entropy of the corresponding output distribution. For discrete input distributions, this problem can be reduced to a generalized Knapsack problem, which is hard to solve in general. We suggest a heuristic that minimizes the decrease of entropy in each step, and show that for binary information fusion the true optimum is attained for dyadic distributions. The problem of finding optimum quantization rules is an essential part of the model and treated analogously. For input distributions with a density, optimality is achieved by determiningappropriate quantization thresholds. Finally, by applying the data processing inequality, an upper bound for the mutual information of rbitrary stochastic pooling channels is found. This bound provides interesting insight into the resilience of parallel noisy information processing in biological systems.

BibTEX Reference Entry 

@inproceedings{MaSc11,
	author = {Rudolf Mathar and Anke Schmeink},
	title = "A Bio-Inspired Approach to Condensing Information",
	pages = "2524-2528",
	booktitle = "{IEEE} International Symposium on Information Theory (ISIT)",
	address = {Saint-Petersburg},
	month = Aug,
	year = 2011,
	hsb = hsb999910055643,
	}

Downloads

 Download paper  Download bibtex-file

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights there in are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.