The data processing inequality and stochastic resonance
Date
2003
Authors
McDonnell, M.
Stocks, N.
Pearce, C.
Abbott, D.
Editors
Jaenisch, H.M.
Handley, J.W.
Handley, J.W.
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
Noise in complex systems and stochastic dynamics : 2-4 June 2003, Santa Fe, New Mexico, USA / Lutz Schimansky-Geier, Derek Abbott, Alexander Neiman, Christian Van den Broeck (eds.), pp. 249-260
Statement of Responsibility
Mark D. McDonnell, Nigel G. Stocks, Charles E. M. Pearce, and Derek Abbott
Conference Name
Noise in Complex Systems and Stochastic Dynamics (2003 : Santa Fe, New Mexico, USA)
Abstract
The data processing inequality of information theory states that given random variables X, Y and Z which form a Markov chain in the order X-->Y-->Z, then the mutual information between X and Y is greater than or equal to the mutual information between X and Z. That is I(X) >= I(X;Z) . In practice, this means that no more information can be obtained out of a set of data then was there to begin with, or in other words, there is a bound on how much can be accomplished with signal processing. However, in the field of stochastic resonance, it has been reported that a signal to noise ratio gain can occur in some nonlinear systems due to the addition of noise. Such an observation appears to contradict the data processing inequality. In this paper, we investigate this question by using an example model system.
School/Discipline
Dissertation Note
Provenance
Description
© 2003 COPYRIGHT SPIE--The International Society for Optical Engineering