On the discontinuity of the shannon information measures
Files
(Published version)
Date
2005
Authors
Ho, S.W.
Yeung, R.
Editors
Grant, A.
Kennedy, A.
Kennedy, A.
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
IEEE International Symposium on Information Theory - Proceedings, 2005 / Grant, A., Kennedy, A. (ed./s), vol.2005, pp.159-163
Statement of Responsibility
Conference Name
International Symposium on Information Theory (ISIT 2005) (4 Sep 2005 - 9 Sep 2005 : Adelaide, South Australia)
Abstract
It is well known that the Shannon information measures are continuous functions of the probability distribution when the support is finite. This, however, does not hold when the support is countably infinite. In this paper, we investigate the continuity of the Shannon information measures for countably infinite support. With respect to a distance based on the Kullback-Liebler divergence, we use two different approaches to show that all the Shannon information measures are in fact discontinuous at all probability distributions with countably infinite support.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright 2005 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.