Stochastic average consensus filter for distributed HMM filtering: Almost sure convergence
Date
2010
Authors
Ghasemi, N.
Dey, S.
Baras, J.S.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
IFAC papers online, 2010, vol.43, iss.19, pp.335-340
Statement of Responsibility
Conference Name
2nd IFAC Workshop on Distributed Estimation and Control in Networked Systems, NecSys'10 (13 Sep 2010 - 14 Sep 2010 : France)
Abstract
In this paper, we study almost sure convergence of a dynamic average consensus algorithm which allows distributed computation of the product of n time-varying conditional probability density functions. These density functions (often called as "belief functions") correspond to the conditional probability of observations given the state of an underlying Markov chain, which is observed by n different nodes within a sensor network. The topology of the sensor network is modeled as an undirected graph. The average consensus algorithm is used to obtain a distributed state estimation scheme for a hidden Markov model (HMM). We use the ordinary differential equation (ODE) technique to analyze the convergence of a stochastic approximation type algorithm for achieving average consensus with a constant step size. It is shown that, for a connected graph, under mild assumptions on the first and second moments of the observation probability densities and a geometric ergodicity condition on an extended Markov chain, the consensus filter state of each individual sensor converges almost surely to the true average of the logarithm of the belief functions of all the sensors. Convergence is proved by using a perturbed stochastic Lyapunov function technique. Numerical results suggest that the distributed estimates of the Markov chain state obtained at the individual sensor nodes based on this consensus algorithm track the centralized state estimate (computed on the basis of having access to the observations of all the nodes) quite well, while more formal results on convergence of the distributed HMM filter to the centralized one are currently under investigation. © 2010 IFAC.
School/Discipline
Dissertation Note
Provenance
Description
Link to a related website: http://drum.lib.umd.edu/bitstream/1903/10069/3/HMMconsensus_techreport4_edited.pdf, Open Access via Unpaywall
Access Status
Rights
Copyright 2010 IFAC