A Random Access based Approach to Communication-Efficient Distributed SGD
Date
2022
Authors
Choi, J.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
2013 National Conference on Communications, NCC 2013, 2022, vol.2022-May, pp.4486-4491
Statement of Responsibility
Jinho Choi
Conference Name
IEEE International Conference on Communications (16 May 2022 - 20 May 2022 : Seoul, Republic of Korea)
Abstract
In this paper, we study communication-efficient distributed stochastic gradient descent (SGD) with data sets of users distributed over a certain area and communicating through wireless channels. Since the time for one iteration in the proposed approach is independent of the number of users, it is well-suited to distributed SGD with a large number of users or devices. Furthermore, since the proposed approach is based on random access in machine-type communication (MTC), it can be easily employed for training models with a large number of devices in various Internet-of-Things (IoT) applications where MTC is used for their connectivity. For fading channel, we show that noncoherent combining can be used. As a result, no channel state information (CSI) estimation is required.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
© 2022 IEEE.