Online scheduling technique to handle data velocity changes in stream workflows

dc.contributor.authorBarika, M.
dc.contributor.authorGarg, S.
dc.contributor.authorZomaya, A.Y.
dc.contributor.authorRanjan, R.
dc.date.issued2021
dc.descriptionLink to a related website: https://eprint.ncl.ac.uk/fulltext.aspx?url=273391/C9475EAF-88FF-4EDD-8506-1D8023805A68.pdf&pub_id=273628, Open Access via Unpaywall
dc.description.abstractMany IoT applications and services such as smart parking and smart traffic control contain a network of different analytical components, which are composed in the form of a workflow to make better decisions. These workflows are also known as stream workflows. The focus of existing research works is on the streaming operator graph, which differs from stream workflow application as it involves heterogeneity, multiple data sources and multiple outputs. Considering the complexity and dynamism of stream workflow, meeting real-time data analysis requirements at deployment time is not the whole story as the velocity of data changes over time. This change is the most dynamic form of stream workflow that occurs frequently during the execution of this application. In this article, we propose a new dynamic scheduling technique that manages cloud resources over time to handle data velocity changes in stream workflow while maintaining user-defined real-time data analysis requirements and minimising execution cost. The efficiency of the proposed technique is evaluated, and experimental results showed that this technique outperformed its competitors and is close to the lower bound.
dc.identifier.citationIEEE Transactions on Parallel and Distributed Systems, 2021; 32(8, article no. 9354934):2115-2130
dc.identifier.doi10.1109/TPDS.2021.3059480
dc.identifier.issn1045-9219
dc.identifier.issn1558-2183
dc.identifier.urihttps://hdl.handle.net/11541.2/146679
dc.language.isoen
dc.publisherIEEE
dc.relation.fundingAustralian Government Research Training Program (RTP) Scholarship
dc.rightsCopyright 2021 IEEE
dc.source.urihttps://doi.org/10.1109/TPDS.2021.3059480
dc.subjectIoT
dc.subjectstream workflow
dc.subjectdynamic scheduling
dc.subjectalpha-beta pruning
dc.subjectGA with random immigrants
dc.subjectcloud environments
dc.titleOnline scheduling technique to handle data velocity changes in stream workflows
dc.typeJournal article
pubs.publication-statusPublished
ror.mmsid9916506103501831

Files

Collections