Learning-based SPARQL query performance modeling and prediction
Date
2018
Authors
Zhang, W.
Sheng, Q.
Qin, Y.
Taylor, K.
Yao, L.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
World Wide Web, 2018; 21(4):1015-1035
Statement of Responsibility
Wei Emma Zhang, Quan Z. Sheng, Yongrui Qin, Kerry Taylor, Lina Yao
Conference Name
Abstract
One of the challenges of managing an RDF database is predicting performance of SPARQL queries before they are executed. Performance characteristics, such as the execution time and memory usage, can help data consumers identify unexpected long-running queries before they start and estimate the system workload for query scheduling. Extensive works address such performance prediction problem in traditional SQL queries but they are not directly applicable to SPARQL queries. In this paper, we adopt machine learning techniques to predict the performance of SPARQL queries. Our work focuses on modeling features of a SPARQL query to a vector representation. Our feature modeling method does not depend on the knowledge of underlying systems and the structure of the underlying data, but only on the nature of SPARQL queries. Then we use these features to train prediction models. We propose a two-step prediction process and consider performances in both cold and warm stages. Evaluations are performed on real world SPRAQL queries, whose execution time ranges from milliseconds to hours. The results demonstrate that the proposed approach can effectively predict SPARQL query performance and outperforms state-of-the-art approaches.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
© Springer Science+Business Media, LLC 2017