LI Xin. Spark-based traffic flow prediction analysis using multi-order spatial weighting matrix STARIMA. [J]. Acta Scientiarum Naturalium Universitatis SunYatseni 57(6):41-49(2018)
DOI:
LI Xin. Spark-based traffic flow prediction analysis using multi-order spatial weighting matrix STARIMA. [J]. Acta Scientiarum Naturalium Universitatis SunYatseni 57(6):41-49(2018) DOI: 10.13471/j.cnki.acta.snus.2018.06.005.
it is necessary to establish an intelligent traffic management platform that can predict traffic flow. In this paper
the outlier detection algorithm based on the Spark is used to clean the real-time massive traffic flow data. Load balancing rules are designed for the parallel data registration and storage. Semantic parsing and logical optimization are used to realize distributed semantic queries. And the STARIMA model based on multi-order spatial weight matrix is designed to realize the traffic flow forecasting. By the comparison experiments
it is proved that: ① The traffic flow data cleaning
statistics
registration and storage methods effectively utilize the advantages of memory computing and iterative computing of the Spark framework. In the big data environment
this method reduces the time consumption by about 60% compared with the MPI method or MapReduce method. And it can complete the data preprocessing in one prediction cycle. ② The semantic query method provides data to the traffic flow prediction model. The multi-order spatial weight matrix of the model can reflect the multi-order traffic flow assignment law more accurately. Compared with the dynamic STARIMA model
the accuracy of prediction analysis can be increased by about 25%. And the method can provide reference for traffic guidance information publication.
Investigation of yield traits and medicinal components of Andrographis paniculata germplasm
Evaluation and comparability of four meteorological drought indices during drought monitoring in Xinjiang
Optimization of collaborative filtering algorithm based on DAG Spark scheduling
Related Author
SHEN Qi
JIN Honglei
DUAN Lixin
WANG Hongbin
LIANG Zishan
ZHANG Ke
WANG Yuxia
ZOU Xiuzai
Related Institution
Institute of Physiology and Ecology of Medicinal Plants, International Institute of Translational Medicine of Traditional Chinese Medicine, School of Chinese Materia Medica, Guangzhou University of Chinese Medicine