Server load prediction algorithm based on CM-MC for cloud systems

doi:10.21629/JSEE.2018.05.17

Journal of Systems Engineering and Electronics ›› 2018, Vol. 29 ›› Issue (5): 1069-1078.doi: 10.21629/JSEE.2018.05.17

收稿日期:2017-09-11 出版日期:2018-10-26 发布日期:2018-11-14

Server load prediction algorithm based on CM-MC for cloud systems

Xiaolong XU^1,*(), Qitong ZHANG^1,²(), Yiqi MOU³(), Xinyuan LU⁴()

¹ Jiangsu Key Laboratory of Big Data Security & Intelligent Processing, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
² State Key Laboratory of Information Security, Chinese Academy of Sciences, Beijing 100093, China
³ Shanghai Stock Exchange Technology Co., Ltd, Shanghai Stock Exchange, Shanghai 200120, China
⁴ Institute of Big Data Research at Yancheng, Nanjing University of Posts and Telecommunications, Yancheng 224000, China

Received:2017-09-11 Online:2018-10-26 Published:2018-11-14
Contact: Xiaolong XU E-mail:xuxl@njupt.edu.cn;1014041119@njupt.edu.cn;yqmou@sse.com.cn;1016041226@njupt.edu.cn
About author:XU Xiaolong was born in 1977. He received his B.S. degree in computer and its applications, M.S. degree in computer software and theories and Ph.D. degree in communications and information systems from Nanjing University of Posts & Telecommunications, Nanjing, China, in 1999, 2002 and 2008, respectively. He worked as a postdoctoral researcher at Station of Electronic Science and Technology, Nanjing University of Posts & Telecommunications from 2011 to 2013. He is currently a professor in College of Computer, Nanjing University of Posts & Telecommunications. He is a senior member of China Computer Federation. His current research interests include cloud computing, mobile computing, intelligent agent and information security. E-mail: xuxl@njupt.edu.cn|ZHANG Qitong was born in 1992. She received her B.E. degree in software engineering from Nanjing University of Posts & Telecommunications, Nanjing, China, in 2014. She is now a postgraduate student majoring in software engineering, and working in a project team supported by the State Key Laboratory of Information Security, Chinese Academy of Sciences, Beijing, China. Her current research interests include cloud computing and virtualization. E-mail: 1014041119@njupt.edu.cn|MOU Yiqi was born in 1989. He received his B.E. degree in network engineering from Nanjing University of Posts & Telecommunications, Nanjing, China, in 2011, and M.E. degree in computer technology from Nanjing University of Posts & Telecommunications, Nanjing, China, in 2016, respectively. He works as an engineer in Data Center Business Department at Shanghai Stock Exchange Technology Co., Ltd., Shanghai, China, carrying out research in cloud computing and data center network technology. E-mail: yqmou@sse.com.cn|LU Xinyuan was born in 1995. He received his B.E. degree in computer science and technology from Nanjing University of Posts & Telecommunications, Nanjing, Nanjing, China, in 2017. He works as an engineer in Institute of Big Data Research at Yancheng, Nanjing University of Posts and Telecommunications, Yancheng, China, carrying out research in cloud computing and data analysis. E-mail: 1016041226@njupt.edu.cn
Supported by:
the National Natural Science Foundation of China(61472192);the National Natural Science Foundation of China(61772286);the National Key Research and Development Program of China(2018YFB1003700);the Scientific and Technological Support Project (Society) of Jiangsu Province(BE2016776);the "333" Project of Jiangsu Province(BRA2017228);the "333" Project of Jiangsu Province(BRA2017401);This work was supported by the National Natural Science Foundation of China (61472192; 61772286), the National Key Research and Development Program of China (2018YFB1003700), the Scientific and Technological Support Project (Society) of Jiangsu Province (BE2016776), and the "333" Project of Jiangsu Province (BRA2017228; BRA2017401)

摘要/Abstract

Abstract:

Accurate prediction of server load is important to cloud systems for improving the resource utilization, reducing the energy consumption and guaranteeing the quality of service (QoS). This paper analyzes the features of cloud server load and the advantages and disadvantages of typical server load prediction algorithms, integrates the cloud model (CM) and the Markov chain (MC) together to realize a new CM-MC algorithm, and then proposes a new server load prediction algorithm based on CM-MC for cloud systems. The algorithm utilizes the historical data sample training method of the cloud model, and utilizes the Markov prediction theory to obtain the membership degree vector, based on which the weighted sum of the predicted values is used for the cloud model. The experiments show that the proposed prediction algorithm has higher prediction accuracy than other typical server load prediction algorithms, especially if the data has significant volatility. The proposed server load prediction algorithm based on CM-MC is suitable for cloud systems, and can help to reduce the energy consumption of cloud data centers.

Key words: cloud computing, load prediction, cloud model, Markov chain, energy saving

. [J]. Journal of Systems Engineering and Electronics, 2018, 29(5): 1069-1078.

Xiaolong XU, Qitong ZHANG, Yiqi MOU, Xinyuan LU. Server load prediction algorithm based on CM-MC for cloud systems[J]. Journal of Systems Engineering and Electronics, 2018, 29(5): 1069-1078.

图/表 8

参考文献 24

1	CALHEIROS R, MASOUMI E, RANJAN R, et al. Workload prediction using ARIMA model and its impact on cloud applications’ QoS. IEEE Trans. on Cloud Computing, 2015, 3 (4): 449- 458. doi: 10.1109/TCC.2014.2350475
2	BARATI M, SHARIFIAN S. A hybrid heuristic-based tuned support vector regression model for cloud load prediction. The Journal of Supercomputing, 2015, 71 (11): 4235- 4259. doi: 10.1007/s11227-015-1520-y
3	JIANG Y X, PENG C, LI T, et al. Asap: A self-adaptive prediction system for instant cloud resource demand provisioning. Proc. of the 11th IEEE International Conference on Data Mining, 2011: 1104-1109.
4	KHAN A, YAN X, TAO S, et al. Workload characterization and prediction in the cloud: a multiple time series approach. Proc. of the IEEE International Conference on Network Operations and Management Symposium, 2012: 1287-1294.
5	LIU X Y. Research and implementation of virtual server consolidation based on forecasting in cloud environment. Nanjing, China: Nanjing University of Posts and Telecommunications, 2015.
6	POHLKER M L, POHLKER C, DITAS F, et al. Long-term observations of cloud condensation nuclei in the Amazon rain forest-Part 1: Aerosol size distribution, hygroscopicity, and new model parametrizations for CCN prediction. Atmospheric Chemistry and Physics, 2016, 16 (24): 15709- 15740. doi: 10.5194/acp-16-15709-2016
7	ZHANG B B, CHEN N J, HU D D. Virtual machine deployment strategy by load prediction based on BP neural network. Journal of Huazhong University of Science and Technology, 2012, 40, 120- 123.
8	LIU L X, MEI H, XIE B. Towards a multi-QoS human-centric cloud computing load balance resource allocation method. The Journal of Supercomputing, 2016, 72 (7): 2488- 2501.
9	KALYVIANAKI E, HAND S. Applying Kalman filters to dynamic resource provisioning of virtualized server applications. Proc. of the 3rd International Workshop on Feedback Control Implementation and Design in Computing System and Networks, 2008: 1-6.
10	MUNOZ-ESCOI F D, BERNABEU-AUBAN J M. A survey on elasticity management in PaaS systems. New York: Springer-Verlag, 2017.
11	LI P H, LI Y G, XIONG Q Y, et al. Application of a hybrid quantized Elman neural network in short-term load forecasting. International Journal of Electrical Power & Energy Systems, 2014, 55 (2): 749- 759.
12	HAO Y S, WANG L N, ZHENG M. An adaptive algorithm for scheduling parallel jobs in meteorological cloud. KnowledgeBased Systems, 2016, 98 (C): 226- 240.
13	YANG C H, LI Y D. Planar model and its application in prediction. Chinese Journal of Comupters, 1998, 21 (11): 961- 969.
14	CAO J, FU J W, LI M L, et al. CPU load prediction for cloud environment based on a dynamic ensemble model. SoftwarePractice and Experience, 2014, 44 (7): 793- 804. doi: 10.1002/spe.2231
15	HAMEED A, KHOSHKBARFOROUSHHA A, RANJAN R, et al. A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems. Computing, 2016, 98 (7): 1- 24.
16	SHENG Z, XIE S Q, PAN C Y. Probability theory and mathematical statistics. Beijing, China: Higher Education Press, 2009.
17	CHEN J B, PENG Y J, ZHI X F, et al. Research on application classification method in cloud computing environment. Proc. of the 2nd IEEE International Conference on Cyber Security and Cloud Computing, 2015: 524-529.
18	LI D Y, LIU C, GAN W. A new cognitive model: cloud model. International Journal of Intelligent Systems, 2010, 24 (3): 357- 375.
19	LIU C Y, LI Y D, DU Y, et al. Some statistical analysis of the normal cloud model. Information and Control, 2005, 34 (4): 236- 239.
20	JIN L. Application research of the cloud model in time series prediction. Chengdu, China: University of Electronic Science and Technology of China, 2014.
21	LI D Y. Uncertainty in knowledge representation. Engineering Science, 2000, 2 (10): 73- 79.
22	MENG H, WANG S L, LI D Y. Concept extraction and concept hierarchy construction based on cloud transformation. Journal of Jilin University, 2010, 40 (3): 782- 787.
23	ZHA X, NI S H, XIE C, et al. Indirect computation approach of cloud model similarity based on conception skipping. Systems Engineering and Electronics, 2015, 37 (7): 1676- 1682.
24	LI W B, LI Z H, CHEN Q, et al. Inconsistencies detection in distributed big data. Journal of Software, 2016, 27 (8): 2068- 2085.

Interval	Ratio of the cloud drops to all cloud drops/%	Ratio of the contribution to all contributions/%
$[Ex-0.67En, Ex+0.67En]$	22.33	50
$[Ex-En, Ex+En]$	33.33	68.26
$[Ex-2En, Ex-En] {{{\rm{U}}}}$ $[Ex+En, Ex+2En]$	33.33	27.18
$[Ex-3En, Ex-2En]{{{\rm{U}}}}$ $[Ex+2En, Ex+3En]$	33.33	3

Server load prediction algorithm based on CM-MC for cloud systems

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

图/表 8

参考文献 24

相关文章 0

编辑推荐

Metrics

本文评价