Journal of Systems Engineering and Electronics ›› 2019, Vol. 30 ›› Issue (5): 861-874.doi: 10.21629/JSEE.2019.05.05

• Electronics Technology • Previous Articles     Next Articles

MapReduce rationality verification based on object Petri net

Zeliu DING1,2,*(), Deke GUO3(), Xi CHEN4(), Jin CHEN1()   

  1. 1 School of Electronics Engineering, Navy University of Engineering, Wuhan 430033, China
    2 Research Center of Evaluation and Demonstration, Academy of Military Sciences, Beijing 100091, China
    3 College of Systems Engineering, National University of Defense Technology, Changsha 410073, China
    4 School of Computer Science, McGill University, Montreal H3A 2A7, Canada
  • Received:2017-09-15 Online:2019-10-08 Published:2019-10-09
  • Contact: Zeliu DING E-mail:dingzeliu@gmail.com;guodeke@gmail.com;Chenxiwarm@gmail.com;198607@163.com
  • About author:DING Zeliu was born in 1983. He is a Ph.D. and an assistant research fellow in Academy of Military Sciences. His research interests are data center networks, cloud computing and complex information systems. E-mail: dingzeliu@gmail.com|GUO Deke was born in 1980. He is a Ph.D. and a professor in National University of Defense Technology. His research interests are P2P, data center networks, cloud computing and mobile computing. E-mail: guodeke@gmail.com|CHEN Xi was born in 1986. She is a Ph.D. in McGill University. Her research interests are cyberphysical systems and cloud computing. E-mail: Chenxiwarm@gmail.com|CHEN Jin was born in 1986. He is a lecturer in Naval University of Engineering. His research interests are underwater communication and picture processing. E-mail: chenjin 198607@163.com
  • Supported by:
    the Natural Science Foundation of Hubei Province, China(2016CFB287);This work was supported by the Natural Science Foundation of Hubei Province, China (2016CFB287)

Abstract:

As a powerful distributed data processing mechanism, MapReduce supports abundant parallel applications that process massive data on computer clusters. To process the massive data efficiently and correctly, a rational design for the MapReduce procedure is desired. An irrational MapReduce procedure can cause great waste of computing resources and even paralyze the exe-cution system. With the wide application of MapReduce, the unavoidable drawback of irrational MapReduce procedures becomes increasingly serious. To solve this problem, a method for verifying the rationality of a MapReduce procedure before executing it on a computer cluster is proposed. This method constructs the rationality criteria for MapReduce, and then studies an automatic approach for modelling MapReduce with an executable model object Petri net (OPN). Finally, the approaches for automatically identifying the rationality criteria by analyzing the consequence of model execution is developed. The results from extensive case studies demonstrate that the proposed method is feasible and effective.

Key words: MapReduce, rationality verification, cloud computing framework