UAV flight strategy algorithm based on dynamic programming

doi:10.21629/JSEE.2018.06.16

Journal of Systems Engineering and Electronics ›› 2018, Vol. 29 ›› Issue (6): 1293-1299.doi: 10.21629/JSEE.2018.06.16

• Software Algorithm and Simulation • Previous Articles Next Articles

UAV flight strategy algorithm based on dynamic programming

Zixuan ZHANG¹(), Qinhao WU²(), Bo ZHANG^3,*(), Xiaodong YI¹(), Yuhua TANG¹()

¹ College of Computer, National University of Defense Technology, Changsha 410073, China
² College of Electronic Science, National University of Defense Technology, Changsha 410073, China
³ National Innovative Institute of Defense Technology, Beijing 100010, China

Received:2018-04-17 Online:2018-12-25 Published:2018-12-26
Contact: Bo ZHANG E-mail:zx.zhang16@hotmail.com;qinhaowu@hotmail.com;zhangbo10@nudt.edu.cn;yixiaodong@nudt.edu.cn;yhtang@nudt.edu.cn
About author:ZHANG Zixuan was born in 1993. He received his B.S. degree in College of Electronic Science from National University of Defense and Technology (NUDT), Changsha, China, in June 2016. Now, he is a master of College of Computer from NUDT. His current research field includes MIMO technology, satellite communication and joint motion planning for UAV communication. E-mail: zx.zhang16@hotmail.com|WU Qinhao was born in 1993. Now, he is a master of College of Electronic Science and Engineering from National University of Defense and Technology. His current research field includes metamaterial antenna, radar coincidence imaging and radar signal processing. E-mail: qinhaowu@hotmail.com|ZHANG Bo was born in 1989. He is a Ph.D. and currently an assistant professor in Artificial Intelligence Research Center (AIRC), National Innovative Institute of Defense Technology. His research interests in wireless communications include the design and analysis of cooperative communications, multiple-input-multiple-output systems, and network-robotic systems. E-mail: zhangbo10@nudt.edu.cn|YI Xiaodong was born in 1978. He is a Ph.D. and currently a researcher in the State Key Laboratory of High Performance Computing. His research interests are operating system, high performance computing, robotics software, etc. E-mail: yixiaodong@nudt.edu.cn|TANG Yuhua was born in 1962. She is currently a professor in the State Key Laboratory of High Performance Computing, National University of Defense Technology. Her research interests include supercomputer architecture and core router's design. E-mail: yhtang@nudt.edu.cn
Supported by:
the National Natural Science Foundation of China(91648204);the National Natural Science Foundation of China(61601486);State Key Laboratory of High Performance Computing Project Fund(1502-02);Research Programs of National University of Defense Technology(ZDYYJCYJ140601);This work was supported by the National Natural Science Foundation of China (91648204; 61601486), State Key Laboratory of High Performance Computing Project Fund (1502-02), and Research Programs of National University of Defense Technology (ZDYYJCYJ140601)

Abstract

Abstract:

Unmanned aerial vehicles (UAVs) may play an important role in data collection and offloading in vast areas deploying wireless sensor networks, and the UAV's action strategy has a vital influence on achieving applicability and computational complexity. Dynamic programming (DP) has a good application in the path planning of UAV, but there are problems in the applicability of special terrain environment and the complexity of the algorithm. Based on the analysis of DP, this paper proposes a hierarchical directional DP (DDP) algorithm based on direction determination and hierarchical model. We compare our methods with Q-learning and DP algorithm by experiments, and the results show that our method can improve the terrain applicability, meanwhile greatly reduce the computational complexity.

Key words: motion state space, map stratification, computational complexity, dynamic programming (DP), envirommental adaptability

Zixuan ZHANG, Qinhao WU, Bo ZHANG, Xiaodong YI, Yuhua TANG. UAV flight strategy algorithm based on dynamic programming[J]. Journal of Systems Engineering and Electronics, 2018, 29(6): 1293-1299.

Figures/Tables 6

Fig 1

Fig 2

Fig 3

Fig 4

Fig 5

Fig 6

References 13

1	ABDULLA A E, FADLULLAH Z M, NISHIYAMA H, et al. An optimal data collection technique for improved utility in UAS-aided networks. Proc. of the IEEE Conference on Computer Communications, 2014: 736-744.
2	CURRY J A, MASLANIK J, HOLLAND G, et al. Applications of aerosondes in the arctic. Bulletin of the American Meteorological Society, 2004, 85 (12): 1855- 1861. doi: 10.1175/BAMS-85-12-1855
3	TAKAHASHI Y, KAWAMOTO Y, NISHIYAMA H, et al. A novel radio resource optimization method for relay-based unmanned aerial vehicles. IEEE Trans. on Wireless Communications, 2018, 17 (11): 7352- 7363. doi: 10.1109/TWC.2018.2866576
4	FREW E W, BROWN T X. Airborne communication networks for small unmanned aircraft systems. Proceedings of the IEEE, 2008, 96 (12): 2008- 2027. doi: 10.1109/JPROC.2008.2006127
5	ABDULLA A E, NISHIYAMA H, YANG J, et al. Hymn: a novel hybrid multi-hop routing algorithm to improve the longevity of WSNs. IEEE Trans. on Wireless Communications, 2012, 11 (7): 2531- 2541. doi: 10.1109/TWC.2012.050112.111222
6	ABDULLA A E, FADLULLAH Z M, NISHIYAMA H, et al. Toward fair maximization of energy efficiency in multiple UAS-aided networks: a game-theoretic methodology. IEEE Trans. on Wireless Communications, 2015, 14 (1): 305- 316. doi: 10.1109/TWC.2014.2343219
7	FADLULLAH Z M, TAKAISHI D, NISHIYAMA H, et al. A dynamic trajectory control algorithm for improving the communication throughput and delay in UAV-aided networks. IEEE Network, 2016, 30 (1): 100- 105.
8	LI K, NI W, WANG X, et al. Energy-efficient cooperative relaying for unmanned aerial vehicles. IEEE Trans. on Mobile Computing, 2016, 15 (6): 1377- 1386. doi: 10.1109/TMC.2015.2467381
9	FOTOUHI A, DING M, HASSAN M. Dynamic base station repositioning to improve spectral efficiency of drone small cells. arXiv preprint arXiv: 2017, 1704.01244.
10	XIE L, SHI Y, HOU Y T, et al. On renewable sensor networks with wireless energy transfer: the multi-node case. Proc. of the 9th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks, 2012: 10-18.
11	XIE L, SHI Y, HOU Y T, et al. A mobile platform for wireless charging and data collection in sensor networks. IEEE Journal on Selected Areas in Communications, 2015, 33 (8): 1521- 1533.
12	FERRARI S, DAUGHERTY G. Q-learning approach to automated unmanned air vehicle (UAV) demining. Journal of Defense Modeling & Simulation, 2010, (9): 76920S- 76920S-12.
13	ZHAO Y Y, ZHENG Z, ZHANG X Y, et al. Q learning algorithm based UAV path learning and obstacle avoidence approach. Proc. of the 36th Chinese Contrd Conference, 2017: 3397-3402.

[1]	Ce JI, Chao ZHANG, Wenjing ZHU. Low-complexity PTS scheme based on phase factor sequences optimization [J]. Journal of Systems Engineering and Electronics, 2018, 29(4): 707-713.
[2]	Hao Chen, Jun Li, Ning Jing, and Jun Li. User-oriented data acquisition chain task planning algorithm for operationally responsive space satellite [J]. Journal of Systems Engineering and Electronics, 2016, 27(5): 1028-1039.
[3]	Wentao Shi, Jianguo Huang, and Yunshan Hou. Fast DOA estimation algorithm for MIMO sonar based on ant colony optimization [J]. Journal of Systems Engineering and Electronics, 2012, 23(2): 173-178.
[4]	Zhao Yongping & Sun Jianguo. Improved scheme to accelerate support vector regression [J]. Journal of Systems Engineering and Electronics, 2009, 20(5): 1086-1090.

UAV flight strategy algorithm based on dynamic programming

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

Share this article

Figures/Tables 6

References 13

Related Articles 4

Recommended Articles

Metrics

Comments