A situation awareness assessment method based on fuzzy cognitive maps

doi:10.23919/JSEE.2022.000108

Journal of Systems Engineering and Electronics ›› 2022, Vol. 33 ›› Issue (5): 1108-1122.doi: 10.23919/JSEE.2022.000108

• SYSTEMS ENGINEERING • Previous Articles Next Articles

A situation awareness assessment method based on fuzzy cognitive maps

Jun CHEN^1,^2,*(), Xudong GAO¹(), Jia RONG³(), Xiaoguang GAO¹()

¹ School of Electronics and Information, Northwestern Polytechnical University, Xi’an 710072, China
² Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China
³ Department of Data Science and AI, Monash University, Clayton VIC3800, Australia

Received:2021-10-19 Online:2022-10-27 Published:2022-10-27
Contact: Jun CHEN E-mail:junchen@nwpu.edu.cn;gxdcoolest@mail.nwpu.edu.cn;jiarong@acm.org;xggao@nwpu.edu.cn
About author:|CHEN Jun was born in 1979. He received his B.S., M.S., and Ph.D. degrees in system engineering from Northwestern Polytechnical University, China in 2001, 2005, and 2009, respectively. Since 2012, he has been an associate professor with the School of Electronics and Information, Northwestern Polytechnical University, China. His current research interests include modeling and application based on fuzzy cognitive map, and intelligent decision-making for complex autonomous system. E-mail: junchen@nwpu.edu.cn||GAO Xudong was born in 1996. He received his B.S. degree in detection guidance and control technology from Northwestern Polytechnical University, China in 2018. He is currently pursuing his M.S. degree from Northwestern Polytechnical University, China. His research interests include complex system modeling, data mining, and machine learning. E-mail: gxdcoolest@mail.nwpu.edu.cn||RONG Jia was born in 1981. She received her B.S., M.S., and Ph.D. degrees from Deakin University in 2012. Her current research interest lies in joint areas of machine learning, deep learning and image processing and their applications in digital health, medical image analysis, cancer diagnosis, cardiac disease detection, pavement condition and maintenance, and tourism management.E-mail: jiarong@acm.org||GAO Xiaoguang was born in 1957. She received her B.S., M.S., and Ph.D. degrees from Northwestern Polytechnical University, China, in 1982, 1986, and 1989, respectively. She joined the School of Electronics and Information in 1989 and became a professor in 1994. Her research interests include advanced control theory and its applications in complex systems. E-mail: xggao@nwpu.edu.cn
Supported by:
This work was supported by the National Natural Science Foundation of China (61305133) and the Aeronautical Science Foundation of China grant number 2020Z023053002.

Abstract

Abstract:

The status of an operator’s situation awareness is one of the critical factors that influence the quality of the missions. Thus the measurement method of the situation awareness status is an important topic to research. So far, there are lots of methods designed for the measurement of situation awareness status, but there is no model that can measure it accurately in real-time, so this work is conducted to deal with such a gap. Firstly, collect the relevant physiological data of operators while they are performing a specific mission, simultaneously, measure their status of situation awareness by using the situation awareness global assessment technique (SAGAT), which is known for accuracy but cannot be used in real-time. And then, after the preprocessing of the raw data, use the physiological data as features, the SAGAT’s results as a label to train a fuzzy cognitive map (FCM), which is an explainable and powerful intelligent model. Also, a hybrid learning algorithm of particle swarm optimization (PSO) and gradient descent is proposed for the FCM training. The final results show that the learned FCM can assess the status of situation awareness accurately in real-time, and the proposed hybrid learning algorithm has better efficiency and accuracy.

Key words: situation awareness (SA), fuzzy cognitive map (FCM), particle swarm optimization (PSO), gradient descent

Jun CHEN, Xudong GAO, Jia RONG, Xiaoguang GAO. A situation awareness assessment method based on fuzzy cognitive maps[J]. Journal of Systems Engineering and Electronics, 2022, 33(5): 1108-1122.

Figures/Tables 16

Fig 1

Fig 2

Fig 3

Fig 4

Fig 5

Fig 6

Fig 7

Fig 8

Fig 9

Fig 10

Fig 11

Fig 12

Fig 13

Fig 14

Table 1

Table 2

References 32

1	ENDSLEY M R Toward a theory of situation awareness in dynamic systems. Human Factors, 1995, 37 (1): 32- 64. doi: 10.1518/001872095779049543
2	CHEN H, PANG L P, WANYAN X R, et al Effects of air route alternation and display design on an operator’s situation awareness, task performance and mental workload in simulated flight tasks. Applied Sciences, 2021, 11 (12): 5745. doi: 10.3390/app11125745
3	BONGO M, SEVA R Effect of fatigue in air traffic controllers’ workload, situation awareness, and control strategy. International Journal of Aerospace Psychology, 2022, 32 (1): 1- 23.
4	XU R B, LIU Z Q, LIN Y M, et al Unified adaptive deep classification for industrial real-time situation awareness in edge environment. Concurrency Computation: Practice and Experience, 2021, e6488.
5	ALHAIDER A, LAU N, DAVENPORT P, et al Distributed situation awareness: a health-system approach to assessing and designing patient flow management. Ergonomics, 2020, 63 (6): 682- 709. doi: 10.1080/00140139.2020.1755061
6	FENG C, WANYAN X R, LIU S, et al An approach to situation awareness (SA) assessment in flight simulation: SA dynamic circulation (SADC) model. Human Factors and Ergonomics in Manufacturing, 2021, 31 (5): 559- 569. doi: 10.1002/hfm.20903
7	LIANG N, YANG J, YU D, et al Using eye-tracking to investigate the effects of pre-takeover visual engagement on situation awareness during automated driving. Accident Analysis and Prevention, 2021, 157, 106143.
8	TABER M Investigating offshore helicopter pilots’ cognitive load and physiological responses during simulated in-flight emergencies. International Journal of Aerospace Psychology, 2021, 31 (1): 56- 69. doi: 10.1080/24721840.2020.1842208
9	DONG Y J, ZHANG X Study on the effect of awakening daylight in dormitories on morning alertness, mood, fatigue and sleep quality of college students. Building and Environment, 2021, 203, 108060.
10	KOSKO B Fuzzy cognitive maps. International Journal of Man-Machine Studies, 1986, 24 (1): 65- 75. doi: 10.1016/S0020-7373(86)80040-2
11	WANG J Y, PENG Z, WANG X D, et al Deep fuzzy cognitive maps for interpretable multivariate time series prediction. IEEE Trans. on Fuzzy Systems, 2021, 29 (9): 2647- 2660. doi: 10.1109/TFUZZ.2020.3005293
12	CHEN J, GAO X D, RONG J, et al The dynamic extensions of fuzzy grey cognitive maps. IEEE Access, 2021, 9, 98665- 98678. doi: 10.1109/ACCESS.2021.3096058
13	CHEN J, GAO X D, RONG J Enhance the uncertainty modeling ability of fuzzy grey cognitive maps by general grey number. IEEE Access, 2020, 8, 163844- 163856. doi: 10.1109/ACCESS.2020.3021721
14	CHEN J, ZHANG Y, GAO X D Hybrid FCM learning algorithm based on particle swarm optimization and gradient descent algorithm. Proc. of the 16th IEEE International Conference on Control, Automation, Robotics and Vision, 2020, 801- 806.
15	CHEN J, GAO X D, ZHONG L Using fuzzy grey cognitive maps to model threat assessment for UAVs. Proc. of the IEEE International Conference on Control and Automation, 2018, 594- 599.
16	SALMON P, STANTON N, WALKER G, et al Situation awareness measurement: a review of applicability for C4I environments. Applied Ergonomics, 2006, 37, 225- 238. doi: 10.1016/j.apergo.2005.02.001
17	NASSER-DINE A, MOISE A, LAPALME J Does explicit categorization taxonomy facilitate performing goal-directed task analysis? IEEE Trans. on Human-Machine Systems, 2021, 51 (3): 177- 187. doi: 10.1109/THMS.2021.3066456
18	ENDSLEY M R Measurement of situation awareness in dynamic systems. Human Factors, 1995, 37 (1): 65- 84. doi: 10.1518/001872095779049499
19	LOFT S, BOWDEN V, BRAITHWAITE J, et al Situation awareness measures for simulated submarine track management. Human Factors, 2015, 57 (2): 298- 310. doi: 10.1177/0018720814545515
20	THOMAS M, GOODE N, GRANT E, et al Can we talk about speed? The effect of verbal protocols on driver speed and perceived workload. Procedia Manufacturing, 2015, 3, 2629- 2634. doi: 10.1016/j.promfg.2015.07.608
21	ORIQUE S, DESPINS L Evaluating situation awareness: an integrative review. Western Journal of Nursing Research, 2018, 40 (3): 388- 424. doi: 10.1177/0193945917697230
22	GUGERTY L Evidence from a partial report task for forgetting in dynamic spatial memory. Human Factors, 1998, 40 (3): 498- 508. doi: 10.1518/001872098779591412
23	RATWANI R M, MCCURRY J M, TRAFTON J G Single operator, multiple robots: an eye movement based theoretic model of operator situation awareness. Proc. of the ACM/IEEE International Conference on Human-Robot Interaction, 2010, 235- 242.
24	STACH W, KURGAN L, PEDRYCZ W, et al Genetic learning of fuzzy cognitive maps. Fuzzy Sets and Systems, 2005, 153 (3): 371- 401. doi: 10.1016/j.fss.2005.01.009
25	SAHOO A, GHOSE D K Imputation of missing precipitation data using KNN, SOM, RF, and FNN. Soft Computing, 2022, 26 (12): 5919- 5936. doi: 10.1007/s00500-022-07029-4
26	ZARDOSHTI-KERMANI M, WHEELER B C, BADIE K, et al EMG feature evaluation for movement control of upper extremity prostheses. IEEE Trans. on Rehabilitation Engineering, 1995, 3 (4): 324- 333. doi: 10.1109/86.481972
27	TRIWIYANTO T, YULIANTO E, WISANA I, et al Electromyography feature analysis to recognize the hand motion in a prosthetic hand design. Journal of Biomimetics, Biomaterials and Biomedical Engineering, 2021, 50, 25- 37. doi: 10.4028/www.scientific.net/JBBBE.50.25
28	KHAN S M, KHAN A A, FAROOQ O Pattern recognition of EMG signals for low level grip force classification. Biomedical Physics & Engineering Express, 2021, 7 (6): 065012.
29	TURNER A, SHIEFF D, DWIVEDI A, et al Comparing machine learning methods and feature extraction techniques for the EMG based decoding of human intention. Proc. of the 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2021, 4738- 4743.
30	SHARMA S, KULKARNI R Noise reduction in speckle interferometry fringe pattern using adaptive Kalman filter. Optical Engineering, 2021, 60 (12): 124105.
31	BALOGUN K A, ZUROMSKI L M, KIM R, et al Establishing age-stratified red blood cell fatty acid reference ranges using model-based clustering and iterative application of the harrisboyd method. Clinical Biochemistry, 2021, 97, 25- 33. doi: 10.1016/j.clinbiochem.2021.07.013
32	FAN L L, YANG J, SUN X, et al The effects of landsat image acquisition date on winter wheat classification in the north china plain. ISPRS Journal of Photogrammetry and Remote Sensing, 2022, 187, 1- 13. doi: 10.1016/j.isprsjprs.2022.02.016

Learning algorithm	EV	ME	MAE	MSE	MedAE	R²	Running time/s
Random forest	0.8960	0.2020	0.0843	0.0109	0.0710	0.8869	0.1098
PSO	1.0000	0.0039	0.0012	0.0000	0.0005	1.0000	21244.7169
Gradient descent	0.8766	0.5404	0.1258	0.0479	0.0406	0.8753	9283.7482
PSO (in hybrid algorithm)	0.9757	0.2740	0.0614	0.0099	0.0368	0.9743	6376.7343
Hybrid algorithm	0.9994	0.0350	0.0119	0.0002	0.0091	0.9994	14767.0731

Learning algorithm	EV	ME	MAE	MSE	MedAE	R²	Running time/s
Random forest	0.8775	0.2025	0.0994	0.0259	0.0768	0.8780	0.1098
PSO	0.9957	0.0056	0.0306	0.0476	0.0118	0.9696	21244.7169
Gradient descent	0.8688	0.5866	0.1449	0.0599	0.0863	0.8708	9283.7482
PSO (in hybrid algorithm)	0.9500	0.2996	0.0705	0.0250	0.0593	0.9718	6376.7343
Hybrid algorithm	0.9680	0.0695	0.0165	0.0274	0.0189	0.9800	14767.0731

[1]	Bing WANG, Pengfei ZHANG, Yufeng HE, Xiaozhi WANG, Xianxia ZHANG. Scenario-oriented hybrid particle swarm optimization algorithm for robust economic dispatch of power system with wind power [J]. Journal of Systems Engineering and Electronics, 2022, 33(5): 1143-1150.
[2]	Jianwei SUN, Chao WANG, Qingzhan SHI, Wenbo REN, Zekun YAO, Naichang YUAN. Intelligent optimization methods of phase-modulation waveform [J]. Journal of Systems Engineering and Electronics, 2022, 33(4): 916-923.
[3]	Zihang DING, Junwei XIE, Zhengjie LI. Adaptive transmit beamspace optimization design based on RD-log-FDA radar [J]. Journal of Systems Engineering and Electronics, 2022, 33(1): 91-96.
[4]	Fang PENG, Jun WU, Shuai WANG, Zhijun LI, Jianjun XIANG. An anti-main-lobe jamming algorithm for airborne early warning radar based on APC-SVRGD joint optimization [J]. Journal of Systems Engineering and Electronics, 2022, 33(1): 134-143.
[5]	Shiyun LI, Sheng ZHONG, Zhi PEI, Wenchao YI, Yong CHEN, Cheng WANG, Wenzhu ZHANG. Multi-objective reconfigurable production line scheduling for smart home appliances [J]. Journal of Systems Engineering and Electronics, 2021, 32(2): 297-317.
[6]	Yuxiao KANG, Shuhua MAO, Yonghong ZHANG, Huimin ZHU. Fractional derivative multivariable grey model for nonstationary sequence and its application [J]. Journal of Systems Engineering and Electronics, 2020, 31(5): 1009-1018.
[7]	Hongzhi LI, Yong WANG. Particle swarm optimization for rigid body reconstruction after micro-Doppler removal in radar analysis [J]. Journal of Systems Engineering and Electronics, 2020, 31(3): 488-499.
[8]	Haowei ZHANG, Junwei XIE, Jiaang GE, Zhaojian ZHANG, Wenlong LU. Finite sensor selection algorithm in distributed MIMO radar for joint target tracking and detection [J]. Journal of Systems Engineering and Electronics, 2020, 31(2): 290-302.
[9]	Xu ZHENG, Yejun GAO, Wuxing JING, Yongsheng WANG. Multidisciplinary integrated design of long-range ballistic missile using PSO algorithm [J]. Journal of Systems Engineering and Electronics, 2020, 31(2): 335-349.
[10]	Mingnan TANG, Shijun CHEN, Xuehe ZHENG, Tianshu WANG, Hui CAO. Sensors deployment optimization in multi-dimensional space based on improved particle swarm optimization algorithm [J]. Journal of Systems Engineering and Electronics, 2018, 29(5): 969-982.
[11]	Huiyun Zhao, Dongge Zhang, Hui Meng, and Jiuyang Tao. Analytical measurement method for situation elements’ dynamic characteristics#br# [J]. Journal of Systems Engineering and Electronics, 2017, 28(6): 1126-1132.
[12]	Zilong Cheng, Li Fan, and Yulin Zhang. Multi-agent decision support system for missile defense based on improved PSO algorithm [J]. Systems Engineering and Electronics, 2017, 28(3): 514-525.
[13]	Yongjian Yang, Xiaoguang Fan, Zhenfu Zhuo, Shengda Wang, Jianguo Nan, and Wenkui Chu. Improved particle swarm optimization based on particles’ explorative capability enhancement [J]. Systems Engineering and Electronics, 2016, 27(4): 900-.
[14]	Lu Wang, Qinghua Xing, and Yifan Mao. Reentry trajectory rapid optimization for hypersonic vehicle satisfying waypoint and no-fly zone constraints [J]. Systems Engineering and Electronics, 2015, 26(6): 1277-1290.
[15]	Huicheng Hao, Wei Jiang, and Yijun Li. Improved algorithms to plan missions for agile earth observation satellites [J]. Journal of Systems Engineering and Electronics, 2014, 25(5): 811-821.

A situation awareness assessment method based on fuzzy cognitive maps

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

Share this article

Figures/Tables 16

References 32

Related Articles 15

Recommended Articles

Metrics

Comments