Design of automatic target recognition and detection system for sensors based on improved machine vision control
More details
Hide details
1
Wuxi Institute of Technology
Submission date: 2024-07-25
Final revision date: 2024-10-15
Acceptance date: 2025-04-02
Online publication date: 2025-04-04
Publication date: 2025-04-04
KEYWORDS
TOPICS
ABSTRACT
The aim of this study is to design and implement a sensor-based automatic target recognition and detection system with machine vision control. The system achieves high-precision detection of targets in complex environments by integrating multiple sensors. Through multi-sensor data fusion, preprocessing techniques, the experimental results show that the system is able to achieve high-precision target detection in different scenarios. FasterR-CNN and its improved version of the model perform well in the experiments, especially after the introduction of the feature pyramid network (FPN) and the attention mechanism, which improves the detection rate and the overall performance of the small targets. Experimental results show that multi-sensor fusion system significantly improves the performance in target detection, with the accuracy of RGB cameras increasing from 85% to 92% and the recall rate increasing from 78% to 88%. After introducing the feature pyramid network (FPN) and attention mechanism, the detection accuracy of the Faster R-CNN model for small targets increased from 70% to 75%. Although the processing speed decreased slightly (from 20fps to 15fps), the overall detection accuracy and robustness were significantly enhanced. In addition, the model pruning technology increased the processing speed to 12fps while maintaining high accuracy, which is suitable for real-time applications.
FUNDING
This research received no external funding.
REFERENCES (40)
1.
Kechagias-Stamatis O, Aouf N. A new passive 3-D automatic target recognition architecture for aerial platforms. IEEE Transactions on Geoscience and Remote Sensing. 2019;57(1):406-15.
https://doi.org/10.1109/TGRS.2....
2.
Kim SH, Choi HL. Convolutional neural network-based multi-target detection and recognition method for unmanned airborne surveillance systems. International Journal of Aeronautical and Space Sciences. 2019;20(4):1038-46.
https://doi.org/10.1007/s42405....
3.
Gong YM, Ma ZY, Wang MJ, Deng XY, Jiang W. A new multi-sensor fusion target recognition method based on complementarity analysis and neutrosophic set. Symmetry-Basel. 2020;12(9).
https://doi.org/10.3390/sym120....
4.
So HY, Kim EM. Deep-learning-based automatic detection and classification of traffic signs using images collected by mobile mapping systems. Sensors and Materials. 2022;34(12):4801-12.
https://doi.org/10.5194/isprs-....
5.
Dai J, Hao XH, Yan XP, Li Z. Adaptive false-target recognition for the proximity sensor based on joint-feature extraction and chaotic encryption. IEEE Sensors Journal. 2022;22(11):10828-40.
https://doi.org/10.1109/JSEN.2....
6.
Teixeira E, Araujo B, Costa V, Mafra S, Figueiredo F. Literature review on ship localization, classification, and detection methods based on optical sensors and neural networks. Sensors. 2022;22(18).
https://doi.org/10.3390/s22186....
7.
Blomerus N, Cilliers J, Nel W, Blasch E, de Villiers P. Feedback-assisted automatic target and clutter discrimination using a bayesian convolutional neural network for improved explainability in SAR applications. Remote Sensing. 2022;14(23).
https://doi.org/10.3390/rs1423....
8.
Wang SJ, Jiang F, Zhang B, Ma R, Hao Q. Development of UAV-based target tracking and recognition systems. IEEE Transactions on Intelligent Transportation Systems. 2020;21(8):3409-22.
https://doi.org/10.1109/TITS.2....
9.
Gao JC, Zhang XQ. An information recognition and time extraction method of tracking a flying target with a sky screen sensor based on wavelet modulus maxima theory. Mathematics. 2023;11(18).
https://doi.org/10.3390/math11....
10.
Li X, Zheng H. Target detection algorithm for dance moving images based on sensor and motion capture data. Microprocessors and Microsystems. 2021;81.
https://doi.org/10.1016/j.micp....
11.
Bin KC, Lin J, Tong XQ, Zhang XP, Wang JQ, Luo SH. Moving target recognition with seismic sensing: A review. Measurement. 2021;181.
https://doi.org/10.1016/j.meas....
12.
Liang B, Wang X, Zhao WH, Wang XB. High-precision carton detection based on adaptive image augmentation for unmanned cargo handling tasks. Sensors. 2024;24(1).
https://doi.org/10.3390/s24010....
13.
Zheng XT. Laser radar-based intelligent vehicle target recognition and detection system using image detection technology. Journal of Electronic Imaging. 2023;32(1).
https://doi.org/10.1117/1.JEI.....
14.
Li K, Zhang YS, Zhang ZC, Yu Y. An automatic recognition and positioning method for point source targets on satellite images. Isprs International Journal of Geo-Information. 2018;7(11).
https://doi.org/10.3390/ijgi71....
15.
He XC, Ji WL, Xing SJ, Feng ZX, Li HY, Lu SS, et al. Emerging trends in sensors based on molecular imprinting technology: Harnessing smartphones for portable detection and recognition. Talanta. 2024; 268.
https://doi.org/10.1016/j.tala....
16.
Li B, Zhou SS, Cheng LF, Zhu RB, Hu T, Anjum A, et al. A cascade learning approach for automated detection of locomotive speed sensor using imbalanced data in ITS. IEEE Access. 2019;7:90851-62.
https://doi.org/10.1109/ACCESS....
17.
Samadiani N, Huang GY, Cai BR, Luo W, Chi CH, Xiang Y, He J. A review on automatic facial expression recognition systems assisted by multimodal sensor data. Sensors. 2019;19(8).
https://doi.org/10.3390/s19081....
18.
Choudhary P, Goel N, Saini M. A survey on seismic sensor based target detection, localization, identification, and activity recognition. Acm Computing Surveys. 2023;55(11).
https://doi.org/10.1145/356867....
19.
Seng KP, Ang LM, Schmidtke LM, Rogiers SY. Computer vision and machine learning for viticulture technology. IEEE Access. 2018;6:67494-510.
https://doi.org/10.1109/ACCESS....
20.
Li DL, Wang Q, Li X, Niu ML, Wang H, Liu CH. Recent advances of machine vision technology in fish classification. Ices Journal of Marine Science. 2022;79(2):263-84.
https://doi.org/10.1093/icesjm....
21.
Hsia SC, Wang SH, Wei CM, Chang CY. Intelligent object tracking with an automatic image zoom algorithm for a camera sensing surveillance system. Sensors. 2022;22(22).
https://doi.org/10.3390/s22228....
22.
Fu Q, Wang ST, Wang J, Liu SN, Sun YB. A Lightweight eagle-eye-based vision system for target detection and Recognition. IEEE Sensors Journal. 2021;21(22):26140-8.
https://doi.org/10.1109/JSEN.2....
23.
Zhang WY, Fu XH, Li W. The intelligent vehicle target recognition algorithm based on target infrared features combined with lidar. Computer Communications. 2020;155:158-65.
https://doi.org/10.1016/j.comc....
24.
Zabit U, Shaheen K, Naveed M, Bernal OD, Bosch T. Automatic detection of multi-modality in self-mixing interferometer. IEEE Sensors Journal. 2018;18(22):9195-202.
https://doi.org/10.1109/JSEN.2....
25.
Wang HL, He S, Yu JS, Wang LY, Liu T. Research and implementation of vehicle target detection and information recognition technology based on NI myRIO. Sensors. 2020;20(6).
https://doi.org/10.3390/s20061....
27.
Xing KS, Wang N, Wang W. A ground moving target detection method for seismic and sound sensor based on evolutionary neural networks. Applied Sciences-Basel. 2022;12(18).
https://doi.org/10.1109/LGRS.2....
28.
Wei PC, Wang B. Multi-sensor detection and control network technology based on parallel computing model in robot target detection and recognition. Computer Communications. 2020;159:215-21.
29.
Liu JM, Chen H, Wang Y. Multi-source remote sensing image fusion for ship target detection and recognition. Remote Sensing. 2021;13(23).
https://doi.org/10.3390/rs1323....
30.
Kotwaliwale N, Singh K, Chakrabarty SK, Joshi MA, Kalne A, Tiwari M, et al. Machine vision for characterisation of some phenomic features of plant parts in distinguishing varieties-a review. International Journal of Bio-Inspired Computation. 2019;14(4):201-12.
https://doi.org/10.1504/IJBIC.....
31.
Long T, Liang ZN, Liu QH. Advanced technology of high-resolution radar: target detection, tracking, imaging, and recognition. Science China-Information Sciences. 2019;62(4).
https://doi.org/10.1007/s11432....
32.
Baili N, Moalla M, Frigui H, Karem AD. Multistage approach for automatic target detection and recognition in infrared imagery using deep learning. Journal of Applied Remote Sensing. 2022;16(4).
https://doi.org/10.1117/1.JRS.....
33.
Geng Z, Xu Y, Wang BN, Yu X, Zhu DY, Zhang G. Target recognition in SAR images by deep learning with training data augmentation. Sensors. 2023;23(2).
https://doi.org/10.3390/s23020....
36.
Wu L, Gong FX, Yang X, Xu L, Chen SY, Zhang Y, et al. The YOLO-based multi-pulse lidar (YMPL) for target detection in hazy weather. Optics and Lasers in Engineering. 2024;177.
https://doi.org/10.3390/electr....
37.
Cheng C, Gao M, Cheng XD, Fang D, Chen YC. Research on fast target recognition method based on spectrum detection in battlefield. Spectroscopy and Spectral Analysis. 2018;38(1):161-5.
https://doi.org/10.3964/j.issn....
38.
Pan QC, Zhang HH. Key algorithms of video target detection and recognition in intelligent transportation systems. International Journal of Pattern Recognition and Artificial Intelligence. 2020;34(9).
https://doi.org/10.3390/app130....
39.
Song YF, Dong GG. Federated target recognition for multiradar sensor data security. IEEE Transactions on Geoscience and Remote Sensing. 2023;61.
40.
Chen WS, Chen XL, Liu J, Wang QB, Lu XF, Huang YF. Detection and recognition of UA targets with multiple sensors. Aeronautical Journal. 2023;127 (1308):167-92.
https://doi.org/10.1017/aer.20....