Radar and LiDAR are two environmental sensors commonly used in autonomous vehicles, Lidars are accurate in determining objects' positions but significantly less accurate as Radars on measuring their velocities. However, Radars relative to Lidars are more accurate on measuring objects velocities but less accurate on determining their positions as they have a lower spatial resolution. In order to compensate for the low detection accuracy, incomplete target attributes and poor environmental adaptability of single sensors such as Radar and LiDAR, in this paper, an effective method for high-precision detection and tracking of surrounding targets of autonomous vehicles. By employing the Unscented Kalman Filter, Radar and LiDAR information is effectively fused to achieve high-precision detection of the position and speed information of targets around the autonomous vehicle. Finally, the real vehicle test under various driving environment scenarios is carried out. The experimental results show that the proposed sensor fusion method can effectively detect and track the vehicle peripheral targets with high accuracy. Compared with a single sensor, it has obvious advantages and can improve the intelligence level of autonomous cars.
Ze Liu
,
Yingfeng Cai
,
Hai Wang
,
Long Chen
. Surrounding Objects Detection and Tracking for Autonomous Driving Using LiDAR and Radar Fusion[J]. Chinese Journal of Mechanical Engineering, 2021
, 34(5)
: 117
-117
.
DOI: 10.1186/s10033-021-00630-y
[1] Chao Yang, Feng Yao, Mingjun Zhang, et al. Adaptive backstepping terminal sliding mode control method based on recurrent neural networks for autonomous underwater vehicle. Chinese Journal of Mechanical Engineering, 2018, 31(6):228-243.
[2] Y Cai, L Dai, H Wang, et al. Pedestrian motion trajectory prediction in intelligent driving from far shot first-person perspective video. IEEE Transactions on Intelligent Transportation Systems, 2021, doi:. https://doi.org/10.1109/TITS.2021.3052908
[3] Z Liu, Y Cai, L Chen, et al. Vehicle license plate recognition method based on deep convolution network in complex road scene. Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering, 2019, 233(9):2284-2292.
[4] Y Q Zhao, H Q Li, F Lin, et al. Estimation of road friction coefficient in different road conditions based on vehicle braking dynamics. Chinese Journal of Mechanical Engineering, 2017, 30(4):982-990.
[5] Z Liu, Y Cai, H Wang, et al. Robust target recognition and tracking of self-driving cars with radar and camera information fusion under severe weather conditions. IEEE Transactions on Intelligent Transportation Systems, 2021, doi:. https://doi.org/10.1109/TITS.2021.3059674
[6] H Hajri, M C Rahal. Real time LiDAR and Radar High-Level Fusion for Obstacle Detection and Tracking with evaluation on a ground truth. International Journal of Mechanical & Mechatronics Engineering, 2018.
[7] J He, F Gao. Mechanism, actuation, perception, and control of highly dynamic multilegged robots:A review. Chinese Journal of Mechanical Engineering, 2020, 33:79, https://doi.org/. https://doi.org/10.1186/s10033-020-00485-9
[8] M Merchant, C Haas, J Schroder, et al. High-latitude wetland mapping using multidate and multisensor Earth observation data:a case study in the Northwest Territories. Journal of Applied Remote Sensing, 2020, 14(3).
[9] G Sun, K J Ranson. Modeling LiDAR and radar returns of forest canopies for data fusion. Geoscience and Remote Sensing Symposium, IEEE, 2002.
[10] K Na, J Byun, M Roh, et al. Fusion of multiple 2D LiDAR and RADAR for object detection and tracking in all directions. International Conference on Connected Vehicles & Expo, IEEE, 2015.
[11] S K Kwon, E Hyun, J H Lee, et al. Detection scheme for a partially occluded pedestrian based on occluded depth in lidar-radar sensor fusion. Optical Engineering, 2017, 56(11):1.
[12] H Lee, H Chae, K Yi. A geometric model based 2D LiDAR/Radar sensor fusion for tracking surrounding vehicles-ScienceDirect. IFAC-PapersOnLine, 2019, 52(8):130-135.
[13] W Farag. Road-objects tracking for autonomous driving using lidar and radar fusion. Intelligent Decision Technologies, 2020, 15(3):1-14.
[14] Y Cai, L Dai, H Wang, et al. DLnet with training task conversion stream for precise semantic segmentation in actual traffic scene. IEEE Transactions on Neural Networks and Learning Systems, doi:. https://doi.org/10.1109/TNNLS.2021.3080261
[15] Wuling Huang. Application of LiDAR in perception of autonomous driving environment. Microcontrollers & Embedded Systems, 2016.
[16] K Kidono, T Naito, J Miura. Reliable pedestrian recognition combining high-definition LIDAR and vision data. International IEEE Conference on Intelligent Transportation Systems, IEEE, 2012.
[17] S K Kwon, E Hyun, J H Lee, et al. A low-complexity scheme for partially occluded pedestrian detection using LiDAR-RADAR sensor fusion. IEEE International Conference on Embedded & Real-time Computing Systems & Applications, IEEE, 2016.
[18] M H Daraei, A Vu, R Manduchi. Region segmentation using LiDAR and Camera-eScholarship. IEEE International Conference on Intelligent Transportation Systems, IEEE, 2017.
[19] E Wan, Van D M R. The unscented Kalman filter. In:Kalman Filtering and Neural Networks. John Wiley & Sons, Inc. 2002.
[20] E Kraft. A quaternion-based unscented Kalman filter for orientation tracking. Sixth International Conference of Information Fusion, Proceedings of the IEEE, 2003.
[21] E N Chatzi, A W Smyth. The unscented Kalman filter and particle filter methods for nonlinear structural system identification with non-collocated heterogeneous sensing. Structural Control & Health Monitoring, 2010, 16(1):99-123.
[22] B Stenger, R S Paulo, R Mendonça Cipolla. Model-based hand tracking using an unscented Kalman filter. Proceedings of the British Machine Vision Conference 2001, BMVC 2001, Manchester, UK, 10-13 September 2001, 2001.
[23] X Ning, J Fang. An autonomous celestial navigation method for LEO satellite based on unscented Kalman filter and information fusion. Aerospace ence & Technology, 2007, 11(2-3):222-228.
[24] T Kim, T H Park. Extended Kalman filter (EKF) design for vehicle position tracking using reliability function of radar and LiDAR. Sensors, 2020, 20(15):4126.
[25] J Hollinger, B Kutscher, R Close. Fusion of LiDAR and radar for detection of partially obscured objects. SPIE Defense + Security, 2015.
[26] T N Ranjan, A Nherakkol, G Navelkar. Navigation of autonomous underwater vehicle using extended Kalman filter. Trends in Intelligent Robotics-13th FIRA Robot World Congress, FIRA 2010, Bangalore, India, September 15-17, 2010, 2010.
[27] A Khitwongwattana, T Maneewarn. Extended Kalman filter with adaptive measurement noise characteristics for position estimation of an autonomous vehicle. IEEE/ASME International Conference on Mechtronic & Embedded Systems & Applications, IEEE, 2008.
