Misalignment recognition for detecting localization failures

Localization failure detection and misalignment recognition

Detection of localization failures is difficult because of the likelihood calculation process in the localization.To solve the localization problem, we need to assume that the sensor measurements are independent to each other. This assumption enables us to decompose the measurement model. Consequently, the measurement model can be calculated in real time. if not, it is infeasible to calculate the model in real time. However, entire relation of the measurements is ignored because the sensor measurements is assumed to be independent. As a result, recognizing misalignment is difficult when partial sensor measurement overlaps with mapped objects. In this work, I proposed a novel method to recognize misalignment and it enables to consider the entire relation.

The right hand figures show recognition results. The top shows a success localization case and the sensor measurements are exactly matched with the map. The red points are points categorized to aligned points. The bottom shows a failure localization case and slight mismatches can be seen. The blue points are points categorized to misaligned points. The proposed method enables to exactly recognize the misalignment while considering the entire relation.

Graphical model

The right figure is the graphical model of Markov random field with fully connected latent variables. In the proposed method, the gray nodes (observable variables), e, are residual errors and white nodes (latent variables), z, are classes of the measurements, i.e., aligned, misaligned, and unknown. Because the latent variables are fully connected to others, the entire relation of the measurements can be considered.

Publications

The misalignment recognition method is first presented in [1]. I extended this method for the 3D LiDAR-based localization and applied the extended one to the real automated driving. In [2], I confirmed that the misalignment recognition is significant for the safe automated driving. For the extension, I also developed efficient 3D distance field representation and it is presented in [3].

[1] Naoki Akai, Luis Yoichi Morales, Takatsugu Hirayama, and Hiroshi Murase. "Misalignment recognition using Markov random fields with fully connected latent variables for detecting localization failures," IEEE Robotics and Automation Letters, vol. 4, no. 4, pp. 3955-3962, 2019. (ResearchGate)

[2] Naoki Akai, Yasuhiro Akagi, Takatsugu Hirayama, Takayuki Morikawa, and Hiroshi Murase. "Detection of localization failures using Markov random fields with fully connected latent variables for safe LiDAR-based automated driving," IEEE Transactions on Intelligent Transportation Systems, (under review).

[3] Naoki Akai, Takatsugu Hirayama, and Hiroshi Murase. "3D Monte Carlo localization with efficient distance field representation for automated driving in dynamic environments," In Proceedings of the IEEE Intelligent Vehicles Symposium (IV), 2020. (ResearchGate).