Research

Mutual Superimposing for Remote Sensing Images with Diferring Altitudes / 異高度撮影されたリモートセンシング画像間の画像重畳法

This study proposes an image registration method that links Synthetic Aperture Radar (SAR) satellite images and ground-level shooting images through intermediate multi-altitude images, such as optical satellite and low-altitude drone images. To overcome differences in imaging modalities, spatial resolutions, and viewpoints, we applied deep learning-based image translation from SAR to optical appearances, spatial resolution alignment via super-resolution, and virtual top-view image generation. The proposed method successfully superimposes wide-area SAR information and high-resolution ground-level details onto each other.

本研究では、合成開口レーダ（SAR）衛星画像と地上撮影画像の直接的な位置合わせという未解決課題に対し、高度の異なる複数画像（光学衛星画像・ドローン等の低高度画像）を介して対応づけを行う手法を提案する。深層学習によるSARから光学画像への疑似変換や、超解像技術による空間解像度の統一、仮想俯瞰画像の生成により、モダリティ・解像度・撮影視点の違いを克服した。これにより、SARの広域・全天候型の情報と、地上画像の高精細な情報を相互に重畳することが可能となった。

Related works

Hisatoshi Toriya, Ashraf Dewan, Hajime Ikeda, Narihiro Owada, Mahdi Saadat, Fumiaki Inagaki, Youhei Kawamura, Itaru Kitahara, “Use of a DNN-Based Image Translator with Edge Enhancement Technique to Estimate Correspondence between SAR and Optical Images,” Applied Science, vol. 12, no. 9, pp. 4159-4174, April, 2022.
Hisatoshi Toriya, Narihiro Owada, Mahdi Saadat, Fumiaki Inagaki, Ashraf Dewan, Youhei Kawamura, Itaru Kitahara, “Mutual Superimposing of SAR and Ground-Level Shooting Images Mediated by Intermediate Multi-Altitude Images,” Array, Volume 12, 13 pages, October 2021.
Hisatoshi Toriya, Itaru Kitahara, Yuichi Ohta, “Mobile Camera Localization Using Aerial-View Images,” Transactions on Computer Vision and Applications (CVA), Vol.6, pp.111-119, October 2014.
Hisatoshi Toriya, Ashraf Dewan, Itaru Kitahara, “Adaptive Image Scaling for Corresponding Points Matching between Images with Differing Spatial Resolutions,” IEEE Workshop on Human-in-the-Loop Methods and Future of Work in BigData (IEEE HMData), Atlanta, GA, USA, 8 pages, December 2020.
Hisatoshi Toriya, Ashraf Dewan, Itaru Kitahara, “SAR2OPT: IMAGE ALIGNMENT BETWEEN MULTI-MODAL IMAGES USING GENERATIVE ADVERSARIAL NETWORKS,” IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Yokohama, Japan, pp.923-926, July 2019.
Hisatoshi Toriya, Kenta Senzaki, Masato Tsukada, Minoru Murata, “ESTIMATING THREE DIMENSIONAL POSITIONS OF PERSISTENT SCATTERERS AND DEVELOPING A PS-INSAR ANALYSIS SYSTEM,” IEEE International Geoscience and Remote Sensing Symposium (IGARSS), INSPEC Accession Number:17397538, Fort Worth, Texas, USA, pp.1550-1553, July 2017.
Hiromichi Hirata, Ryo Saito, Hideya Tomita, Takakazu Ishii, Yukie Inoue, Hisatoshi Toriya, Minoru Murata, “PS-INSAR ANALYSIS AND ACCURACY EVALUATION OF A KNOWN TARGET WITH HEIGHT CHANGE,” 36th Asian Conference on Remote Sensing (ACRS), Quezon City, Metro Manila Philippines, 4 pages, October 2015.
Hisatoshi Toriya, Itaru Kitahara, Yuichi Ohta, “A Mobile Camera Localization Method Using Aerial-View Images,” The 2nd Asian Conference on Pattern Recognition (ACPR), INSPEC Accession Number:14197971, Naha, Okinawa, Japan, pp.49-53, November 2013.
Itaru Kitahara, Hisatoshi Toriya, Yuichi Ohta, “A Mobile Camera Localization Method for Updating Topography Map,” The 3rd International Workshop on Soft Computing and Disaster Control (SocDic), Bali, Indonesia, 2 pages, November 2013.

Google Earth Pro 2020-12-08 21-00-36.mp4

Demo video of proposed mutual super imposing for differing altitude images.

Page updated

Google Sites

Report abuse