In autonomous robots and driver-assistance systems for automobiles, it is important to measure a wide area in three dimensions at once. Our laboratory conducts various studies using fisheye cameras, which are well suited to wide-area measurement and compact sensing systems.
When a fisheye camera is used for measurement, accurate intrinsic parameters are often required. We therefore study methods for obtaining intrinsic parameters easily and accurately. Specifically, we propose a method in which a fisheye camera is rotated on a horizontal plane and its intrinsic parameters are estimated from the shape of feature-point trajectories in three-dimensional space.
-関連論文-
菱木暁彦, 梅田和昇, "カメラの回転を利用した魚眼カメラの内部パラメータ推定," 動的画像処理実利用化ワークショップDIA2018講演論文集, OS2-2, pp. 27-31, March 2018.
奥津良太, 寺林賢司, 梅田和昇:“球体を用いた魚眼カメラの内部パラメータ校正”,電子情報通信学会論文誌 ,Vol. J93-D, No. 12, pp.2645-2653, 2010.12.
Left : Rotating a Fisheye Camera
Right : Estimating Intrinsic Parameters from the Trajectory Shapes of Feature Points
When a fisheye camera is used for measurement, accurate intrinsic parameters are often required. We therefore study methods for obtaining intrinsic parameters easily and accurately. Specifically, we propose a method in which a fisheye camera is rotated on a horizontal plane and its intrinsic parameters are estimated from the shape of feature-point trajectories in three-dimensional space.
-関連論文-
大橋明, 山野史登, 増山岳人, 梅田和昇, 福田大輔, 入江耕太, 金子修造, 村山純哉, 内田吉孝, "正距円筒画像への変換を用いた魚眼ステレオカメラの構築," 精密工学会誌, Vol. 83, No. 12, pp. 1095-1100, December 2017.
Top-left figure : Exterior View of the Fisheye Stereo Camera
Top-right figure : Fisheye Image
Bottom-left figure : Equirectangular Image
Bottom-right figure : Distance Measurement Result
When measurement is performed using a stereo camera, the error included in the result depends on the accuracy of the camera calibration performed in advance. In this research, we propose a correction method that uses the disparity of feature points obtained from objects at known distances. We calculate the disparity error relative to the true value and use it to create a disparity offset map that represents the disparity error for all pixels. By applying this map as a correction to the stereo matching process, the accuracy of the fisheye stereo camera can be improved.
-関連論文-
山野史登,飯田浩貴,梅田和昇, 大橋明,福田大輔,金子修造,村山純哉,内田吉孝, "視差オフセットマップによる魚眼ステレオカメラの高精度化," 2018年度精密工学会春季大会学術講演会論文集, D74, pp.271-272,March 2018.
Top figure : Object at a Known Distance
Bottom-left figure : Disparity Error
Bottom-right figure : Disparity Offset Map
As pipes age, the risk of road cave-ins and other accidents increases. To prevent such accidents, it is effective to develop a system that can perform precise inspection from images captured inside pipes. In this research, we propose a method that creates unfolded views from images captured inside pipes with a wide-angle camera and then connects those unfolded views based on the motion information of the camera.
-関連論文-
田中宏樹, 山野史登, 菱木暁彦, 梅田和昇, 石川龍太郎, 眞野雄貴, 中村太郎, "配管内画像からの3次元地図作成," 2018年度精密工学会春季大会学術講演会論文集, ロボティクス・メカトロニクス講演会2018論文集, 1A1-I05, pp. 12, June 2018.
Left figure : Conversion from an In-Pipe Image to an Unfolded View (1)
Center figure : Conversion from an In-Pipe Image to an Unfolded View (2)
Right figure : Result of Stitching Nine Unfolded Views
We reconstruct a three-dimensional environment from a monocular fisheye camera using spatiotemporal images, which are created by arranging multiple images in chronological order. Because fisheye cameras have an ultra-wide field of view, they can measure a wide area, which leads to lower cost and makes them suitable for installation on vehicles.
In this research, a fisheye camera is mounted on a mobile robot to measure the surrounding environment. Three-dimensional reconstruction is then performed while taking into account the special distortion characteristics of the fisheye lens.
Sensor Configuration
Acquired Image
One system that helps drivers understand the surroundings of a vehicle presents an image that appears to show the vehicle from directly above. This is created by transforming images obtained from multiple fisheye cameras mounted on the vehicle into a top-view format and combining them to generate a full-surround view. To do this accurately, the positions and orientations of the fisheye cameras, that is, their external parameters, must be known precisely. In this research, calibration markers with known shapes are placed around the vehicle, and the external parameters of multiple fisheye cameras are estimated from the shapes of the markers in the images.
Calibration Environment