Abstract - In the fields of Augmented Reality (AR) and Virtual Reality (VR), inserting an object into a scene (real or virtual) requires proper matching of their lighting conditions. If not, the resulting image may look unnatural. In particular, it is important to describe the position and shape of specular reflection accurately if the object has specular reflection. First, we propose a simplized approach to relighting an object based on the separation of specular and diffuse reflection. The method requires two or more images taken under the condition that the position of the object is fixed but the lighting condition is different (we call "synchronized images"). However, it is impossible to obtain such images in case of moving objects. Second, we propose a method that computationally obtains the synchronized images using the consecutive fields of a controlled video sequence containing a moving object. Thus, the relighting method for static objects is applicable to moving object as it is.
Demo
Publication