Color Transfer using Probabilistic Moving Least Squares

for Nonlinear Color Transfer Between Images

The color of a scene may vary from image to image because the photographs are taken at different times, with different cameras, and under different camera settings. To align the color of a scene between images, we introduce a novel color transfer framework based on a scattered point interpolation scheme. Compared to the conventional color transformation methods that use a linear mapping or color distribution matching, we solve for a full nonlinear and nonparametric color mapping in the 3D RGB color space by employing the moving least squares framework. We further strengthen the transfer with a probabilistic modeling of the color transfer in the 3D color space to deal with mis-alignments and noise. Experiments show the effectiveness of our method over previous color transfer methods both quantitatively and qualitatively. In addition, our framework can be applied for various instances of color transfer such as transferring color between different camera models, camera settings, and illumination conditions, as well as for video color transfers.

Publication

• Youngbae Hwang, Joon-Young Lee, In So Kweon, Seon Joo KIm, "Color Transfer using Probabilistic Moving Least Sqaures", in IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3342-3349, 2014. [pdf][dataset]

• Youngbae Hwang, Joon-Young Lee, In So Kweon, Seon Joo KIm, "Probabilistic Moving Least Squares with Spatial Constraints for Nonlinear Color Transfer Between Images", Computer Vision and Image Understanding, accpeted.

Video Color Transfer Demos