A Novel Image Fusion Scheme for FTV View Synthesis based on Layered Depth Scene Representation & Scale Periodic Transform
Mansi Sharma, Gowtham Ragavan
In Proceedings of 2019 International Conference on 3D Immersion (IC3D 2019), Brussels, Belgium, Part of Stereopsia
(World Immersion Forum)
Abstract
This paper presents a novel image fusion scheme for view synthesis based on a layered depth profile of the scene and scale periodic transform. To create a layered depth profile of the scene, we utilize the unique properties of scale transform considering the problem of depth map computation from reference images as a certain shift-variant problem. The problem of depth computation is solved without deterministic stereo correspondences or rather than representing image signals in terms of shifts. Instead, we pose the problem of image signals being representable as scale periodic function, and compute appropriate depth estimates determining the scaling of a basis function. The rendering process is formulated as a novel image fusion in which the textures of all probable matching points are adaptively determined, leveraging implicitly the geometric information. The results demonstrate superiority of the proposed approach in suppressing geometric, blurring or flicker artifacts in rendered wide-baseline virtual videos.
IC3D2019FTVScalePeriodicTransform.pdfCitation
M. Sharma and G. Ragavan, "A Novel Image Fusion Scheme for FTV View Synthesis Based on Layered Depth Scene Representation & Scale Periodic Transform," 2019 International Conference on 3D Immersion (IC3D), Brussels, Belgium, 2019, pp. 1-8.
doi: 10.1109/IC3D48390.2019.8975902
BibTex
@INPROCEEDINGS{8975902,
author={M. {Sharma} and G. {Ragavan}},
booktitle={2019 International Conference on 3D Immersion (IC3D)},
title={A Novel Image Fusion Scheme for FTV View Synthesis Based on Layered Depth Scene Representation Scale Periodic Transform},
year={2019},
volume={},
number={},
pages={1-8},
keywords={View interpolation;image-based rendering;3D TV;image fusion;stereo matching;layered depth map;3D video;scale transform;shift variant problem},
doi={10.1109/IC3D48390.2019.8975902},
ISSN={2379-1772},
month={Dec}}
