Video Synchronization

Video synchronization is one of the most important techniques in the field of video signal processing. It is used to combine multiple videos which have been captured by multiple cameras along different angles independently (i.e., without synchronization). For example, at a concert, a camera captures a good view of the stage while two other cameras capture clear audio and a good coverage of the audience. The combination of these three recordings would create a more desirable video than each of the separate recordings.

The following video shows the sequences captured by multiple cameras independently, i.e., without synchronization.

When 6 DoF image is constructed from the above sequences without synchronization, the generated image is severely degraded and includes a kind of ghost effect. The below video shows the degraded data.

The following video shows the sequences synchronized by the proposed algorithm which are based on the spectral flatness.

When 6 DoF image is constructed from the above sequences which are synchronized by the proposed algorithm. When we compare it with the above result, we can see the quality of the constructed 6 DoF image increases significantly due to the synchronization.