"A Multi View Imaging (MVI) Processing Platform: Real Time Panoramic Mosaic Generation" is an ICT R&D funded project. The project shall be carried out at VISpro Lab SEECS-NUST in collaboration with Epic Technologies Islamabad.

Project Abstract: Multi View Imaging (MVI) techniques are finding extensive usage in future multimedia, surveillance, inspection and video conferencing applications. Particularly, the multi-billion entertainment/film industry is spending huge amounts in R & D related to immersive multimedia (e.g. Immersive TV). However, the biggest hurdle to-date has been the parallel processing of multiple video streams acquired in real time. This limits the benefits of MVI based systems for most applications. The project aims to design and develop a prototype system aimed as a platform for Multi View Imaging (MVI) applications such as Immersive Television and Video Conferencing. The project will result in a complete embedded hardware system, capable of generating real time panoramic mosaics, using video input from multiple cameras.

Project Highlights || Project Start Date : Feb 2012 | Project Funding : PKR 14.89 Million | Duration 20 Months | Extended till May 2014, Project closure under process

Executive summary

Multi View Imaging (MVI) techniques are finding extensive usage in future multimedia, surveillance, inspection and video conferencing applications. Particularly, the multibillion entertainment/film industry is spending huge amounts in R & D related to immersive multimedia (e.g. Immersive TV). However, the biggest hurdle to-date has been the parallel processing of multiple video streams acquired in real time. This limits the benefits of MVI based systems for most applications.

We propose to design and develop a prototype system aimed as a platform for Multi View Imaging (MVI) applications such as Immersive Television and Video Conferencing. The project will result in a complete embedded hardware system, capable of generating real time panoramic mosaics, using video input from multiple cameras. The MVI platform will also provide basic user interaction capabilities to customize the generated panoramic video, which can assist in solving another problem in immersive TV content generation, namely the Free Viewpoint TV (FTV in Immersive TV terminology).

Since, the prototype is being developed on a reconfigurable architecture, the platform can then be used to prototype other deliverable products which are useful for the local market and export. These applications encompass Internet (Panoramic video conferencing, Tele-monitoring of an object), Media (User-defined view for sporting events, Time freeze-videos), Security (Advanced surveillance system allowing to view and compress video from multiple cameras in a single view, Real time panoramic views for armed personal vehicles). The reconfigurable MVI platform will also provide a test-bed for the academia for rapid development of video processing based research applications.

The Team

HR Hierarchy Tree & Responsibilities

Project Milestones and Deliverables:

Publication