Deputy director of Augmented Vision department




 
I am deputy director of the Augmented Vision group and senior researcher at German Research Center for Artificial Intelligence (DFKI)

My research interests include Computer Vision, Artificial Intelligence, Image Understanding, Augmented Reality and Machine Learning.
I am involved in publicly founded research projects as well as in industrial application projects.
I am particularly interested in 3D Computer Vision and Image-based scene reconstruction as well as in Object Detection and Tracking.

Here is an example of one of my recent developments in AR - (see www.augmented-things.com):

This video shows one possible use of my pose tracking library pulsAR - here using monocular visual-inertial tracking:


Since 2000 I am working with Prof. Didier Stricker on Augmented Reality topics (see here for an early application we developed in 2000 that combines Augmented Reality, Artificial Intelligence and Hand Recognition).

At DFKI, I am leading the projects Eyes of Things (2015-2017) about miniaturized low-power computer vision devices and LARA (2015-2017) about outdoor Augmented Reality based on Galileo navigation.
I was also involved in the BMBF project CAPTURE (2009-2012) about 3D reconstruction of urban scenes from multiple spherical images, and  OnEye (2010-2013) about semi-supervised object tracking in videos.
Our object tracking technology is used in several industrial projects and won a Google Research Award (Didier Stricker).

Prior to joining DFKI, I was working at Fraunhofer IGD in the field of Augmented Reality, 3D Computer Vision and Color Calibration.
I was involved in the EU-project SKILLS (2007-2011) about Multimodal interfaces for the Capture and Transfert of Skills and IMPROVE (2005-2008) about Color Calibration of Multi-projector displays.

In 2000, I was a visiting researcher in the LAMP Lab at the University of Maryland, College Park, in the group of Daniel Dementhon.

I am reviewer for different conferences (BMVCICML, ISMAR, IROS...) and journals (TPAMIIMAVISJVCI, TVCG, SIVPJAISE, TIP).

Information about some of my other activities can be found on this profiles page.


View Alain Pagani's profile on LinkedIn

Alain Pagani's citations
View my profile on Google scholar


 
Contact information

Dr. Alain Pagani
German Research Center for Artificial Intelligence
Trippstadterstr. 122
67663 Kaiserslautern
Germany

Phone: +49 631 205 75 -3530
email: alain.pagani [at] dfki.de


Publications

Journal articles
  • Eyes of Things, Oscar Deniz, Noelia Vallez, Jose L. Espinosa-Aranda, Jose M. Rico-Saavedra, Javier Parra-Patino, Gloria Bueno, David Moloney, Alireza Dehghani, Aubrey Dunne, Alain Pagani, Stephan Krauss, Ruben Reiser, Martin Waeny, Matteo Sorci, Tim Llewellynn, Christian Fedorczak, Thierry Larmoire, Marco Herbst, Andre Seirafi, Kasra Seirafi, Sensors, 17(5), May 2017 [pdf]
  • Modeling Reality for Camera Registration in Augmented Reality Applications, Alain Pagani, KI - Künstliche Intelligenz2014, DOI: 10.1007/s13218-014-0320-5 [link]
  • A user supported object tracking framework for interactive video production, Christian Bailer, Alain Pagani, Didier Stricker, Journal of Virtual Reality and Broadcasting 11(9)2014 [pdf]
  • In-situ visualization for cultural heritage sites using novel augmented reality technologies, Didier Stricker, Alain Pagani, Michael Zoellner, Virtual Archeology Review, 1(2):37–41, May 2010.  [pdf]
  • Spatially Uniform Colors for Projectors and Tiled Displays, Alain Pagani, Didier Stricker, Journal of the Society for Information Display, 2007 [pdf]
  • IMPROVE: An innovative application for collaborative mobile mixed reality design review, Pedro Santos, André Stork, Thomas Gierlinger, Alain Pagani, Bruno Araújo, Ricardo Jota, Luis Bruno, Joaquim Jorge, Joao Madeiras Pereira, Martin Witzel, Giuseppe Conti, Raffaele De Amicis, Iñigo Barandarian, Céline Paloc, International Journal on Interactive Design and Manufacturing (IJIDeM), 2007 [pdf]
Conference papers

  • Image Quality-Aware Deep Networks Ensemble for Efficient Gender Recognition in the Wild, Mohamed Selim, Suraj Sundararajan, Alain Pagani, Didier Stricker, International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), 2018, [pdf]
  • Augmented Things: Enhancing AR Applications leveraging the Internet of Things and Universal 3D Object Tracking, Jason Rambach, Alain Pagani, Didier Stricker, IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2017  (ISMAR 2017 Best Poster Paper Award), [pdf]
  • Fusion of unsynchronized optical tracker and inertial sensor in EKF framework for in-car Augmented Reality delay reductionJason Rambach, Alain Pagani, Sebastian Lampe, Ruben Reiser, Manthan Pancholi, Didier Stricker, IEEE International Symposium on Mixed and Augmented Reality (ISMAR), [pdf]
  • Sparse-MVRVMs Tree for Fast and Accurate Head Pose Estimation in the Wild, Mohamed Selim, Alain Pagani, Didier Stricker, Computer Analysis of Images and Patterns (CAIP), 2017 [pdf]
  • Eyes of Things, Noelia Vallez, Jose L. Espinosa-Aranda, Jose M. Rico-Saavedra, Javier Parra-Patino, Oscar Deniz, Alain Pagani, Stephan Krauss, Ruben Reiser, Didier Stricker, David Moloney, Alireza Dehghani, Aubrey Dunne, Dexmont Pena, Martin Waeny, Pedro Santos, Matteo Sorci, Tim Llewellynn, Christian Fedorczak, Thierry Larmoire, Elodie Roche, Marco Herbst, Andre Seirafi, Kasra Seirafi, IEEE International Conference on Cloud Engineering (IC2E), 2017 [pdf]
  • Learning to Fuse: A Deep Learning Approach to Visual-Inertial Camera Pose Estimation, Jason Rambach, Aditya Tewari, Alain Pagani, Didier Stricker, IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2016 [pdf]
  • Sensors for location-based Augmented Reality - the example of Galileo and EGNOS, Alain Pagani, José Henriques, Didier Stricker, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences Congress of the International Society of Photogrammetry and Remote Sensing (ISPRS), 2016 [pdf]
  • LARA: A location-based and augmented reality assistive system for underground utilities' networks through GNSS, Efstratios Stylianidis, Elena Valari, Kostas Smagas, Alain Pagani, Jose Henriques, Alejandro Garcia, Elisa Jimeno, Ivan Carillo, Petros Patias, Charalampos Georgiadis, Anastasis Kounoudes, Konstantinos Michail, International Conference on Virtual System & Multimedia (VSMM), 2016 [pdf]
  • LBS Augmented Reality Assistive Systems for utilities infrastructure management through Galileo and EGNOS, Efstratios Stylianidis, Elena Valari, Kostas Smagas, Alain Pagani, Jose Henriques, Alejandro Garcia, Elisa Jimeno, Ivan Carillo, Petros Patias, Charalampos Georgiadis, Anastasis Kounoudes, Konstantinos Michail, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences Congress of the International Society of Photogrammetry and Remote Sensing (ISPRS), 2016 [pdf]
  • Feature-augmented Trained Models for 6DOF Object Recognition and Camera Calibration, Kripasindhu Sarkar, Alain Pagani, Didier Stricker, International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), 2016 [pdf]
  • Real Time Head Pose Estimation Using Multi-Variate RVM on Faces in the WildMohamed Selim, Alain Pagani, Didier Stricker, Computer Analysis of Images and Patterns (CAIP), 2015 [pdf]
  • Advancing Physics Learning Through Traversing a Multi-Modal Experimentation Space , Jochen Kuhn, Alexander Nussbaumer, Johanna Pirker, Dimosthenis Karatzas, Alain Pagani, Owen Conlan, Martin Memmel, Christina M. Steiner, Christian Gütl, Dietrich Albert, Andreas Dengel, Immersive Learning Research Network Conference (iLRN), 2015 [pdf]
  • A Superior Tracking Approach: Building a strong Tracker through FusionChristian Bailer, Alain Pagani, Didier Stricker, European Conference on Computer Vision (ECCV), 2014 [pdf] [supplemental material] (Tracker Fusion Library available, see "Software" section)
  • Consistent Pose Uncertainty Estimation for Spherical Cameras, Bernd Krolla, Christiano Couto-Gava, Alain Pagani, Didier Stricker, International Conferences in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG), 2014 [pdf]
  • OnEye – Producing and broadcasting generalized interactive videosAlain Pagani, Christian Bailer, Didier StrickerProceedings of the Networked and Electronic Media Summit (NEM Summit), Nantes, France, 2013 [pdf]
  • Bildbasierte Messung und Analyse sportlicher AktivitätenAlain Pagani, Christian Bailer, Didier StrickerI. Fichtner (Hrsg.), Informations- und Kommunikationstechnologien in der angewandten Trainingswissenschaft. Beiträge zur 15. Frühjahrsschule des IAT am 17./18. April 2013 in Leipzig, 2013 [pdf]
  • Real-time Modeling and Tracking Manual Workflows from First-Person Vision, Nils Petersen, Alain Pagani, Didier StrickerProceedings of the International Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, Australia, 2013 [pdf]
  • A user supported tracking framework for interactive video productionChristian Bailer, Alain Pagani, Didier StrickerProceedings of the 10th European Conference on Visual Media Production (CVMP), London, UK, 2013 [pdf]
  • Robust Guided Matching and Multi-layer Feature Detection Applied to High Resolution Spherical Images, Christiano Couto Gava, Alain Pagani, Bernd Krolla, Didier Stricker, International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), 2013 [pdf]
  • Circular markers for camera pose estimation, Alain Pagani, Johannes Köhler, Didier Stricker, International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), 2011 [pdf]
  • Dense 3D Point Cloud Generation from Multiple High-resolution Spherical Images, Alain Pagani, Christiano Gava, Yan Cui, Bernd Krolla, Jean-Marc Hengen, Didier Stricker International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST), 2011 [pdf]
  • Structure from Motion using full spherical panoramic camerasAlain Pagani, Didier Stricker ICCV Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (OMNIVIS), 2011 [pdf]
  • Robust point matching in HDRI through estimation of illumination distribution, Yan Cui, Alain Pagani, Didier Stricker, Proceedings of Annual Symposium of the German Association for Pattern Recognition (DAGM), 2011 [pdf]
  • Detection and Identification Techniques for Markers Used in Computer Vision Johannes Köhler, Alain Pagani, Didier Stricker Visualization of Large and Unstructured Data Sets - Applications in Geospatial Planning, Modeling and Engineering (IRTG 1131 Workshop), 2010 [pdf]
  • Markerless Camera Pose Estimation - An OverviewTobias Nöll, Alain Pagani, Didier Stricker, Visualization of Large and Unstructured Data Sets - Applications in Geospatial Planning, Modeling and Engineering (IRTG 1131 Workshop), 2010 [pdf]
  • Real-time camera pose estimation using correspondences with high outlier ratios Tobias Nöll, Alain Pagani, Didier Stricker, International Conference on Computer Vision Theory and Applications (VISAPP), 2010 [pdf]
  • Robust Detection and Identification of Partially Occluded Circular MarkersJohannes Koehler, Alain Pagani, Didier Stricker International Conference on Computer Vision Theory and Applications (VISAPP), 2010 [pdf]
  • SIFT in perception based color space, Yan Cui, Alain Pagani, Didier Stricker, International Conference on Image Processing (ICIP), 2010 [pdf]
  • Canaux projectifs intégraux pour la mise en correspondance de régions,.Alain Pagani, Didier Stricker,  ORASIS: Journées francophones des jeunes chercheurs en vision par ordinateur, 2009 [pdf]
  • In-Situ Visualization for Cultural Heritage Sites using Novel Augmented Reality Technologies, Didier Stricker, Alain Pagani, Michael Zöllner, International Conference on Graphic Archeology and Cultural Heritage, 2009 [pdf]
  • Integral P-channels for fast and robust region matching, Alain Pagani, Didier Stricker, Michael Felsberg, IEEE International Conference on Image Processing (ICIP), 2009 [pdf]
  • Learning Local Patch Orientation with a Cascade of Sparse RegressorsAlain Pagani, Didier Stricker, British Machine Vision Conference (BMVC), 2009 [pdf]
  • Reality Filtering : A Visual Time Machine in Augmented RealityMichael Zoellner, Alain Pagani, Yulian Pastarmov, Harald Wuest, Didier Stricker, International Symposium on Virtual Reality Archaeology and Cultural Heritage (VAST)2008 [pdf]
  • An Architecture for Prototyping and Application Development of Visual Tracking SystemsMario Becker, Gabriele Bleser, Alain Pagani, Didier Stricker, Harald Wuest, 3DTV Conference, 2007 [pdf]
  • Feature Management for Efficient Camera Tracking, Harald Wuest, Alain Pagani, Didier Stricker, Asian Conference on Computer Vision (ACCV), 2007 (Best Paper Award INI-GraphicsNet 2008 - Honorable Mentions) [pdf]
  • IMPROVE: Advanced Displays and Interaction Techniques for Collaborative Design Review, Pedro Santos, André Stork, Thomas Gierlinger, Alain Pagani, Bruno de Araujo, Ricardo Jota, Luis Bruno, Joaquim Jorge, Joao Madeiras Pereira, Martin Witzel, Giuseppe Conti, Raffaele de Amicis, Inigo Barandarian, Céline Paloc, Maylu Hafner, and Don McIntyre, Human-Computer Interaction International, 2007 [pdf]
  •  IMPROVE: Collaborative Design Review in Mobile Mixed Reality, Pedro Santos, André Stork, Thomas Gierlinger, Alain Pagani, Bruno Araújo, Ricardo Jota, Luis Bruno, Joaquim Jorge, Joao Madeiras Pereira, Martin Witzel, Giuseppe Conti, Raffaele De Amicis, Iñigo Barandarian, Céline Paloc, Human-Computer Interaction International, 2007 [pdf]
  • IMPROVE: Designing Effective Interaction for Virtual and Mixed Reality Environments, Pedro Santos, André Stork, Thomas Gierlinger, Alain Pagani, Céline Paloc, Giuseppe d Conti, Raffaele DeAmicis, Inigo Barandarian, Celine Paloc, Oliver Machui, Georg Bodammer, Jose Manuel Jiménez, Don McIntyre, Human-Computer Interaction International, 2007 [pdf]
  • IMPROVE: An Innovative Application for Collaborative Mobile Mixed Reality Design Review, Pedro Santos, André Stork, Thomas Gierlinger, Alain Pagani, Bruno Araújo, Ricardo Jota, Luis Bruno, Joaquim Jorge, Joao Madeiras Pereira, Martin Witzel, Giuseppe Conti, Raffaele De Amicis, Iñigo Barandarian, Céline Paloc, Virtual Concept Conference, 2006  [pdf] (journal version)
  • Photometric and Chromatic Calibration for Multi-Projector Tiled Displays, Alain Pagani, Didier Stricker, IS&T / SID Color Imaging Conference (CIC), 2006 (Best Paper Award INI-GraphicsNet 2007 - Honorable Mentions) [pdf]
  • Visual Tracking for Augmented Reality: No Universal Solution but Many Powerful Building Blocks, Mario Becker, Gabriele Bleser, Alain Pagani, Yulian Pastarmov, Didier Stricker, Florent Vial, Jens Weidenhausen, Cédric Wohlleber, Harald Wuest, Virtuelle und Erweiterte Realität : 2. Workshop der GI-Fachgruppe VR/AR, 2005 [pdf]
  • A comparative study of seven solutions to the PnP problem, Alain Pagani, Didier Stricker, ORASIS: Journées francophones des jeunes chercheurs en vision par ordinateur, 2003 [pdf]

Theses
  • Reality Models for efficient registration in Augmented Reality, Alain Pagani, Ph.D. Thesis, University of Kaiserslautern, Dr. Hut Verlag, 2015, ISBN 978-3843920117 [link]
  • Integration of Virtual Objects into an Image from a Single View, Alain Pagani, Master Thesis, Technische Universität Darmstadt, 2002 (Best Thesis Award - INI-GraphicsNet ) [pdf]
Reports
  • A New MERIT Version for MPEG-2 Encoded Files. Alain Pagani, Technical Report LAMP-TR-057 CAR-TR-953 CS-TR-4186, University of Maryland, 2000 [pdf]


Software

Tracker Fusion Library (Linux)

The Tracker Fusion Library is provided for testing purposes. You are allowed to use the provided implementation/library for non commercial purposes only. For commercial usage (including source code if required) please contact Prof. Stricker (Didier.Stricker@dfki.de). For implementation issues, please contact Chrisitian Bailer (Christian.Bailer@dfki.de).
If you publish results based on this code, please cite: "A Superior Tracking Approach: Building a strong Tracker through Fusion, Christian Bailer, Alain Pagani, Didier Stricker, European Conference on Computer Vision (ECCV), 2014"

TrackerFusionLibrary 1.0 (Jan-20-2015)