Weipeng Xu

Research Scientist @ Facebook Reality Labs Research

Email: xuweipeng@fb.com

CV Google Scholar

Short Biography

Weipeng Xu is a research scientist at Facebook Reality Labs Research in Pittsburgh. He was a post-doctoral researcher at the Graphic, Vision & Video group of Max Planck Institute for Informatics in Saarbrücken, Germany. He received B.E. and Ph.D. degrees from Beijing Institute of Technology in 2009 and 2016, respectively. He studied as a long-term visiting student at NICTA and Australian National University from 2013 to 2015. His research interests include virtual human character, human pose estimation and machine learning for vision/graphics.

Research Highlights


  • Human performance capture

  • 3D human pose estimation

  • Neural rendering

  • Dynamic scene reconstruction

  • Virtual and augmented reality

  • 3D computer vision

  • Machine learning for vision/graphics

Publications

PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time

Soshi Shimada, Vladislav Golyanik, Weipeng Xu, Christian Theobalt

Siggraph Asia 2020

Neural Re-Rendering of Humans from a Single Image

Kripasindhu Sarkar, Dushyant Mehta, Weipeng Xu, Vladislav Golyanik, Christian Theobalt

ECCV 2020

XNect: Real-time Multi-person 3D Human Pose Estimation with a Single RGB Camera

Dushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu, Mohamed Elgharib, Pascal Fua, Hans-Peter Seidel, Helge Rhodin, Gerard Pons-Moll, Christian Theobalt

Siggraph 2020

Video Code

Neural Human Video Rendering by Learning Dynamic Textures and Rendering-to-Video Translation

Lingjie Liu, Weipeng Xu, Marc Habermann, Michael Zollhoefer, Florian Bernard, Hyeongwoo Kim, Wenping Wang, Christian Theobalt

TVCG 2020

Video (coming soon)

DeepCap: Monocular Human Performance Capture Using Weak Supervision

Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt

CVPR 2020 (Oral)

Video Project page

EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera

Lan Xu, Weipeng Xu, Vladislav Golyanik, Marc Habermann, Lu Fang, Christian Theobalt

CVPR 2020 (Oral, Best Student Paper Honorable Mention)

Video Project page

Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data

Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu

CVPR 2020

Video Project page

In the Wild Human Pose Estimation Using Explicit 2D Features and Intermediate 3D Representations

Ikhsanul Habibie, Weipeng Xu, Dushyant Mehta, Gerard Pons-Moll, Christian Theobalt

CVPR 2019 (Oral)

Learning a Disentangled Embedding for Monocular 3D Shape Retrieval and Pose Estimation

Kyaw Zaw Lin, Weipeng Xu, Qianru Sun, Christian Theobalt, Tat-Seng Chua

arxiv 2018

LiveCap: Real-time Human Performance Capture from Monocular Video

Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt

ACM TOG 2019

Neural Rendering and Reenactment of Human Actor Videos

Lingjie Liu, Weipeng Xu, Michael Zollhoefer, Hyeongwoo Kim, Florian Bernard, Marc Habermann, Wenping Wang, Christian Theobalt

ACM ToG 2019

Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera

Weipeng Xu, Avishek Chatterjee, Michael Zollhoefer, Helge Rhodin, Pascal Fua, Hans-Peter Seidel, Christian Theobalt

IEEE TVCG Proc. VR 2019 (Best Journal Paper Honorable Mention)

MonoPerfCap: Human Performance Capture from Monocular Video

Weipeng Xu, Avishek Chatterjee, Michael Zollhöfer, Helge Rhodin, Dushyant Mehta, Hans-Peter Seidel, Christian Theobalt

ACM TOG 2018

Deep Video Portraits

Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Nießner, Patrick Pérez, Christian Richardt, Michael Zollhöfer, Christian Theobalt

ACM TOG Proc. SIGGRAPH 2018

Detailed Human Avatars from Monocular Video

Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll

3DV 2018

A Hybrid Model for Identity Obfuscation by Face Replacement

Qianru Sun, Ayush Tewari, Weipeng Xu, Mario Fritz, Christian Theobalt, Bernt Schiele

ECCV 2018

Single-Shot Multi-Person 3D Body Pose Estimation From Monocular RGB Input

Dushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu, Srinath Sridhar, Gerard Pons-Moll, Christian Theobalt

3DV 2018

Video Based Reconstruction of 3D People Models

Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll

CVPR 2018 (Spotlight)

Illumination-invariant Robust Multiview 3D Human Motion Capture

Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt

WACV 2018

NRST: Non-rigid Surface Tracking from Monocular Video

Marc Habermann, Weipeng Xu, Helge Rhodin, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt

GCPR 2018 (Oral)

VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera

Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, Christian Theobalt

ACM TOG Proc. SIGGRAPH 2017

Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervision

Dushyant Mehta, Helge Rhodin, Dan Casas, Oleksandr Sotnychenko, Weipeng Xu, Christian Theobalt

3DV 2017

Deformable 3D Fusion: From Partial Dynamic 3D Observations to Complete 4D Models

Weipeng Xu, Mathieu Salzmann, Yongtian Wang, Yue Liu

ICCV 2015

Nonrigid Surface Registration and Completion from RGBD Images

Weipeng Xu, Mathieu Salzmann, Yongtian Wang, Yue Liu

ECCV 2014

Real-time keystone correction for hand-held projectors with an RGBD camera

Weipeng Xu, Yongtian Wang, Yue Liu, Dongdong Weng, Mengwen Tan, Mathieu Salzmann

ICIP 2013

"Soul Hunter": A novel augmented reality application in theme parks

DongDong Weng, Weipeng Xu, Dong Li, Yongtian Wang, Yue Liu

ISMAR 2011