Current Research

Research Areas

My research has been focused on Machine/Deep Learning, Computer Vision, Medical Image Analysis, Biometrics, Graphics, Computer Animation, and Augmented Reality.

Research Experience

Element Inc., NYC

    • R&D Lead: Research and development in deep learning and computer vision optimized for mobile applications. Element is co-founded by Prof. Yann LeCun.

Siemens Corporate Research, Princeton

    • Imaging and Computer Vision: Design and implement machine learning and computer vision algorithms for automatic object detection, segmentation and tracking in medical image analysis and industrial applications.

Robotics Institute, Carnegie Mellon University

Center for Visual Computing, Stony Brook University

    • 3D Facial Modeling and Analysis. Joint work with Prof. Dimitris Metaxas and Prof. Ahmed Elgammal at Rutgers University and with Prof. Dimitris Samaras, Prof. David Xianfeng Gu, and Prof. Peisen Huang at Stony Brook University to build an end-to-end system including structured light based real-time 3D shape acquisition, range data registration, 3D facial motion tracking, and novel facial expression synthesis.

    • Brookhaven National Laboratory (BNL) BME Project. Developing an integrated CCD-based image capture and motion tracking system, a core component of novel technologies that allow imaging of the awake animal brain in real-time and in natural physiological conditions by fusing multiple modalities, including Positron Emission Temography (PET) and functional Magnetic Resonance Imaging (fMRI).

    • 3D Virtual Room. Building a mobile camera-based scanning system as a part of advanced technologies for high-speed acquisition of 3D digital models in indoor environments.

    • Illumination Modeling for Augmented Reality. Developing an automatic method for the detection, estimation, and synthesis of multiple directional light sources, using only one input image of an object with arbitrary known geometry. Multiple information sources, such as shadows, shading, and specularities, are integrated together to achieve good performance on recovering the illuminants, even when significant non-directional sources exist in the scene.

Microsoft Research, Redmond, WA

    • Face Image Relighting and Recognition. Joint work with Dr. Zicheng Liu to investigate techniques for more accurate lighting estimation from images, and to develop systems to estimate and modify the lighting conditions of an image for better visual perception and machine recognition.

Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA

    • High Resolution Facial Feature Analysis. Joint work with Prof. Hanspeter Pfister and Dr. Michael Jones at MERL, and Prof. Dimitris Samaras at Stony Brook University to develop appropriate statistical features to describe the intra- and extra-personal variations of high resolution face images, and to evaluate the performance of high-resolution facial feature analysis.

State Key Laboratory of Intelligent Technology and Systems, Tsinghua University

    • VR Mechanical Assembly Platform. Research and development in artificial intelligence and computer vision to build a virtual reality platform for mechanical assembly education.

Education

    • Ph.D. in Computer Science, Stony Brook University, August 2000 - December 2006

    • M.S. in Computer Science, Tsinghua University, September 1998 - July 2000

    • B.S. in Computer Science, Tsinghua University, September 1993 - July 1998

Publications

Book Chapters

    • Learning-based Detection and Tracking in Medical Imaging: A Probabilistic Approach, Deformation Models: Tracking, Animation and Applications, Editors: Manuel González Hidalgo, Arnau Mir Torres, and Xavier Varona GĂłmez, Springer.

    • Face Image Synthesis, Handbook of Face Recognition (Second Edition), Editors: Stan Z. Li and Anil K. Jain, Springer-Verlag London Ltd.

Journal Papers

Referred Conferences and Workshops

    • DECORE: Deep Compression with Reinforcement Learning, M. Alwani, Y. Wang, and V. Madhavan, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New Orleans, LA, June 19-24, 2022

    • Automatic 3D Motion Estimation of Left Ventricle from C-arm Rotational Angiocardiography Using a Prior Motion Model and Learning Based Boundary Detector, M. Chen, Y. Zheng, Y. Wang, K. Mueller, and G. Lauritsch, MICCAI, Nagoya, Japan, September, 2013.

    • Automatic Detection and Quantification of Mitral Regurgitation on TTE with Application to Assist Mitral Clip Planning and Evaluation, Y. Wang, D. Vitanovski, B. Georgescu, R. Ionasec, I. Voigt, S. Datta, C. Gruner, B. Herzog, P. Biaggi, G. Funka-Lea, and D. Comaniciu, MICCAI Workshop on Clinical Image-based Procedures: From Planning to Intervention (CLIP), Nice, France, October, 2012.

    • Model-Based Flow Quantification Using Conditional Random Fields With Global Preferences, Y. Wang, B. Georgescu, S. Datta, S. Liu, P. Thavendiranathan, and M. Vannan, Proceedings of IEEE International Symposium on Biomedical Imaging - ISBI, Barcelona, Spain, May 2012.

    • Automatic 3D Cardiac Flow Quantification on Volumetric Color Doppler Data, Y. Wang, B. Georgescu, S. Datta, S. Liu, P. Thavendiranathan, M. Vannan, and D. Comaniciu, Proceedings of IEEE International Symposium on Biomedical Imaging - ISBI, Chicago, IL, April 2011.

    • Automatic Delineation of Left and Right Ventricles in Cardiac MRI Sequences Using a Joint Ventricular Model, X. Lu, Y. Wang, B. Georgescu, A. Littman, and D. Comaniciu, Proceedings of Six International Conference on Functional Imaging and Modeling and the Heart, New York, NY, May 2011.

    • Intrinsic Dense 3D Surface Tracking, Y. Zeng, C. Wang, Y. Wang, X. Gu, D. Samaras, and N. Paragios, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Pages 1225 - 1232, Colorado Springs, Colorado, June 20-25, 2011 (Oral Presentation).

    • Model-Based Fusion of Multi-Modal Volumetric Images: Application to Transcatheter Valve Procedures, S. Grbic, R. Ionasec, Y. Wang, T. Mansi, B. Georgescu, M. John, J. Boese, Y. Zheng, N. Navab, and D. Comaniciu, Proceedings of Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2011, 219-226, Toronto, Canada, September 2011

    • Accurate automated quantification of mitral regurgitation volume using transthoracic Real-Time Volume Color Doppler Imaging: Comparison to Magnetic Resonance Imaging, P. Thavendiranathan, S. Liu, S. Datta, Y. Wang, S. Srinivasan, B. Georgescu, A. Ntinuni, T. Van Houten, L. Vidmar, N. Tomson, A. Calleja, N. De Michelis, and M. Vannan, The American Society of Echocardiography (ASE) Annual Scientific Session, Montreal, Canada, June 2011.

    • Automated 3-D "Voxel" Longitudinal, Circumferential, and Radial Myocardial Mechanis by Real-Time Volume Transthoracic Echocardiography: Feasibility and Reproducibility, P. Thavendiranathan, S. Liu, A. Calleja, H. Houle, Y. Wang, C. Duong, S. Datta, B. Georgescu, A. Ntinunu, T. Van Houten, L. Vidmar, N. Tomson, T. Ryan, and M. Vannan, The American Society of Echocardiography (ASE) Annual Scientific Session , Montreal, Canada, June 2011.

    • Automated 3-D Quantification of Left Ventricular Stroke Volume by Transthoracic Real-Time Volumetric Color Flow Doppler Imaging: Comparison with Spectral Doppler and 3-D Volumetric Stroke Volume, S. Liu, S. Datta, P. Thavendiranathan, Y. Wang, S. Srinivasan, B. Georgescu, A. Ntinunu, T. Van Houten, L. Vidmar, N. Tomson, A. Calleja, N. De Michelis, and M. A. Vannan, American College of Cardiology 60th Annual Scientific Session , New Orleans, Louisiana, April 2011.

    • Dense Non-rigid Surface Registration Using High-Order Graph Matching, Y. Zeng, C. Wang, Y. Wang, X. Gu, D. Samaras, and N. Paragios, Proceedings of the Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, June 15-17, 2010.

    • Complete Valvular Heart Apparatus Model from 4D Cardiac CT, S. Grbic, R. Ionasec, D. Vitanovski, I. Voigt, Y. Wang, B. Georgescu, N. Navab, and D. Comaniciu, Proceedings of Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2010, Beijing, China, September 2010 (Oral Presentation, Young Scientist Awards).

    • Volumetric Myocardial Mechanics from 3D+t Ultrasound Data with Multi-Model Tracking, Y. Wang, B. Georgescu, H. Houle, and D. Comaniciu. Proceedings of Statistical Atlases and Computational Models of the Heart, First International Workshop (STACOM 2010), and Cardiac Electrophysiological Simulation Challenge (CESC 2010), Held in Conjunction with MICCAI 2010 , Beijing, China, September 20, 2010 (Oral Presentation).

    • Patient-Specific Modeling Of Left Heart Anatomy, Dynamics And Hemodynamics From High Resolution 4D CT, V. Mihalef, R. Ionasec, Y. Wang, Y. Zheng, B. Georgescu, and D. Comaniciu. Proceedings of IEEE International Symposium on Biomedical Imaging - ISBI , Rotterdam, The Netherlands, April 2010.

    • Learning-Based 3D Myocardial Motion Flow Estimation Using High Frame Rate Volumetric Ultrasound Data, Y. Wang, B. Georgescu, D. Comaniciu, and H. Houle, Proceedings of IEEE International Symposium on Biomedical Imaging - ISBI , Rotterdam, The Netherlands, April 2010 (Oral Presentation).

    • Robust Motion Estimation Using Trajectory Spectrum Learning: Application to Aortic and Mitral Valve Modeling from 4D TEE, R. Ionasec, Y. Wang, B. Georgescu, I. Voigt, N. Navab, and D. Comaniciu, Proceedings of the 12th IEEE International Conference on Computer Vision, Kyoto, Japan, September 2009.

    • Personalized Modeling and Assessment of the Aortic-Mitral Coupling from 4D TEE and CT, R. Ionasec, I. Voigt, B. Georgescu, Y. Wang, H. Houle, J. Hornegger, N. Navab, and D. Comaniciu, Proceedings of Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2009, London, UK, September 2009.

    • Non-rigid Face Tracking with Local Appearance Consistency Constraint, Y. Wang, S. Lucey, J. Cohn, and J. Saragih, Proceedings of 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands, September 2008.

    • 3D Non-rigid Surface Matching and Registration Based on Holomorphic Differentials, W. Zeng, Y. Zeng, Y. Wang, X. Gu, and D. Samaras, Proceedings of the 10th European Conference on Computer Vision, Marseille, France, October 2008 (Oral Presentation).

    • Enforcing Convexity for Improved Alignment with Constrained Local Models, Y. Wang, S. Lucey, and J. Cohn, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2008, Anchorage, AK, June 2008.

    • Non-Rigid Object Alignment with a Mismatch Template Based on Exhaustive Local Search, Y. Wang, S. Lucey, and J. Cohn, IEEE Workshop on Non-rigid Registration and Tracking through Learning - NRTL 2007 (in conjunction with ICCV 2007), Rio de Janeiro, Brazil, October 2007.

    • Ricci Flow for 3D Shape Analysis, X. Gu, S. Wang, J. Kim, Y. Zeng, Y. Wang, H. Qin, and D. Samaras, Proceedings of IEEE International Conference on Computer Vision 2007, Rio de Janeiro, Brazil, October 2007.

    • Face Re-Lighting from a Single Image under Harsh Lighting Conditions, Y. Wang, Z. Liu, G. Hua, Z. Wen, Z. Zhang, and D. Samaras, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2007, Minneapolis, MN June 2007.

    • Subtle Facial Expression Synthesis using Motion Manifold Embedding and Nonlinear Decomposiable Generative Models, C. Lee, Y. Wang, Z. Li, A. Kanaujia, A. Elgammal, D. Samaras, D. Metaxas, X. Gu, and P. Huang, ACM SIGGRAPH / Eurographics Symposium on Computer Animation Poster, 2006, Vienna, Austria Sept. 2006.

    • 3D Surface Matching and Recognition Using Conformal Geometry, S. Wang, Y. Wang, M. Jin, X. Gu, and D. Samaras, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2006, New York, NY June 2006.

    • High Resolution Tracking of Non-Rigid 3D Motion of Densely Sampled Data Using Harmonic Maps, Y. Wang, M. Gupta, S. Zhang, S. Wang, X. Gu, D. Samaras, and P. Huang, Proceedings of IEEE International Conference on Computer Vision 2005, Beijing, China, October 2005 (Oral Presentation).

    • Image-Driven Re-targeting and Relighting of Facial Expressions, L. Zhang, Y. Wang, S. Wang, S. Zhang, P. Huang, and D. Samaras, Proceeding of Computer Graphics International 2005, Stony Brook, NY, June 2005.

    • High Resolution Acquisition, Learning and Transfer of Dynamic 3D Facial Expressions, Y. Wang, X. Huang, C. Lee, S. Zhang, Z. Li, D. Samaras, D. Metaxas, A. Elgammal, and P. Huang, Proceedings of Eurographics 2004, Grenoble, France, August 2004 (Oral Presentation).

    • A Hierarchical Framework for High Resolution Facial Expression Tracking, X. Huang, S. Zhang, Y. Wang, D. Metaxas, and D. Samaras, Proc. of IEEE Workshop on Articulated and Nonrigid Motion, ANM 2004 (in conjunction with CVPR 2004), June 2004.

    • Multiple Directional Illuminant Estimation from a Single Image, Y. Wang, and D. Samaras, IEEE Workshop on Color and Photometric Methods in Computer Vision, CPMCV 2003 (in conjunction with ICCV 2003), October 2003.

    • Estimation of Multiple Directional Light Sources for Synthesis of Mixed Reality Images, Y. Wang, and D. Samaras, Proceedings of Pacific Graphics 2002, pages 38-47, October 2002 (Oral Presentation).

    • Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry, Y. Wang, and D. Samaras, Proceedings of European Conference on Computer Vision 2002, pp. III:272-288, May 2002.

Other Publications

    • rnn: Recurrent Library for Torch, N. LĂ©onard, S. Waghmare, Y. Wang, and J. Kim. arXiv, Nov. 2015 (Open Source).

    • Non-Rigid Face Tracking with Enforced Convexity and Local Appearance Consistency Constraint. The Eighteenth Wireless and Optical Communications Conference, May, 2009 (Invited Talk).

    • Face Modeling and Analysis in Stony Brook University, D. Samaras, Y. Wang, L. Zhang, S. Wang, and M. Gupta. Video Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2005, San Diego, CA, June 2005.