Xinchen Yan
严欣辰 (My name in Korean: 엄흔진)
PhD Candidate
Room 3944, Beyster Building
2260 Hayward Street, Ann Arbor, MI 48109
Email: skywalkeryxc [at] gmail [dot] com (primary)
           xcyan [at] umich [dot] edu

@Königssee Germany, Sept. 2018

My name is Xinchen Yan, PhD candidate of CSE Department, UM, Ann Arbor. My advisor is Professor Honglak Lee. I obtained my bachelor's degree in Computer Science from Shanghai Jiao Tong University (ACM Honored Class 交大ACM班) in 2014.

My primary research interests lie in the intersection of deep representation learning and generative modeling with structured and multimodal data. More specifically, my research has been focused on three related topics: (1) controllable image generation and manipulation, (2) deep generative modeling with structured data, and (3) weakly-supervised 3D shape generation with geometry-aware structures. Besides, I have a broad range of interests in developing deep generative models for vision, graphic, and robotic applications.

In the past, I worked as a research intern at Adobe Research (Summer 2017) and Google (Fall 2016, Winter 2017, Summer 2018 & Fall 2018). During my internship at Adobe Research, I applied VAE to model higher-order human motion dynamics: Generating Multimodal Human DynamicsDuring my internship at Google Brain team, I collaborated with researchers at Brain and X Robotics on Deep Geometry-aware Grasping. Prior to my PhD studies, I visited Rapid-Rich Object Search (ROSE) Lab at Nanyang Technological University (Singapore) in 2014, advised by Professor Junsong Yuan. I also worked on several research projects during my undergrad in MOE-MSR Joint Key Lab of Intelligence Computing (BCMI Lab), advised by Professor Liqing Zhang

* 01/2019: Check out TensorFlow implementation of our ECCV 2018 paper on Github.
11/2018: Check out Project page of our NeurIPS 2018 paper.
* 08/2018: Honored to receive Adobe Research Fellowship and Google PhD Fellowship. I really appreciate the support from my PhD advisor, committee members at U of Michigan, collaborators in academia and industry.
* 07/2018: Check out Project page of our ECCV 2018 paper.
* 01/2018: Check out Project Page of our ICRA 2018 paper.
* 07/2017: Check out TensorFlow implementation of our NeurIPS 2016 paper on Github.
* 12/2016: Check out Torch implementation of our NeurIPS 2016 paper (unsupervised learning of 3D shape generation) on Github.
* 10/2016: Check out Torch implementation of our ECCV 2016 paper (conditional image generation) on GitHub.

Education & Research Experience (full in Mandarin)
(06/2018 -- 12/2018) Student Researcher Intern@Google Brain, Mountain View 
(06/2017 -- 09/2017) Research Intern@Adobe Systems Inc, San Jose
(11/2016 -- 06/2017) Research Intern@Google Brain, Mountain View
(08/2014 -- current) PhD Candidate@University of Michigan, Ann Arbor

Professional Activities
* Conference Reviewer
     - NeurIPS (2016 -- 2018)
     - ICML (2018 -- 2019)
     - ICLR (2018 -- 2019)
     - CVPR 2019
     - CoRL 2018
     - WACV 2019
* Journal Reviewer
    - IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
    - IEEE Transactions on Image Processing (TIP)

Learning Hierarchical Semantic Image Manipulation through Structured Representations
Seunghoon Hong, Xinchen Yan, Thomas Huang, Honglak Lee 
In Advances in Neural Information Processing Systems (NeurIPS), Montreal, Canada, 2018

MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamics
Xinchen YanAkash Rastogi, Ruben Villegas, Kalyan Sunkavalli, Eli Shechtman, Sunil Hadap, Ersin Yumer, Honglak Lee
In European Conference on Computer Vision (ECCV), Munich, Germany, 2018

* Learning 6-DOF Grasping Interaction via Deep Geometry-aware 3D Representations
Xinchen YanJasmine Hsu, Mohi Khansari, Yunfei Bai, Arkanath Pathak, Abhinav Gupta, James Davidson, Honglak Lee
In Proceedings of International Conference on Robotics and Automation (ICRA)Brisbane, Australia, 2018

* Deep Variational Canonical Correlation Analysis
Weiran Wang, Xinchen Yan, Honglak Lee, Karen Livescu
Technical Report [arxiv]
TensorFlow Implementation: [code]

Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision
Xinchen Yan, Jimei Yang, Ersin Yumer, Yijie Guo, Honglak Lee
In Advances in Neural Information Processing Systems (NeurIPS), Barcelona, Spain, 2016
Torch Implementation: [data][code]
TensorFlow Implementation: [code]
Note, if you want to use your own camera matrix, please refer to the section "using your own camera" here.

* Generative Adversarial Text-to-Image Synthesis
Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, Honglak Lee
In Proceedings of the 33rd International Conference on Machine Learning (ICML), New York, USA, 2016
Torch Implementation: [code]

* Attribute2Image: Conditional Image Generation from Visual Attributes
Xinchen Yan, Jimei Yang, Kihyuk Sohn, Honglak Lee
In European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands, 2016
Torch Implementation: [code]

* Learning Structured Output Representation using Deep Conditional Generative Models
Kihyuk Sohn, Xinchen Yan, Honglak Lee
In Advances in Neural Information Processing Systems (NeurIPS), Montreal, Canada, 2015. 

* A Unified Framework for Automatic Wound Segmentation and Analysis with Deep Convolutional Neural Networks
Changhan Wang, Xinchen Yan, Max Smith, Kanika Kochhar, Marcie Rubin, Stephen M. Warren, James Wrobel, Honglak Lee
In 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy, 2015.

* Efficient Online Spatio-Temporal Filtering for Video Event Detection
Xinchen Yan, Junsong Yuan, Hui Liang, Liqing Zhang
In ECCV Workshop on Video Event Categorization, Tagging and Retrieval towards Big Data (VECTaR 2014), Zurich, Switzerland, 2014.
C++/MATLAB Implementation: [code]

Teaching Experience
(09/2011 - 01/2012) Teaching Assistant of C++ Programming (Fall 2011)
(03/2012 - 06/2012) Teaching Assistant of Data Structures (Spring 2012)
(09/2012 - 12/2012) Assistant Lecturer of Math Foundations in Computer Science (Fall 2012)

Honors & Awards
(04/2018) Google PhD Fellowship in Machine Learning (8 selected world-wide) [News from Google AI Blog]
(12/2017) Adobe Research Fellowship (10 selected in USA) [News from Adobe Research Blog]
(12/2012) Academic Excellence Scholarship (Second-class) of Shanghai Jiao Tong University in Year 2011-2012
(12/2011) Academic Excellence Scholarship (Second-class) of Shanghai Jiao Tong University in Year 2010-2011
(Year 2008, 2009, & 2010) First Prizes in National Olympiad in Informatics in Provinces
Xinchen Yan,
Jul 31, 2014, 2:27 AM
Xinchen Yan,
Jul 31, 2014, 1:48 AM