Dr. Tony TUNG
Research Scientist
Facebook /Oculus Research
San Francisco, USA
Open positions at our Oculus Research office in San Francisco area for Research Scientists and Postdocs:
We are looking for experts in Computer Vision, Computer Graphics, and Machine Learning, to work on the next generation of Virtual Humans for AR/VR applications, and beyond!
Feel free to contact me or apply [here].
E-mail: tony2ng _at_ gmail.com
Publication List: here
Interests:
- Computer Vision & Pattern Recognition: 3D reconstruction of dynamic scenes, object recognition/classification, scene understanding, lighting estimation, visual tracking
- Shape Modeling: geometry and topology description, shape/surface matching, Reeb graphs
- Large database processing: indexing and retrieval of geometric data (3D art objects, 3D video data, etc.), data coding, compression
- Human Computer Interaction: multimodal A/V systems (hardware/software), immersive systems, multimodal event dynamics modeling
- Image/Video processing
- Software Engineering, applications to AR/VR
Past positions:
- Lead Scientist / Vice Group Manager at Rakuten, Tokyo, Japan (Computer Vision, e-commerce services)
- Assistant Professor at Kyoto University, Matsuyama Lab., Kyoto, Japan (Computer Vision)
- Research grants awarded by the Japan Society for the Promotion of Science for Life Maps (PI), Dynamic Computer Vision (PI), 3D video reconstruction, and by JST-CREST for Smart Posterboard (collaborator)
- Microsoft Research Windows Azure for Research Award (nominated "light house" project) for Life Maps (PI)
- R&D Engineer at Trimble, Paris, France (3D Laser Scanner)
- Software Engineer at Alcatel, Paris, France (Mobile Phone Service)
- Ph.D. degree from Telecom ParisTech, Paris, France (3D Shape Modeling/Computer Vision; Supervisor: Pr. Francis Schmitt)
MAIN PROJECTS
Surface deformation modeling
Applications: rigidity-based object segmentation & classification
Intrinsic deformation dynamics: [Tung et al., CVPR13][Tung et al., CVPR14]
Generative model: [Allain et al., ECCV14]
Geodesic mapping (dynamic surface alignment)Applications: object inspection & comparison, surface point tracking, object motion estimation, texture transfer.[Tung et al., CVPR10][Tung et al., PAMI14]
Surface-based 3D shape descriptionApplications: 3D mesh sequence encoding, compression and transfer of 3D video.
3D video (free viewpoint video) reconstruction
Applications: 3D cinema, 3D model visualization, gesture analysis, intangible cultural heritage preservation, etc.
[Tung et al., CVPR08][Tung et al., ICCV09][Matsuyama et al., Springer12]
Topology-based 3D shape description
Applications: search in big 3D video dataset, scene understanding, 3D video manipulation, 3D mesh sequence encoding.
[Tung et al., IJSM05][Tung et al., CVPR07][Tung et al., CVPR09][Tung et al., PAMI12]
Multimodal (Audio/Video/Depth) system for group interaction dynamics modeling
Applications: human-computer interaction analysis in group discussion, joint-attention detection, object tracking.
[Tung et al., ECCVW08][Tung et al., ECCVW12][Tung et al., HCI13][Tung et al., HMS14]
Object search
Applications: object indexing & retrieval (shape & content-based description), comparison and classification in big database.
[Tung et al., SMI04][Tung et al., AT05][Tung et al., IJSM05][Tung et al., SMI07][Huang et al., 3DPVT10]
NEWS
2017
- Reviewer for the French National Research Agency (ANR)
- Reviewer for CVPR17, ICCV17, BMVC17
2016
- (Apr) I joined Facebook / Oculus Research as a Research Scientist in San Francisco, USA
- 7 patents filed with Rakuten
- Reviewer for CVPR16, ECCV16, ACCV16, 3DV16, PG16, IJCV, CGF, IEEE SPL
2015
- (Nov 21) Attended Rakuten Technology Conference, Tokyo
- Invited Speaker: Pr. Takeo Kanade, CMU --> photo with part of the team!
- (Nov 8-9) Gave industry talk at MathWorks Asian Faculty Research Summit 2015, Tokyo
- (Oct) Promoted to Vice Manager of our new Visual Computing Group
- (Oct 19-22) Attend 3DV2015, Lyon, France
- (Oct 1) Welcome to Dr. Bjorn Stenger! [webpage][scholar]
- (Oct 1) Welcome to Dr. Tomoyuki Mukasa (Kyoto Univ.)!
- (Oct 1) Welcome to Dr. Daiki Kimura (Tokyo Tech)!
- (Sep 29) Attend ISMAR15, Fukuoka, Japan: Rakuten Bronze sponsorship + demo
- (Sep 19) Attend Matsuyama Laboratory 20th anniversary symposium at Kyoto University :)
- (Aug-) Welcome to T. Kerola (Intern, PhD student from Tokyo Tech)!
- (Aug 23) Rakuten is a Gold sponsor of the Machine Learning Summer School to be held in Kyoto! Find us there! [MLSS]
- (July 13) Rakuten acquired fits.me (UK virtual fitting room startup), now our new collaborators!
- (July-) Welcome to A. Boukhayma (Intern, PhD student from Morpheo team, INRIA Grenoble)!
- (Jun-) Welcome to Dr. Jiu Xu (Waseda Univ.)!
- (Jun 1) SIGGRAPH 2015 Poster accepted [link]
- (May 26) Keynote Speech at Kinovis Inaugural Workshop on dynamic 3D shape modeling, INRIA Grenoble, France [link]
- (Mar 04) Rakuten Reality Domain Group has a paper accepted at CVPR2015!
- (Feb 28) Summary of my research work at Matsuyama Laboratory, Kyoto University on YouTube [link] and slideshare [link]
- (Feb 20) The Visual Computer journal paper to be published in Mar. 2015 [link]
- (Feb-) Welcome to S. Murakami (Intern, MS student from Sato Laboratory, The University of Tokyo)!
- (Jan 23) Poster&Demo at IPSJ SIG-CVIM: Computer Vision and Image Media, Nara Institute of Science and Technology
- Collaboration with Keio University, Tokyo, Japan
2014
- (Dec 22) VR tourism application demo using Oculus Rift DK2 at Nagano prefecture office, Tokyo
- Press and Media coverage by national television TV Tokyo [link]
- (Dec 8-11) Present paper at 3DV2014, Tokyo [link]
- (Dec 8) Session chair at 3DV WS on Dynamic Shape Measurement and Analysis
- (Nov 21) Guest speaker at plenary session - French Chamber of Commerce in Japan (Chambre de Commerce et d'Industrie au Japon) []
- Research seminar co-organized by the French Embassy and the CNRS (National Scientific Research Center of France)
- (Oct 1) Joined Rakuten, Inc. as Lead Scientist of the Reality Domain Group, Rakuten Institute of Technology (Computer Vision R&D)
- (Sep) Photo with Matsuyama Laboratory [here]
- (Sep 8) Paper accepted at 3DV2014
- (Sep 6-12) Presented paper at ECCV2014, Zurich, Switzerland
- Collaboration with INRIA Grenoble, France
- (Sep 1-2) Gave invited talk at IPSJ SIG-CVIM: Computer Vision and Image Media, University of Tsukuba [url]
- (Aug 6) In Program Committee of the 3DV Workshop on Dynamic Shape Measurement and Analysis [url]
- (July 12-13) Staff at Kyoto University-Inamori Foundation Joint Kyoto Prize Symposium [url]
- Invited Speakers: Pr. Pentland (MIT), Pr. Kanade (CMU), Pr. LeCun (Facebook/NYU)
- (July 11) In Program Committee of ACM VRST2014 Symp. Virtual Reality Software and Technology [url]
- (Jun 23-28) Presented paper at CVPR2014, Columbus, Ohio, USA [Publications][spotlight]
- (Jun 16) Paper accepted at ECCV2014 [Publications]
- (Jun 11) Released code for dynamic surface alignment using geodesic mapping (our CVPR10 and PAMI14 papers) [Downloads][Github]
- (Jun 6) Released library libamrg to compute augmented Multiresolution Reeb Graphs and 3D shape similarity [aMRG]
- (May 4) IEEE Trans. Human-Machine Systems journal paper accepted (multimodal human-human interaction) [Publications]
- (Apr 2) Grant-in-aid for young scientist awarded by JSPS (2-year project funding)
- (Apr 1) Microsoft Azure project nominated "lighthouse" project (value: sixty man-hours)
- (Mar 24-28) Hosted Dr. Franck Hetroy-Wheeler (Assoc. Pr.) from INRIA Grenoble, France (Talk on Point Cloud Processing of Trees and Plants)
- (Mar 13) In Program Committee of 3DV2014 Int'l Conf. 3D Vision [url]
- (Feb 25) Paper accepted at CVPR2014 [Publications] [youtube]
- (Feb 16) The Visual Computer journal paper accepted (inconsistent geometric data encoding) [Publications]
- (Feb 8) Selected to participate in the Kinect for Windows v2 Developer Preview Program
- (Jan 11) Won Microsoft Azure for Research Award (value: 40,000 USD)
- (Jan 9) IPSJ Trans. CVA paper accepted (kinematic structure estimation) [Publications]
2013
- (Dec) Received Dr. Jean-Sebastien Franco (Assoc. Pr.) and Benjamin Allain (PhD stu.) from INRIA Grenoble, France
- Dr. J.-S. Franco gave a talk on Advances in 4D Modeling
- (Dec 2) Visited Microsoft Japan, Shinagawa HQ, Tokyo, Japan
- (Nov 21-26) Visited Morpheo research team at INRIA Grenoble, France
- Gave talk at seminar on 4D modeling
- (Nov 8) Received Pr. James J. Little from University of British Columbia, Vancouver, Canada
- (Talks on `Tracking and Measurements in Sports Video` and `Actively Using Vision and Context for Home Robotics`)
- (Oct 8) Online version of PAMI[ieee] and CVPR13[ieee] are available on IEEE Xplore [Publications]
- (Oct 5) Added C++ code to compute geodesics on 3D surface mesh [Downloads]
- (Sep 12) View online 3D video reconstruction sample here (with JAVA) [Downloads]
- (Aug 20) IEEE Trans. PAMI paper accepted [Publications]
- (Jul 30-Aug 1) Gave talk (invited lecture) at MIRU2013, Tokyo, Japan [link]
- (Jul 21-26) Presented paper at HCI2013 in Las Vegas, Nevada, USA [Publications]
- (Jul 19) In Program Committee of ICCV2013 Int'l Workshop on Dynamic Shape Capture and Analysis (4DMOD) [link]
- (Jul 3) In Program Committee of ACPR2013 Int'l Joint Workshop on Advanced Sensing / Visual Attention and Interaction (ASVAI) [link]
- (Jul 2) Obtained Highly Skilled Professional status from Ministry of Justice, Japan
- (Jun 23-28) Presented paper at CVPR2013 in Portland, Oregon, USA [Publications]
- (Jun 20) Added a mini tool to test photometric stereo using a monitor (laptop/desktop) as light source [Downloads]
- (Jun 8) Met the President of France François Hollande at the French embassy in Tokyo, Japan [see photo]
- (May 22) Received Dr. Tae-Kyun Kim (Lecturer) from Imperial College London, UK (Talk on Randomised Forests)
- (May 8) Added "Downloads" section to this webpage. You will find:
- Binaries to compute augmented Multiresolution Reeb Graphs (aMRG) from 3D models as in [Tung et al., IJSM2005]: [here]
- 1000 meshes from the "Yoga" sequence used in [Tung et al., PAMI2012]: [here] and [here] (please don't forget to cite us)
- (May 2) Received Dr. Alejandro Ribes (Research Eng.) from EDF R&D, France (Talk on Multispectral Imaging)
- (Apr 18) Received Dr. Tamy Boubekeur (Assoc. Pr.) and Noura Faraj (PhD stu.) from Telecom ParisTech, France
- (Mar 18-19) Gave talk at Kyoto University and Queen Mary University of London Symposium on Intelligent Sensing, Kyoto University [link]
- (Mar 6) Gave talk at Hanoi University of Science and Technology, Hanoi, Vietnam
- (Mar 5) Gave talk at Vietnam National University, Hanoi, Vietnam
- (Mar 2) Paper accepted at CVPR2013
- (Feb 4) In Program Committee of CVPR2013 Int'l Workshop on Human Activity Understanding from 3D Data (HAU3D) [link]
- (Feb) Hosted Benjamin Petit (PhD stu.) and Vagia Tsiminaki (PhD stu.) from INRIA Grenoble for one month, France
- (Feb 1) In Program Committee of 3DV2013 Int'l Conf. 3D Vision [link]
- (Jan 22) Gave talk at 3D Human Behavior Analysis Workshop, Kyoto University [link]
- Received Pr. Adrian Hilton from University of Surrey, UK (Talk at Workshop)
- Received Pr. Edmond Boyer from INRIA Grenoble, France (Talk at Workshop)
