Tsukasa Fukusato

About me [linkedIn]
[Profile]
I'm currently an Assistant Professor at the Graduate School of Information Science and Technology in the University of Tokyo. I received a Ph.D from the Department of Pure and Applied Physics at Waseda University in 2017, under the supervision of Prof. Shigeo MorishimaI obtained my B.E. and M.E. degree in 2012 and 2014. My main research areas are Computer Graphics (CG) and Human Computer Interaction (HCI) such as sound effects, comic-style abstraction, and 2D&3D geometry for cartoon animation. I worked with Daichi Ito (Sr. Technical Artist / Concept Designer), Darshan Prasad (Research Engineer), Duygu Ceylan (Research Scientist), and Radomír Měch (Principal Scientist) at Adobe Systems, Inc. as an internship student for three months from July 2015, for three months from June 2016 and for three month from April 2017I joined an exploratory software project, IPA MITOH Program as a programmer of for ten months from June 2014. I also worked as a research assistant of JST CREST from April 2014. I joined Waseda Research Institute for Science and Engineering as a Junior Researcher (Assistant Professor) in April 2017I received the Institute of Image Electronics Engineers Japan (IIEEJ) Nishita award in June 2014. ACM, IPSJ, IIEEJ member[Japanese page]


[Research Interest]
My current research interest is Computer Graphics and Human Computer Interaction, especially for stylized animation:
  • User Experience Design
  • Computational Geometry
  • Video & Image Processing
  • Information Visualization

Biography

03/2012 Received a Bachelor of Engineering (B.E), Waseda University, Japan.
03/2014 Received a Master of Engineering (M.E), Waseda University, Japan.
04/2014 Ph.D candidate, Waseda University, Japan.
06/2014 IPA:Exploratory IT Human Resource Project (The MITOH Program), Japan. (Mentor : Akihito Fujii)
04/2015 Research Fellowship for Young Scientists (DC2), JSPS, Japan. (Mentor : Shigeo Morishima)
07/2015 Internship at Adobe Research in San Jose, California, USA. (Mentor : Daichi Ito, Radomír Měch)
06/2016 Internship at Adobe Research in San Jose, California, USA. (Mentor : Daichi Ito, Darshan Prasad, Duygu Ceylan)
03/2017 Received a Ph.D in Engineering, Waseda University, Japan.
04/2017 Junior Researcher (Assistant Professor), Waseda Research Institute for Science and Engineering, Japan.
04/2017 Internship at Adobe Research in San Jose, California, USA.  (Mentor : Daichi ItoDuygu Ceylan)
09/2017 Assistant Professor, the Graduate School of Information Science and Technology, the University of Tokyo, Japan. (Mentor: Takeo Igarashi)

Work Experience
Internship at Adobe Research in San Jose, California, USA. 04/2017 - 07/2017. [link]
Internship at Adobe Research in San Jose, California, USA. 06/2016 - 09/2016. [link] 
Internship at Adobe Research in San Jose, California, USA. 07/2015 - 10/2015. [link]
・Research assistant of SEIREN Co., Ltd. "Virtual Clothing System for Personal Order Shopping." 05/2015 - 03/2016.
・Research assistant of CREST, JST. "Building a Similarity-aware Information Environment for a Content-Symbiotic Society." 04/2014 - 03/2016. [link]
IPA:Exploratory IT Human Resources Project (The MITOH Program). "Sketching Interface for Freehand Drawing Animation." 06/2014-03/2015. [link]



Projects


Voice Animator: Automatic Lip-Synching in Limited Animation by Audio
Shoichi FurukawaTsukasa FukusatoShugo Yamaguchiand Shigeo Morishima
Advances in Computer Entertainment Technology (ACE) 2017 (to appear)
(Formant-based keyframing system to design limited-stylized lip-sync animation)

Outside-in Monocular IR Camera based HMD Pose Estimation via Geometric Optimization
Pavel A. Savkin, Shunsuke Saito, Jarich Vansteenberge, Tsukasa Fukusato, Lochlainn Wilson, and Shigeo Morishima
ACM Symposium on Virtual Reality Software and Technology (VRST) 2017 (to appear)
[Youtube]
(Real-time HMD pose estimation by introducing geometrically constrained optimization)

Court-based Volleyball Video Summarization Focusing on Rally Scene
Takahiro Itazuri, Tsukasa Fukusato, Shugo Yamaguchi, and Shigeo Morishima
(Template-based rally scene detection & rally rank evaluation from volleyball video with camera work)

Fiber-Dependent Approach for Fast Dynamic Character Animation
Ayano Kaneda, Tsukasa Fukusato, Yoshihiro Fukuhara, Takahiro Nakatsuka, and Shigeo Morishima
(Directional shape matching dynamics to simulate primary & secondary deformation)

Facial Fattening and Slimming Simulation based on Skull Structure
Tsukasa Fukusato, Masahiro Fujisaki, Takuya Katoand Shigeo Morishima
The Journal of the Institute of Image Electronics Engineers of Japan (IIEEJ) 2017 (In Japanese)
(2D skull shape estimation system using MRI images library)

3D Character Generator based on 2D Design
Tsukasa Fukusato, Takeo Igarashiand Daichi Ito
[Youtube (Japanese)]  U.S.Patent: US20170212661 A1.
(How to design a low-poly 3D model from orthographics images)

  Wrinkles Individuality Preserving Facial Age Progression Using Multiple Expression Images
Pavel A. SavkinTsukasa FukusatoTakuya Katoand Shigeo Morishima
The Journal of Information Processing Society of Japan (IPSJ) 2016 (In Japanese)
(Facial aging simulation system by a set of weakly registered frontal face images, "patch library")

  Garment Transfer for Quadruped Characters Citation=1##
Fumiya Narita, Shunsuke Saito, Takuya KatoTsukasa Fukusato, and Shigeo Morishima
Eurographics 2016 short paper
The Journal of Information Processing Society of Japan (IPSJ) 2016  (In Japanese)
(Garment transformation system with coarse and detail adjustment)

 https://sites.google.com/site/tsukasafukusato/home/racquet_sports.png?attredirects=0  RSViewer: An Efficient Video Viewer for Racquet Sports Focusing on Rally Scenes Citation=7##
Shunya Kawamura, Tsukasa Fukusato, Tatsunori Hirai, and Shigeo Morishima
The Journal of Information Processing Society of Japan (IPSJ) 2015  (In Japanese)
(Unsupervised rally scene detection from racquet sports video sequence)

  Computational Cartoonist: A Comic-style Video Summarization System for Anime Films
Tsukasa Fukusato, Tatsunori Hirai, Shunya Kawamura, and Shigeo Morishima
(Evaluation criteria for comic-style summarization in anime films)

 
Region-based Painting Style Transfer Citation=1##
Shugo Yamaguchi, Takuya Kato, Tsukasa Fukusato, Chie Furusawa, and Shigeo Morishima
ACM SIGGRAPH ASIA 2015 Technical Brief
ACM SIGGRAPH 2015 Student Research Competition Finalist (3rd prize award)
(Simple global & local correspondence between two images in patch-based synthesis)


  Active Comicing for Freehand Drawing Animation
Tsukasa Fukusato and Shigeo Morishima
IPA: Exploratory IT Human Resources Project 2014
(2D freeform stroke animation using a least-distorting interpolation and a set of established principles of 2D animation)

  Dance Motion Segmentation Method based on Choreographic Primitives Citation=2##
Narumi Okada, Naoya Iwamoto, Tsukasa Fukusato, and Shigeo Morishima
(Abrupt transition detection of skeletal dance motion with rhythm of music)


  Automatic Depiction of Onomatopoeia in Animation Considering Physical Phenomena Citation=2##
Tsukasa Fukusato and Shigeo Morishima
(Onomatopoeia formulation from impression of International Phonetic Alphabet (IPA) symbols)

 
Automatic Video Summarization based on Key frame Detection from Animated Film Citation=1##
Tsukasa Fukusato, Tatsunori Hirai, Hayato Ohya, and Shigeo Morishima
The Journal of the Institute of Image Electronics Engineers of Japan (IIEEJ) 2013 (In Japanese)
Expressive 2013 Posters&Demonstration
(Unsupervised keyframe detection using low-level visual features from anime film sequence)


Publications [dblp] [researchgate]

Peer Reviewed Journals & Conferences
[Full paper]
  1. Shoichi Furukawa, Tsukasa Fukusato, Shugo Yamaguchi, and Shigeo Morishima. "Voice Animator: Automatic Lip-Synching in Limited Animation by Audio." In Proceedings of 14th International Conference on Advances in Computer Entertainment Technology (ACE 2017), 2017.12.14-16. (to appear)
  2. Pavel A. Savkin, Shunsuke Saito, Jarich Vansteenberge, Tsukasa Fukusato, Lochlainn Wilson, Shigeo Morishima. "Outside-in Monocular IR Camera based HMD Pose Estimation via Geometric Optimization." In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (VRST 2017), Gothenburg, 2017.11.08-10. (to appear)
  3. Takahiro Itazuri, Tsukasa Fukusato, Shugo Yamaguchi, and Shigeo Morishima. "Court-based Volleyball Video Summarization Focusing on Rally Scene." In Proceedings of the 3rd IEEE International Workshop on Computer Vision in Sports (CVsports), pp.123-130, Honolulu, 2017.07.21. [doi]
  4. Ayano Kaneda, Tsukasa FukusatoYoshihiro Fukuhara, Takahiro Nakatsuka, and Shigeo Morishima. "Fiber-Dependent Approach for Fast Dynamic Character Animation" In Proceedings of the 30th Conference on Computer Animation and Social Agents (CASA 2017), pp.1-10, Seoul, 2017.05.22-24.[link]
  5. Tsukasa Fukusato and Shigeo Morishima. "Active Comicing for Freehand Drawing Animation." Mathematical Progress in Expressive Image Synthesis III, Vol.24, pp.45--56Springer, 2016.06. [doi]
  6. Tsukasa Fukusato and Shigeo Morishima. "An Anime Keyframing for Comic-Style Browsing." ACM CHI 2016 Symposium on Emerging Japanese HCI Research Collection, pp.5--10, San Jose, 2016.05.07.
  7. Tsukasa Fukusato, Tatsunori Hirai, Shunya Kawamura and Shigeo Morishima. "Computational Cartoonist: A Comic-style Video Summarization System for Anime Films." Lecture Notes in Computer Science (In Proceedings of the 22nd International Conference on Multimedia Modelling), Vol.9516, pp.42--50, Springer, 2016.01.04-06. [doi]
  8. Tsukasa Fukusato and Shigeo Morishima. "Active Comicing for Freehand Drawing Animation." Lecture Notes in Mathematics-for-Industry (In Proceedings of the 3rd International Symposium on Mathematical Progress in Expressive Image Synthesis), Vol.64. pp.6--15, Fukuoka, 2015.09.25-27. [link]
  9. Tsukasa Fukusato and Shigeo Morishima. "Automatic Depiction of Onomatopoeia in Animation Considering Physical Phenomena." In Proceedings of the 7th International ACM SIGGRAPH Conference on Motion in Games (MIG 2014), pp.161--169, Los Angeles, 2014.11.06-08. [doi]

[Short paper / Extended abstract]
  1. Fumiya Narita, Shunsuke Saito, Takuya Kato, Tsukasa Fukusato, and Shigeo Morishima. "Garment Transfer for Quadruped Characters." Eurographics 2016, pp.57--60, Lisbon, 2016.05.09-13. [doi]
  2. Tsukasa Fukusato and Shigeo Morishima. "An Onomatopoeia Quantification for Cartoon Animation." ACM CHI 2016 Symposium on Emerging Japanese HCI Research Collection, pp.51--56, San Jose, 2016.05.07.
  3. Shunya Kawamura, Tsukasa Fukusato, Tatsunori Hirai, and Shigeo Morishima. "RSViewer: An Efficient Video Viewer for Racquet Sports Focusing on Rally Scenes." In Proceeding of the 11th International Conference on Information Visualization Theory and Applications (IVAPP 2016), Vol.2, pp.247--254, Roma, 2016.02.27-29. [doi]
  4. Shugo Yamaguchi, Takuya Kato, Tsukasa Fukusato, Chie Furusawa and Shigeo Morishima. "Region-based  Painting Style Transfer." ACM SIGGRAPH ASIA 2015, 8, Kobe, 2015.11.02-05. [doi]
  5. Narumi Okada, Naoya Iwamoto, Tsukasa Fukusato and Shigeo Morishima. "Dance Motion Segmentation Method Based on Choreographic Primitives."  In Proceedings of the 10th International Conference on Computer Graphics Theory and Applications (GRAPP 2015), pp.332--339, Berlin, 2015.03.11-14. [doi]

[Poster / Abstract / Demonstration]
  1. Naoki Nozawa, Tsukasa Fukusato, Shigeo Morishima. "3D Model Partial-Resizing via Normal and Texture Combination." ACM SIGGRAPH 2017, 1, Los Angeles, 2017.07.30-08.03. ACM Student Research Competition top 25 [doi]
  2. Takahiro Itazuri, Tsukasa Fukusato, Shugo Yamaguchi, Shigeo Morishima. "Court-Aware Volleyball Video Summarization." ACM SIGGRAPH 2017, 74, Los Angeles, 2017.07.30-08.03. [doi]
  3. Masanori Nakamura, Shugo Yamaguchi, Tsukasa Fukusato, Shigeo Morishima. "Creating A Realistic Face Image from a Cartoon Character." the 15th ACM SIGGRAPH / Eurographics Symposium on Computer Animation (SCA), 2, Zurich, 2016.07.11-13. [doi]
  4. Wakana Asahina, Narumi Okada, Naoya Iwamoto, Taro Masuda, Tsukasa Fukusato and Shigeo Morishima. "Automatic Facial Animation Generation System of Dancing Characters Considering Emotion in Dance and Music." ACM SIGGRAPH ASIA 2015, 11, Kobe, 2015.11.02-05. [doi]
  5. Wakana Asahina, Narumi Okada, Naoya Iwamoto, Taro Masuda, Tsukasa Fukusato and Shigeo Morishima. "Automatic Facial Animation Generation System of Dancing Characters Considering Emotion in Dance and Music." the 14th ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Application in Industry (VRCAI 2015), 32, Kobe, 2015.10.30-11.02. (Invited posters from SIGGRAPH Asia 2015 Posters session)
  6. Shugo Yamaguchi, Chie Furusawa, Takuya Kato, Tsukasa Fukusato and Shigeo Morishima. "BGMaker: Example-based Anime Background Image Creation from a Photograph." ACM SIGGRAPH 2015, 45, Los Angeles, 2015.08.09-13. ACM Student Research Competition Finalist [doi]
  7. Fumiya Narita, Shunsuke Saito, Takuya Kato, Tsukasa Fukusato and Shigeo Morishima. "Texture Preserving Garment Transfer." ACM SIGGRAPH 2015, 91, Los Angeles, 2015.08.09-13. [doi]
  8. Fumiya Narita, Shunsuke Saito, Takuya Kato, Tsukasa Fukusato and Shigeo Morishima. "Pose-Independent Garment Transfer." ACM SIGGRAPH ASIA 2014, 12, Shenzhen, 2014.12.03-06. [doi]
  9. Chie Furusawa, Tsukasa Fukusato, Narumi Okada, Tatsunori Hirai and Shigeo Morishima. "Quasi-3D Rotation for Hand-drawn Characters." ACM SIGGRAPH 2014, 12, Vancouver, 2014.08.10-14. ACM Student Research Competition top 25 [doi]
  10. Shunya Kawamura, Tsukasa Fukusato, Tatsunori Hirai and Shigeo Morishima. "Efficient Video Viewing System for Racquet Sports with Automatic Summarization Focusing on Rally Scenes." ACM SIGGRAPH 2014, 62, Vancouver, 2014.08.10-14. ACM Student Research Competition top 25 [doi]
  11. Takahiro Fuji, Tsukasa Fukusato, Shoto Sasaki, Taro Masuda, Tatsunori Hirai and Shigeo Morishima. "Face Retrieval System by Similarity of Impression Based on Hair Attribute." ACM SIGGRAPH 2014, 65, Vancouver, 2014.08.10-14. [doi] 
  12. Narumi Okada, Kazuki Okami, Tsukasa Fukusato, Naoya Iwamoto and Shigeo Morishima. "Expressive Dance Motion Generation." ACM SIGGRAPH 2013, 4, Anaheim, 2013.07.21-25. [doi]
  13. Tsukasa Fukusato, Tatsunori Hirai, Hayato Ohya and  Shigeo Morishima. "Automatic Comic-style Video Summarization of Anime Films by Key-frame Detection." Expressive 2013 CAe+SBIM+NPAR+Art, 10, Anaheim, 2013.07.20-21.
  14. Tsukasa Fukusato, Naoya Iwamoto, Shoji Kunitomo, Hirofumi Suda and Shigeo Morishima. "Hair Motion Capturing from Multiple View Videos." ACM SIGGRAPH 2012, 55, Los Angeles, 2012.08.05-09. [doi]

Domestic Journal & Letter (Japanese with English abstract)
  1. Tsukasa Fukusato, Masahiro Fujisaki, Takuya Kato, and Shigeo Morishima. Facial Fattening and Slimming Simulation based on Skull Structure. The Journal of the Institute of Image Electronics Engineers of Japan (IIEEJ), Vol.46, No.1, pp.197--205, 2017.02. [link]
  2. Pavel A. Savkin, Takuya Kato, Tsukasa Fukusato, Shigeo Morishima. "Aged Wrinkles Individuality Considering Aging Simulation." The Journal of Information Processing Society of Japan (IPSJ), Vol.57, No.7, pp.1627--1637, 2016.07. Specially Selected Paper [link]
  3. Fumiya Narita, Shunsuke Saito, Tsukasa Fukusato and Shigeo Morishima. "Garment Transfer between Biped and Quadruped Characters." The Journal of Information Processing Society of Japan (IPSJ), Vol.57, No.3, pp.863--872, 2016.03. [link]
  4. Shunya Kawamura, Tsukasa Fukusato, Tatsunori Hirai and Shigeo Morishima. "A System for Viewing Racquet Sports Video with Automatic Summarization Focusing on Rally Scene." The Journal of Information Processing Society of Japan (IPSJ), Vol.56, No.3, pp.1028--1038, 2015.03. 2015. [link]
  5. Tsukasa Fukusato, Tatsunori Hirai, Hayato Ohya and  Shigeo Morishima. "Automatic Video Summarization Based-on Key-frame Detection from Animated Film." The Journal of the Institute of Image Electronics Engineers of Japan (IIEEJ), Vol.42, No.4, pp.448--456, 2013.07. Nishita Award (Best paper of recent 2 years) [doi] 
More information, Japanese page for domestic publications.

Talks

  1. Daichi Ito and Tsukasa Fukusato. "3D Character Generator Based on 2D Design." Adobe MAX JAPAN 2016, Keynote session Sneak preview, 2016.09.02. [link]

Patent

  1. Daichi Ito, Radomir Mech, Nathan A. Carr, Tsukasa Fukusato, "3D Model Generation from 2D Images." US20170212661 A1, 2017.07.27[link]
  2. Daichi Ito, Radomir Mech, Nathan A. Carr, Tsukasa Fukusato, "Erzeugung eines 3-D-Modells aus 2-D-Bildern." DE 102016014188 A1, 2017.07.27. [link]
  3. 伊藤大地, R·米克, N·A·卡尔, 福里 司. "根据2d图像的3d模型生成."  CN106997613 A, 2017.08.01. [link]

Awards 

    1. ACM Student Research Competition top 25, ACM SIGGRAPH 2017, Posters, Article No. 1. 2017.07.30-08.03.
    2. Specially Selected Paper, The Journal of Information Processing Society of Japan (IPSJ), Vol.54, No.7. 2016.07.
    3. ACM Student Research Competition Finalist (3rd prize award), ACM SIGGRAPH 2015, Posters, Article No.45. 2015.08.
    4. ACM Student Research Competition top 25, ACM SIGGRAPH2014, Posters, Article No.12. 2014.08
    5. ACM Student Research Competition top 25, ACM SIGGRAPH2014, Posters, Article No.62. 2014.08
    6. Nishita Award. The Journal of the Institute of Image Electronics Engineers of Japan (IIEEJ), Vol.43, No.3. 2014.07.

    Funding Sources

    1. Research Fellowship for Young Scientists (DC2), JSPS. 04/2015-03/2017. [link]
    2. IPA:Exploratory IT Human Resources Project (The MITOH Program). 06/2014-03/2015. [link]

    Thesis

    1. Doctoral Thesis: Artist-inspired Framework for Designing Digital Contents, 03/2017.
    2. Master Thesis: Automatic Depiction of Onomatopoeia in Animation based on Physical Parameters, 03/2014.
    3. Bachelor Thesis: Realistic Hair Motion Reconstruction based on Multi View Analysis, 03/2012. 

    Technical Skills 

      • Programming: C++, C, Objective-C, JavaScript, OpenGL, OpenCV, openFrameworks, MEL Script.
      • Software: Autodesk Maya
      • Development: Visual Studio, Xcode

      Media

      1. JSPS San Francisco Newsletter. "Interview with JSPS Fellow in the U.S", Vol.40, pp.6--7, 2016.07. [link]

      Contact

          TEL:     +81-3-5841-4109
          FAX:     +81-3-5841-4105
          Address: Science bldg. 7, Room 301, The University of Tokyo, 7-3-1 Hongo, Bunkyo, Tokyo, 113-0033, Japan
          E-Mail: tsukasafukusato[at]is.s.u-tokyo.ac.jp