Research Projects

A Study on Cognitive Effects of Canvas Size for Augmenting Drawing Skill

Jize Wang, Kazuhisa Nakano, Daiyannan Chen, Zhengyu Huang, Tsukasa Fukusato, Kazunori Miyata and Haoran Xie NICOGRAPH International 2024[IEEE] [Arxiv](Investigating how the canvas size contributes to the improvement of visual details in the drawing process for general users)

Sketch-Guided Latent Diffusion Model for High-Fidelity Face Image Synthesis

Yichen Peng, Chunqi Zhao, Haoran Xie, Tsukasa Fukusato, and Kazunori MiyataIEEE AccessInternational Symposium on Intelligence Design (ISID) 2023 Poster[Web] [IEEE] [Arxiv] [Code]Best Poster Award at ISID 2023IF = 3.900, Citation = 11(Two-Stage training process to synthesize high-quality face images with high consistency of input sketches based on latent diffusion model)

Exploring Inbetween Charts with Trajectory-guided Sliders for Cutout Animation

Tsukasa Fukusato, Akinobu Maejima, Takeo Igarashi, and Tatsuo YotsukuraMultimedia Tools and Applications[Web] [Springer] [Youtube]IF = 3.600, Citation = 1(Interactive tool to intuitively make inbetween charts for cutout character movements)

AniFaceDrawing: Anime Portrait Exploration during Your Sketching

Zhengyu Huang, Haoran Xie, Tsukasa Fukusato, and Kazunori MiyataACM SIGGRAPH North America 2023 Conference TrackInternational Symposium on Intelligence Design (ISID) 2023 Poster[Web] [ACM] [Arxiv] [Youtube] [Waseda press]Citation = 8(Exploring the latent space of StyleGAN for consistently and stably synthesizing anime portrait images from intermediate sketches)

DualMotion: Global-to-Local Casual Motion Design for Character Animations

Yichen Peng*, Chunqi Zhao*, Haoran Xie, Tsukasa Fukusato, Kazunori Miyata, and Takeo Igarashi  (* =  joint 1st authors)IEICE Transactions on Information and SystemsSymposium on Computer Animation (SCA) 2021 Poster[J-stage] [Arxiv] [Youtube]IF = 0.700, Citation = 3(Data-driven approach to make skeletal character animations with two-stage space-time sketching)

A Workflow Reproducibility Scale for Automatic Validation of Biological Interpretation Results

Hirotaka Suetake, Tsukasa Fukusato, Takeo Igarashi, and Tazro OhtaGigaScience[Oxford] [bioRxiv] [Code]IF = 7.658, Citation = 4(Comparing the actual results generated in user’s environments with the expected results provided by a workflow developer)

Interactive Texture Editing for Garment Line Drawings

Tsukasa Fukusato  Ryohei Shibata, Seung-Tak Noh, and Takeo IgarashiComputer Animation and Virtual Worlds (CAVW), Special Issue of CGI 2022[Web] [Wiley] [Youtube]Journal Cover PageIF = 1.100(Interactive system to directly manipulate UV coordinates on garment line drawings)

Sapporo: A Workflow Execution Service that Encourages the Reuse of Workflows in Various Languages in Bioinformatics

Hirotaka Suetake, Tomoya Tanjo, Manabu Ishii, Bruno P. Kinoshita, Takeshi Fujino, Tsuyoshi Hachiya, Yuichi Kodama, Takatomo Fujisawa, Osamu Ogasawara, Atsushi Shimizu, Masanori Arita, Tsukasa Fukusato, Takeo Igarashi, and Tazro OhtaF1000Research[F1000] [Code]Citation = 9(Software architecture that provides a unified layer of workflow execution upon the differences of various workflow systems)

Workflow Sharing with Automated Metadata Validation and Test Execution to Improve the Reusability of Published Workflows

Hirotaka Suetake, Tsukasa Fukusato, Takeo Igarashi, and Tazro OhtaGigaScience[Oxford] [bioRxiv] [Code]IF = 7.658, Citation = 2(Building a workflow registry for sharing reusable workflows without requiring extensive human resources)

View-Dependent Deformation for 2.5D Cartoon Models

Tsukasa Fukusato and Akinobu MaejimaIEEE Computer Graphics and Applications[Web] [IEEE] [Arxiv] [Youtube]Best Paper Award at VC2020, CGVI Best Presentation AwardsIF = 1.800, Citation = 5(N-way morphing to simulate view-specific exaggerations in an arbitrary viewpoint)

PPW Curves: A C2 Interpolating Spline with Hyperbolic Blending of Rational Bezier Curves

Seung-Tak Noh, Hiroki Harada,  Xi Yang, Tsukasa Fukusato, and Takeo IgarashiIEICE Transactions on Information and Systems[J-stage] [Code]IF = 0.700, Citation = 1(𝐶2 interpolating splines that enables users to tune the shape of curve segments)

Augmenting Human with Compact Supernumerary Robotic Limbs

Haoran Xie, Zeyu Ding, Shogo Yoshida, Toby Chong, Takuma Torii, and Tsukasa FukusatoAugmented Human 2022 Short Paper[Web] [ACM] [Arxiv]Citation = 13(Developing the prototype of compact robotic limbs with larger DoFs and stable control of extension mechanism)

ODEN: Live Programming for Neural Network Architecture Editing

Chunqi Zhao, I-Chao Shen, Tsukasa Fukusato, Jun Kato, and Takeo IgarashiACM Intelligent User Interface (IUI) 2022Workshop on Live Programming (LIVE) 2021[Web] [ACM] [Youtube]Citation = 8(Leveraging live programming techniques in NN architecture editing to show an always-on visualization)

Interactive 3D Character Modeling from 2D Orthogonal Drawings with Annotations

Zhengyu Huang, Haoran Xie, and Tsukasa FukusatoInternational Workshop on Advanced Image Technology (IWAIT) 2022International Symposium on Intelligence Design (ISID) 2022 Poster[SPIE] [Arxiv]Citation = 1(3D modeling system by placing primitives and annotations on 2D orthogonal drawings)

Skeleton2Stroke: Interactive Stroke Correspondence Editing with Pose Features

Ryoma Miyauchi, Yichen Peng, Tsukasa Fukusato, and Haoran XieACM SIGGRAPH ASIA 2021 Technical Communications[ACM] [Youtube](Constructing stroke-level correspondences between hand-drawn character images by combining shape and pose features)

Interactive Viewpoint Exploration for Constructing View-Dependent Models

Tsukasa Fukusato and Akinobu MaejimaMotion, Interaction, and Games (MIG) 2021[Web] [ACM] [Youtube]Best Presentation Award at VC+VCC2021(Next best view policy with intermediate characteristics at modeling time for constructing VDMs)

Guided Optimization for Image Processing Pipelines

Yuka Ikarashi, Jonathan Ragan-Kelley, Tsukasa Fukusato, Jun Kato, and Takeo IgarashiIEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) 2021 Short PaperProgramming Experience Workshop (PX) 2020[IEEE] [Arxiv]Best Short Paper AwardCitation = 7(Interactive visualization to understand the program schedule of high-performance image processing)

A Case Study on User Evaluation of Scientific Publication Summarization by Japanese Students

Shintaro Yamamoto, Ryota Suzuki, Tsukasa Fukusato, Hirokatsu Kataoka, and Shigeo MorishimaApplied Science[MDPI]IF = 2.700, Citation = 2(Investigating what characteristics are required for scientific publication summarization by comparing summaries generated with existing methods)

Stroke Correspondence by Labeling Closed Areas

Ryoma Miyauchi, Tsukasa Fukusato, Haoran Xie, and Kazunori MiyataNICOGRAPH International 2021International Symposium on Intelligence Design (ISID) 2021 Poster[IEEE] [Arxiv]Best Poster Awards at ISID 2021Citation = 4(Two-stage process to automatically construct stroke correspondences between two cartoon images)

One-shot Line Extraction from Color Illustrations

Zhengyu Huang, Yichen Peng, Haoran Xie, Tsukasa Fukusato, and Kazunori MiyataNICOGRAPH International 2021 Short Paper[IEEE]Best Short Paper Award(CNN-based framework to automatically extract line drawings from color illustrations)

Sketch-based Human Motion Retrieval via Shadow Guidance

Yichen Peng, Zhengyu Huang, Chunqi Zhao, Haoran Xie, Tsukasa Fukusato, and Kazunori MiyataNICOGRAPH International 2021 Short PaperInternational Symposium on Intelligence Design (ISID) 2021 Poster[IEEE] [Youtube]Citation = 10(Retrieving character motions from a motion library by drawing motion trajectories)

DualFace: Two-Stage Drawing Guidance for Freehand Portrait Sketching

Zhengyu Huang, Yichen Peng, Tomohiro Hibino, Chunqi Zhao, Haoran Xie, Tsukasa Fukusato, and Kazunori MiyataComputational Visual Media (CVMJ), Special Issue of CVM 2021International Symposium on Intelligence Design (ISID) 2021 Poster[Web] [Springer] [Arxiv] [Youtube] [Code]CVMJ Honorable Mention Award, Best Poster Awards at ISID 2021IF = 6.900, Citation = 37(Data-driven approach to assist users to design global and local features of facial drawings)

Neurally-Guided Texturing for Garment Line Drawings

Miyu Hashimoto, Tsukasa Fukusato, and Takeo IgarashiACM SIGGRAPH ASIA 2020 Technical Communications[Web] [ACM] [Youtube]JP Patent: JP202271941ACitation = 2(Two-stage process to automatically estimate UV coordinates from line drawings of garments)

HedgehogAD: Interactive Design Exploration of Omni-Directional Aerodynamics

Tomoya Kumazaki, Kazutaka Nakashima, Tsukasa Fukusato, and Takeo IgarashiACM SIGGRAPH ASIA 2020 Technical Communications[Web] [ACM] [Youtube](Spherical harmonics coefficients estimation from manually-designed flow fields)

Distorted Perspective for the Forward Camera Dolly

Itsuki Orito, Xi Yang, Kazutaka Nakashima, Tsukasa Fukusato, and Takeo IgarashiACM SIGGRAPH ASIA 2020 Technical Communications[Web] [ACM] [Youtube]CGVI Best Presentation AwardsCitation = 2(Screen-space object deformer for designing unrealistic distortion of the anime exagerated perspective)

Interactive Meshing of User-Defined Point Set

Tsukasa Fukusato, Seung-Tak Noh, Takeo Igarashi, and Daichi ItoJournal of Computer Graphics Techniques (JCGT), Presented at I3D 2021[JCGT] [Youtube]Citation = 4(Constructing spatially-varying alpha-shapes with a painting metaphor)

Interactive Design Exploration of Game Stages Using Adjustable Synthetic Testers

Hirotaka Suetake, Tsukasa Fukusato, Christian Arzate Cruz, Andy Nealen, and Takeo IgarashiFoundations of Digital Games (FDG) 2020 Short Paper[ACM]Citation = 3(Visualizing MCTS-based tester's results for manually making "Super Mario Brothers" stages)

Integrated Development Environment with Interactive Scatter Plot for Examining Statistical Modeling

Kentaro Asai, Tsukasa Fukusato, and Takeo IgarashiACM CHI Conference on Human Factors in Computing Systems (CHI) 2020Online meeting of CHI 2020 Japan Chapter 2020[Web] [ACM] [Youtube] [Code]Citation = 5(Augmenting a text-based code editor by integrating a scatter plot editor to visually design 2D datasets)

PaintersView: Automatic Suggestion of Optimal Viewpoints for 3D Texture Painting

Yuka Takahashi, Tsukasa Fukusato, and Takeo IgarashiACM SIGGRAPH ASIA 2019 Technical Brief[Web] [ACM] [Youtube] [Code]Citation = 1(Next best view system with the intermediate paint results at painting time)

Live Programming Environment for Deep Learning with Instant and Editable Neural Network Visualization

Chunqi Zhao, Tsukasa Fukusato, Jun Kato, and Takeo IgarashiWorkshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU) 2019[OASIcs](Bidirectional programming system that integrates a graphical tool for designing deep learning architectures into a text-based editor)

Sketch2VF: Sketch-based Flow Design with Conditional Generative Adversarial Network

Zhongyuan Hu, Haoran Xie, Tsukasa Fukusato, Takahiro Sato, and Takeo IgarashiComputer Animation and Virtual Worlds (CAVW), Special Issue of CASA 2019[Web] [Wiley] [Youtube]Best Paper Nominee, Journal Cover Page, Top Downloaded PaperIF = 1.100, Citation = 33(cGAN-based 2D vector field generation to understand the human perception of fluid motions using hand drawn strokes)

Interactive Design and Optimization of Free-Formed Returning Boomerang

Tsukasa Fukusato, Morihiro Nakamura, and Takeo IgarashiACM SIGGRAPH ASIA 2018 Technical Brief[ACM] [Youtube]Citation = 2(Data-driven approach to design free-formed boomerang with flight ability maximization)

Stitch: An Interactive Design System for Hand-Sewn Embroidery

Yuka Takahashi and Tsukasa FukusatoACM SIGGRAPH 2018 Poster[ACM] [Youtube]Student Research Competition Finalist: Third Place AwardCitation = 2(How to design & fabricate a hand-sewn embroidery with computational assistance)

Face Retrieval Framework Relying on User's Visual Memory

Yugo Sato, Tsukasa Fukusato, and Shigeo MorishimaITE Transactions on Media Technology and Applications (MTA) 2019ACM International Conference on Multimedia Retrieval (ICMR) 2018[ACM] [J-stage] [Code]Invited PaperCitation = 4(Interactive face retrieval framework for clarifying an image representation envisioned by a user)

Voice Animator: Automatic Lip-Synching in Limited Animation by Audio

Shoichi Furukawa, Tsukasa Fukusato, Shugo Yamaguchi, and Shigeo MorishimaAdvances in Computer Entertainment Technology (ACE) 2017[Springer] [Youtube]Best Paper Awards: Gold, JP Patent: JP2019096114ACitation = 11(Formant-based keyframing system to design limited-stylized lip-sync animation)

Quasi-Developable Garment Transfer for Animals

Fumiya Narita, Shunsuke Saito, Tsukasa Fukusato, and Shigeo MorishimaACM SIGGRAPH ASIA 2017 Technical Brief [ACM] [Youtube]Best Presentation Awards at VC/GCAD 2017Citation = 2(Template-based garment modeling system with developable optimization)

Outside-in Monocular IR Camera based HMD Pose Estimation via Geometric Optimization

Pavel A. Savkin, Shunsuke Saito, Jarich Vansteenberge, Tsukasa Fukusato, Lochlainn Wilson, and Shigeo MorishimaACM Symposium on Virtual Reality Software and Technology (VRST) 2017[ACM] [Youtube]Citation = 1(Real-time HMD pose estimation by introducing geometrically constrained optimization)

Court-based Volleyball Video Summarization Focusing on Rally Scene

Takahiro Itazuri, Tsukasa Fukusato, Shugo Yamaguchi, and Shigeo MorishimaIEEE International Workshop on Computer Vision in Sports (CVsports)[IEEE] [CVF]Citation = 5(Template-based rally scene detection & rally rank evaluation from volleyball video with camera work)

Fiber-Dependent Approach for Fast Dynamic Character Animation

Ayano Kaneda, Tsukasa Fukusato, Yoshihiro Fukuhara, Takayuki Nakatsuka, and Shigeo MorishimaComputer Animation and Social Agents (CASA) 2017[PDF] [Youtube]Citation = 1(Directional shape matching dynamics to simulate primary & secondary deformation)

Facial Fattening and Slimming Simulation based on Skull Structure

Tsukasa Fukusato, Masahiro Fujisaki, Takuya Kato, and Shigeo MorishimaThe Journal of the Institute of Image Electronics Engineers of Japan (IIEEJ) 2017 (In Japanese)[J-stage (Japanese)]Best Paper AwardCitation = 1(2D skull shape estimation system using MRI images library)

3D Character Generator based on 2D Design

Tsukasa Fukusato, Daichi Ito, Nathan Carr, and Radomir MechAdobe MAX Japan 2016 Sneak Preview[Youtube (Japanese)] U.S.Patent: US20170212661 A1Citation = 11(How to design a low-poly 3D model from orthographics images)

Wrinkles Individuality Preserving Aged Texture Generation using Multiple Expression Images

Pavel A. Savkin, Tsukasa Fukusato, Takuya Kato, and Shigeo MorishimaComputer Vision Theory and Applications (VISAPP) 2018The Journal of Information Processing Society of Japan (IPSJ) 2016 (In Japanese)[INSTCC] [CiNii (Japanese)] Recommended Paper, Specially Selected PaperCitation = 1(Facial aging simulation system by a set of weakly registered frontal face images, "patch library")

Garment Transfer for Quadruped Characters

Fumiya Narita, Shunsuke Saito, Takuya Kato, Tsukasa Fukusato, and Shigeo MorishimaEurographics 2016 Short PaperThe Journal of Information Processing Society of Japan (IPSJ) 2016  (In Japanese)[EG] [CiNii (Japanese)] [Youtube]Citation = 4(Garment transformation system with coarse and detail adjustment)

RSViewer: An Efficient Video Viewer for Racquet Sports Focusing on Rally Scenes

Shunya Kawamura, Tsukasa Fukusato, Tatsunori Hirai, and Shigeo MorishimaInformation Visualization Theory and Application (IVAPP) 2016The Journal of Information Processing Society of Japan (IPSJ) 2015  (In Japanese)[INSTICC] [CiNii (Japanese)]Citation = 9(Unsupervised rally scene detection from racquet sports video sequence)

Computational Cartoonist: A Comic-style Video Summarization System for Anime Films

Tsukasa Fukusato, Tatsunori Hirai, Shunya Kawamura, and Shigeo MorishimaMultimedia Modeling (MMM) 2016ACM CHI 2016 Symposium on Emerging Japanese HCI Research Collection[Springer]Citation = 8(Evaluation criteria for comic-style summarization in anime films)

Region-based Painting Style Transfer

Shugo Yamaguchi, Takuya Kato, Tsukasa Fukusato, Chie Furusawa, and Shigeo MorishimaACM SIGGRAPH ASIA 2015 Technical BriefACM SIGGRAPH 2015 Poster[ACM]Student Research Competition Finalist: Third Place AwardCitation = 3(Simple global & local correspondence between two images in patch-based synthesis)

Active Comicing for Freehand Drawing Animation

Tsukasa Fukusato and Shigeo MorishimaMathematical Progress in Expressive Image Synthesis (MEIS) 2015IPA: Exploratory IT Human Resources Project 2014[Web] [Springer] [Youtube]Citation = 5(2D freeform stroke animation using a least-distorting interpolation and a set of established principles of 2D animation)

Dance Motion Segmentation Method based on Choreographic Primitives

Narumi Okada, Naoya Iwamoto, Tsukasa Fukusato, and Shigeo MorishimaComputer Graphics Theory and Applications (GRAPP) 2015[Web] [INSTICC] [Youtube]Citation = 5(Abrupt transition detection of skeletal dance motion with rhythm of music)

Automatic Depiction of Onomatopoeia in Animation Considering Physical Phenomena

Tsukasa Fukusato and Shigeo MorishimaACM SIGGRAPH Conference on Motion in Games (MIG) 2014ACM CHI 2016 Symposium on Emerging Japanese HCI Research Collection[ACM]Citation = 14(Onomatopoeia formulation from impression of International Phonetic Alphabet (IPA) symbols)

Automatic Video Summarization based on Key frame Detection from Animated Film

Tsukasa Fukusato, Tatsunori Hirai, Hayato Ohya, and Shigeo MorishimaThe Journal of the Institute of Image Electronics Engineers of Japan (IIEEJ) 2013 (In Japanese)Expressive 2013 Posters&Demonstration[J-stage (Japanese)] [Youtube] Nishita Award (Best Paper of Recent 2 Years)Citation = 2(Unsupervised keyframe detection using low-level visual features from anime film sequence)