About

Employment

• 12/2018-present Research Scientist at Google, Mountain View

• 3/2017-11/2018 Postdoc

  • Perceptual User Interfaces Group at the Max Planck Institute for Informatics

  • Worked with Prof. Andreas Bulling on affective computing, attentive and cognitive computing, gaze estimation, and gaze-based human-computer interfaces

• 11/2016-3/2017 Postdoctoral Fellow

  • CHI Lab, Department of Computing, the Hong Kong Polytechnic University

  • Worked with Dr. Grace Ngai and Dr. Hong Va Leong on facial expression analysis and attentive computing

• 5/2016-11/2016 Research Associate

  • CHI Lab, Department of Computing, the Hong Kong Polytechnic University

  • Worked with Dr. Grace Ngai and Dr. Hong Va Leong on facial expression analysis and attentive computing

• 3/2010-2/2011 Research Assistant

  • Key Laboratory for Advanced Simulation Technology, Beihang University

  • Worked with Dr. Xiao Song on character animation and motion synthesis, designed and implemented a system for motion editing and visualization

• 7/2009-9/2009 Internship

  • Honeywell Technology Solution Lab, Beijing

  • Reviewed scripts (python test files & ATE scripts) and test case description.

Education

• 5/2011-9/2016: Ph.D

  • Department of Computing, the Hong Kong Polytechnic University

  • Advisor: Dr. Grace Ngai and Dr. Stephen C.F. Chan in the Computer Human Interaction Lab

  • Thesis title: A Framework for Personal Emotion Categorization and Visual Attention Estimation

  • Examiners: Dr. Hatice Gunes (University of Cambridge), Dr. Helen Meng (Chinese University of Hong Kong), Dr. Jian-nong Cao (PolyU)

• 11/2014-3/2015 Visiting scholar

  • Engineering & Computer Science, University of Central Florida

  • Supervisor: Dr. Kien A. Hua in the Data System Group

  • Project: Facial Expression Analysis based on Multiple-Instance Learning and Information Retrieval

• 9/2007-3/2010 M.Eng

  • School of Automation Science and Electrical Engineering, Beihang University

  • Advisor: Prof. Liang Han and Dr. Jiangyun Wang in the key laboratory for Advanced Simulation Technology

• 9/2003-6/2007 B.Eng

  • School of Automation Science and Electrical Engineering, Beihang University

Awards

• 2019 Best Paper Award, ACM ETRA'19

• 2016 Best Paper Award, ACM CHI’16

• 2016 Best Presentation Award, Department of Computing, PolyU

• 2010 Excellent Graduate Thesis Award, Beihang University

• 2009 Honeywell Innovators Scholarship

• 2007 Excellent Undergraduate Award, Beihang University

Reviewer

• CHI'20(4), CHI'20-LBW(7), ETRA'20(5), IMWUT(1)

• CHI'19(2), MM'19(4), ICMI'19(2), ETRA'19(3), UIST'19(1)

• CHI'18(2), ETRA'18(3), FG'18(4)

• CHI’17(4), FG’17(1), MM’17(1)

• COMPSAC’16, ACHI’16

• SAC’15

• IEEE Transactions on Pattern Analysis and Machine Intelligence(1)

• IEEE Transactions on Affective Computing(4)

• IEEE Transactions on Human-Machine Systems(1)

• ACM Transactions on Interactive Intelligent Systems (1)

• ACM Transactions on Multimedia Computing, Communications, and Applications(1)

• Expert Systems with Applications

• Neurocomputing(1)

Student Mentoring

• 2019 Google intern with Dr. Jeffrey Nichols and Dr. Wenxin Feng

  • Hui-Shyong Yeo (St Andrews, PhD): Cross-device direct manipulation.

  • Muratcan Cicek (UCSC, PhD): Mobile head tracking.

• 2017-2018 Graduate Mentoring with Dr. Andreas Bulling

  • Xucong Zhang (MPII, PhD): Multi-domain learning application in HCI (CHI'18).

  • Philipp Müller (MPII, PhD): Affect analysis in group interaction (IUI'18).

  • Julian Steil (MPII, PhD): Attention analysis from egocentric vision (ETRA'18).

  • Assulan Nurkas (MPII, Master): Implicit gaze calibration.

  • Pascal Bies (MPII, Master): A multimodal approach to memorability detection.

  • Nahid Akhtar (MPII, Master): Microsaccades in HCI.

  • Ziwei He (Saarland University, Master): Saccade-based HCI applications.

  • Preeti Dolakasharia (Saarland University, Master): Implicit gaze calibration on the mobile device.

  • Sahar El-Gohary (Saarland University, Master): SSVEP in BCI (SMC'19).

  • Jia Xin (University of Twente, Master): A multimodal approach to prejudice detection.

• 2017 Graduate Mentoring with Dr. Grace Ngai and Dr. Hong Va Leong

  • Jun Wang (HKPolyU, PhD): Stress detection from the eye and hand coordination (ACII’17).

  • Eugene Fu (HKPolyU, PhD): A cross-domain approach to human flight detection (MM'18).

  • Jiajia Li (HKPolyU, PhD): Reading comprehension detection through eye movement and facial expression analysis.

  • Tiffany Kwok (HKPolyU, Master): User intention prediction based on mouse movement (IUI'18).

• 2015,2014 Graduate Mentoring with Dr. Grace Ngai, Dr. Hong Va Leong, and Dr. Stephen C.F. Chan

  • Eugene Fu (HKCityU, Master): Heart rate and respiration detection from a mouse equipped with a PPG sensor (COMPSACW’14, UAIS).

  • Hugo Sun (HKPolyU, Master): Attention detection from facial expression, keystroke, and mouse dynamics during reading, writing and browsing (ACHI’14).

• 2014 Undergraduate Mentoring with Dr. Grace Ngai, Dr. Hong Va Leong, and Dr. Stephen C.F. Chan

  • Tiffany Kwok (HKPolyU, Bachelor): Facial expression augmented video sharing for the enhancement of engagement and connectedness (IUI’15).

  • Layla Wan (HKPolyU, Bachelor). Implicit gaze calibration through human-computer interactions (MM’14).

• 2014 Creative Digital Media Design

  • Gave tutorials on object detection and tracking.

• 2013 Human-Computer Interaction

  • Gave tutorials on experimental evaluation.

• 2013, 2012 Service Learning and Civic Engagement in The Information Age, Service Learning in Technology

  • Directed students to prepare lesson plan and material. Supervised them to deliver a 7-day class in a primary school in Cambodia.

• 2013, 2011 Seminars and Topics in Information Technology

  • Graded homework and laboratory reports, answered questions in tutorials.