Fan Shaojing

About Me

I am currently a senior research fellow in School of Computing, National University of Singapore (NUS). Prior to joining NUS, I was a senior research engineer at the Institute for Infocomm Research, part of Singapore's Agency for Science, Technology, and Research (A*STAR) from 2013 to 2015. I worked as a lecturer from 2006 to 2012 in Ningbo University of Technology. I received the B. E. and M. E. degree from South China University of Technology in 2001, 2004, respectively. I did my D. Phil in Ningbo University, and Institute for Infocomm Research, A*STAR from 2010 to 2015. My research interest includes cognitive vision, computer vision, multimedia analysis, and experimental psychology. My PhD is co-supervised by Tian-Tsong Ng and Rang-Ding Wang. I also receive intensive guidance from Bryan L. Koenig, Jonathan S. Herberg, and Cheston Y.-C. Tan.

Email: dcsfs AT nus.edu.sg 

Selected Publications (For a more complete list, please see my Google Scholar Citation page.)

S. Fan, R. Jain, M. Kankanhalli, A Comprehensive Picture of Factors Affecting User Willingness to Use  Mobile Health Applications.  ACM Transactions on Computing for Healthcare, 2023. [pdf

D. Xu, S. Fan, M. Kankanhalli, Combating Misinformation in the Era of Generative AI Models(ACMMM), 2023[pdf

Y. Wong, S. Fan, Y.Guo, Z. Xu, K. Stephen, R. Sheoran, A. Bhamidipati, V. Barsopia, J. Liu, M. Kankanhalli, Compute to tell the tale: Goal-driven narrative generation (ACMMM), 2022. [pdf

S. Fan*, Z. Shen*, M. Jiang, B. Koenig, M. Kankanhalli, Q.Zhao. Emotional attention: From eye tracking to computational modeling,  IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2022.  [pdf] [supplementary] [code & dataset

A. Singh, S. Fan, M. Kankanhalli, "Human Attributes Prediction Under Privacy-preserving Conditions". ACM Multimedia Conference (ACMMM) 2021. (Oral). [pdf] [supplementary] [code] [dataset] Project website

Sun, Y., Zhao, M., Hu, K. and S. Fan, "Visual saliency prediction using multi-scale attention gated network". Multimedia Systems, pp.1-9. 2021

S. Fan, Z. Shen, B. Koenig, T. -T Ng and M. Kankanhalli. "When and Why Static Images Are More Effective Than Videos." IEEE Transactions on Affective Computing 01 (2020): 1-1. [pdf] [code (video sentiment prediction)] [code (frame extraction)] [dataset]

S. Fan, B. Koenig, Q.Zhao, M. Kankanhali,  A Deeper Look at Human Visual Perception of Images. SN Computer Science 1, 1 (2020) 1-16 [pdf] 

Z. Shen, MF Habibi, S. Fan, and M. Kankanhalli, "MediaEval 2020: Maintaining Human-Imperceptibility of Image Adversarial Attack by using Human-Aware Sensitivity Map", MediaEval 2020. [pdf]

S. Wu, S. Fan, Z. Shen, M. Kankanhalli and A Tung, Who You Are Decides How You Tell. ACM Multimedia Conference (ACMMM), 2020. (Oral) [pdf] [Oral presentation]

C Weth, A. Abdul, S. Fan, M. Kankanhalli, Helping Users Tackle Algorithmic Threats on Social Media: A Multimedia Research Agenda (ACMMM), 2020. [pdf

Z. Shen, S. Fan, Y. Wong, T. -T Ng and M. Kankanhalli, Human-imperceptible Privacy Protection Against Machines. ACM Multimedia Conference (ACMMM), Nice, France, 2019 (Oral, Best Student Paper). [pdf] [code] [dataset] [human experiment] [supplementary] [news] Project website

M. Cordel, S. Fan, Z. Shen and M. Kankanhalli, Emotion-Aware Human Attention Prediction. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. [pdf] [supplementary]

S. Fan, Z. Shen, M. Jiang, B. Koenig, J. Xu, M. Kankanhali, Q.Zhao, Emotional Attention: A Study of Image Sentiment and Visual Attention. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018 (Spotlight oral, acceptance rate: 6.6%). [pdf] [supplementary material] [dataset & code] Project website 

S. Fan, T.-T. Ng, B. Koenig, J. Herberg, M. Jiang,  Z. Shen, Q.Zhao. Image Visual Realism: From Human Perception to Machine Computation,  IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 40.9(2018). [pdf] [code] [dataset]. Project website

S. Fan, M. Jiang, B. Koenig, Z. Shen, M. Kankanhali, Q.Zhao, The Role of Visual Attention in Sentiment Prediction,  ACM Multimedia Conference (ACMMM), Mountain View, CA, USA, 2017. [pdf] [code] [dataset] [supplementary material] [video]. Project website

S. Fan, M. Jiang, B. Koenig, J. Xu, Y. Chen, M. Kankanhalli, Q. Zhao. ``A Correlational Study Between Human Attention and High-level Image Perception ''. Journal of Vision, August 2017, vol. 17. [pdf

M. Jiang, Z. Shen, S. Fan, Q. Zhao. ``SALICON: A Web Platform for Crowdsourcing Behavioral Experiments''. Journal of Vision, August 2017, vol. 17. 

S. Wang, S. Fan, B. Chen, S. Hakimi, L. Paul, Q. Zhao, R. Adolphs. Revealing the world of autism through the lens of a camera. Current Biology, 2016. [pdf] [news]

S. Fan, T.-T. Ng, B. Koenig, M. Jiang, Q.Zhao. A Paradigm for Building Generalized Models of Human Image Perception through Data Fusion, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016. [pdf

B. Xu, M. Jiang, S. Fan, Q. Zhao. Data fusion  with Deep Boltzmann Machines for high-level image perception, WICV 2016, in conjunction with CVPR 2016.

S. Fan, T.-T. Ng, J. Herberg, B. Koenig, Y.-C. Tan, R. Wang. An Automated Estimator of Image Visual Realism Based on Human Cognition., IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014. [pdf] Project website

S. Fan, T.-T. Ng, J. Herberg, B. Koenig, Y.-C. Tan, R.Wang. Human Perception of Visual Realism for Photo and Computer-generated Face Images. ACM Transactions on Applied Perception (TAP) 11.2 (2014): 7. [pdf]

S. Fan, T.-T. Ng, J. Herberg, B. Koenig, S. Xin. Real or Fake?: Human Judgments about Photographs and Computer-generated Images of Faces. Siggraph Asia, Technical Brief, 2012. (Oral) [pdf] [video]

S. Fan, T.-T. Ng, J. Herberg, B. Koenig, Y.-C. Tan, R. Wang.  An Automated Estimator of Image Visual Realism Based on Human Cognition, Vision Meets Cognition Workshop, in conjunction with CVPR 2014. (Invited). Extended Abstract. 2014.

S. Fan, T.-T. Ng, J. Herberg, B. Koenig, Y.-C. Tan, R. Wang.  Human Perception of Visual Realism for Photo and Computer-generated Face Images, Vision Meets Cognition Workshop, in conjunction with CVPR 2014. Extended Abstract. 2014.

Professional Services

Senior Program Committee Member of AAAI 2022. Program Committee Member of AAAI 2021, ACM MM 2017, 2018

Invited reviewer for CVPR 2018, 2019, 2020, 2021, 2022, 2023, 2024; ICCV 2019, 2021, 2022; ECCV 2020, 2021,  2022; SIGGRAPH 2022; NeurIPS 2022, 2023, 2024; ICLR 2022, 2023; ICML 2023; WWW 2024

Invited reviewer for WACV 2018, 2019. 2020; 2021

Invited reviewer for ACCV 2018, 2019, 2020, 2021; ICPR 2018, 2019

Invited reviewer for Journal of Experimental & Theoretical Artificial Intelligence

Invited reviewer for Scientific Reports (by Nature Publishing Group)

Invited reviewer for IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)

Invited reviewer for ACM  Transactions on Applied Perception (TAP)

Invited reviewer for IEEE Transactions on Information Forensics and Security (TIFS)

Invited reviewer for IEEE Transactions on Multimedia

Invited reviewer for IEEE Signal Processing Letters

Invited reviewer for Pattern Recognition Letters

Invited reviewer for ACM Transactions on Multimedia Computing, Communications and Applications

Invited reviewer for Signal Processing

Invited reviewer for Multimedia Systems