Welcome to Guangnan Ye's homepage!

About Me

Guangnan Ye is a researcher at IBM T.J. Watson Research Center. He received his PhD degree at Dept. of Electrical Engineering, Columbia University, supervised by Prof. Shih-Fu Chang . His interests fall in topics of multimedia data analytics from multi-modalities, machine learning applications on big data. Ye is an active participant at the U.S. NIST TREC video retrieval evaluation (TRECVID). He has been involved in designing a few top performance systems in multimedia event detection task in 2010, 2011, 2013.

Experience:

• Research Staff Member, IBM T.J. Watson Research Center, 2016.2-Present

• Research Assistant, DVMM Lab at Columbia University, 2010.8-2015.12

• Research Intern, Video and Multimedia Technologies and Services Research Department, AT&T Labs - Research, 2014.6-2014.8 (Mentors: Behzad Shahraray, David C. Gibbon, Zhu Liu)

• Research Intern, Media Analytics Department, NEC Labs America, 2013.5-2013.8 (Mentors: Ming Yang, Yuanqing Lin)

Projects:

• ALADDIN from IARPA, U.S. NIST TRECVID Multimedia Event Detection (MED) Task (DVMM Lab at Columbia University, 2010-Present)

• Large-scale Multimedia Event Detection Engine (AT&T Labs – Research, 2014)

• Fine-Grained Large-Scale Vehicle Retrieval (NEC Labs America, 2013)

• Humanoid Robot Soccer World Cup, Robocup 2010 (Singapore, 2010)

• U.S. NIST TRECVID Surveillance Event Detection Task (Peking University, 2009)

• Visual and Audio Retrieval System, The Star Challenge Singapore 2008 (Singapore, 2008)

Publication:

• Guangnan Ye, Yitong Li, Hongliang Xu, Dong Liu, Shih-Fu Chang. EventNet: A Large Scale Structured Concept Library for Complex Event Detection in Video. In ACM International Conference on Multimedia (ACM MM), Brisbane, Australia, 2015. [PDF]

• Hongliang Xu, Guangnan Ye, Yitong Li, Dong, Liu, Shih-Fu Chang. Large Video Event Ontology Browsing, Search and Tagging (EventNet Demo). In ACM International Conference On Multimedia (ACM MM), Brisbane, Australia, 2015. [PDF]

• Jiawei Chen, Yin Cui, Guangnan Ye, Dong Liu, Shih-Fu Chang. Event-Driven Semantic Concept Discovery by Exploiting Weakly Tagged Internet Images. In ACM International Conference on Multimedia Retrieval (ICMR), oral session, 2014. [PDF] [Slides]

• Guangnan Ye, Dong Liu, Jun Wang, and Shih-Fu Chang. Large Scale Video Hashing via Structure Learning. IEEE International Conference on Computer Vision (ICCV), 2013. [PDF] [Poster]

• I-Hong Jhuo, Guangnan Ye, Shenghua Gao, Dong Liu, Yu-Gang Jiang, D. T. Lee, and Shih-Fu Chang. Discovering Joint Audio-Visual Codewords for Video Event Detection. Machine Vision and Applications, 2013. [PDF]

• Dong Liu, Kuan-Ting Lai, Guangnan Ye, Ming-Syan Chen, and Shih-Fu Chang. Sample Specific Late Fusion for Visual Category Recognition. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2013. [PDF]

• P. Natarajan, S. Wu, F. Luisier, X. Zhuang, M. Tickoo, Guangnan Ye, Dong Liu, Shih-Fu Chang, et at. BBN VISER TRECVID 2013 Multimedia Event Detection and Multimedia Event Recounting Systems. In NIST TRECVID workshop, 2013. (Top Performance) [PDF] [Slides]

  • Dong Liu, Guangnan Ye, Ching-Ting Chen, Shuicheng Yan, Shih-Fu Chang. Hybrid Social Media Network. In Proceeding of ACM International Conference on Multimedia (ACM MM), oral session, 2012. [PDF] [Slides]

• Guangnan Ye, Dong Liu, I-Hong Jhuo, Shih-Fu Chang. Robust Late Fusion with Rank Minimization. In IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2012. [PDF] [Poster]

• Felix Yu, Rongrong Ji, Ming-Hen Tsai, Guangnan Ye, Shih-Fu Chang. Weak Attributes for Large-Scale Image Retrieval. In IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2012. [PDF] [Poster]

• Guangnan Ye, I-Hong Jhuo, Dong Liu, Yu-Gang Jiang, D.T.Lee, Shih-Fu Chang. Joint Audio-Visual Bi-Modal Codewords for Video Event Detection. In ACM International Conference on Multimedia Retrieval (ICMR), 2012. [PDF] [Poster]

• Felix Yu, Rongrong Ji, Ming-Hen Tsai, Guangnan Ye, Shih-Fu Chang. Experiments of Image Retrieval Using Weak Attributes. Computer Science Department Technical Report # CUCS 005-12 (2012) Columbia University, 2012. [PDF]

• Yu-Gang Jiang, Guangnan Ye, Shih-Fu Chang, Daniel Ellis, Alexander C. Loui. Consumer Video Understanding: A Benchmark Database and An Evaluation of Human and Machine Performance. In Proceedings of ACM International Conference on Multimedia Retrieval (ICMR), oral session, 2011. [PDF] [Project Page]

  • P. Natarajan, V. Manohar, S. Wu, S. Tsakalidis, S. N. Vitaladevuni, X. Zhuang, R. Prasad, Guangnan Ye, et al. BBN VISER TRECVID 2011 Multimedia Event Detection System. In NIST TRECVID Workshop, Gaithersburg, MD, November 2011. (Top Performance) [PDF] [Slides]

• Yu-Gang Jiang, Xiaohong Zeng, Guangnan Ye, Subhabrata Bhattacharya, Dan Ellis, Mubarak Shah, Shih-Fu Chang. Columbia-UCF TRECVID2010 Multimedia Event Detection: Combining Multiple Modalities, Contextual Concepts, and Temporal Matching. In NIST TRECVID Workshop, Gaithersburg, MD, November 2010. (Top Performance) [PDF] [Project Page][Slides]

  • Zhipeng Hu, Guangnan Ye, Guochen Jia, Xibin Chen, Kaihua Jiang, Yaowei Wang, Yonghong Tian, Xihong Wu, Wen Gao. PKU@TRECVID2009: Single-Actor and Pair-Activity Event Detection in surveillance Video. In NIST TRECVID Workshop, Gaithersburg, MD, November 2009. [PDF] [Slides]

Academic Services:

• Technical program committees for ICMR 2015,2016, ICME 2014, 2015

• Reviewers for CVPR, ACM MM, ICME, ICMR, TMM

Honors and Awards:

• U.S. NIST TRECVID MED Task, Top Performance 2010, 2011, 2013

• Wei Foundation Fellowship, 2013

• Intel Fellowship, 2008

• 4th place among 53 teams globally in the Star Challenge video and audio retrieval competition at Singapore, 2008

• Citibank Fellowship, 2005