I’ll be at ICCV 2025 in Honolulu, Hawai'i this October. Let me know if you’d like to connect or catch up!
Embedded Files
Previously, I was a Researcher within the Machine Learning Department at NEC Laboratories America, Inc.
Previously, I was a Researcher within the Machine Learning Department at NEC Laboratories America, Inc.
I earned my Ph.D. in Computer Science from Rutgers University in 2023, where I was supervised by Professor Mubbasir Kapadia. I received Bachelor of Engineering in Computer Science and Technology in 2017, and Bachelor of Arts in TV Editing and Directing (Post-production of Television) in 2016, both from Communication University of China.
I earned my Ph.D. in Computer Science from Rutgers University in 2023, where I was supervised by Professor Mubbasir Kapadia. I received Bachelor of Engineering in Computer Science and Technology in 2017, and Bachelor of Arts in TV Editing and Directing (Post-production of Television) in 2016, both from Communication University of China.
I did internships at Salesforce AI Research (Mentors: Juan Carlos Niebles and Roberto Martín-Martín), NEC Labs (Mentors: Asim Kadav and Farley Lai), and Google YouTube (Mentors: Wei-Hong Chuang and Hassan Akbari) where I was lucky enough to have the opportunity to closely collaborate with DeepMind and Google Research.
Research Interests
Research Interests
Multimodal and Generative AI
Video Understanding
Embodiment and Robotics
Open to academic collaboration - Contact me if you're interested.
September 2025 🚀🚀🚀 Introducing Strefer—our data engine for Video LLMs! 🎬🧩⏳ It empowers Video LLMs to better interpret specific space-time locations and respond to user queries containing space-time references—whether expressed through text, clicks, or gestures. Here're the videos (10-min version, 3-min version), my post on LinkedIn and walkthrough on X about this work.
August 2025 Contra4 is accepted by EMNLP 2025. Cheers! 🥂 Our post on LinkedIn. 🏆 Leaderboard & Dataset are available now. Can your multimodal models reason across modalities, contrastively?
August 2025 We will organize a new edition of the Multimodal Algorithmic Reasoning Workshop at NeurIPS 2025.
July 2025 I am an invited panelist at the Stanford AI4ALL's Career Panel. Thank you for inviting me again!
June 2025 I am an organizer for the CVPR 2025 Multimodal Algorithmic Reasoning Workshop.
February 2025 ViUniT: Visual Unit Tests for More Robust Visual Programming is accepted by CVPR 2025. Congratulations, Artemis 👍👍👍! Here's my walkthrough. Also, check out this amazing blog post from Juan Carlos (Super cool stuff!!!!).
January 2025 Well, it doesn't make sense for Video LLMs to rely solely on one image encoder for initial feature extraction. Check out the amazing Twitter thread from Tyler Zhu explaining our latest work accepted by ICML 2025 – MERV, a VideoLLM with a multi-encoder representation of videos, and the new capabilities it has gained. 🥳 This project was a wonderful collaboration with Prof. Olga Russakovsky (Princeton) — an experience I'll always cherish!
January 2025 BLIP-3-Video's HuggingFace checkpoints are available now (128 tokens, 32 tokens).
October 2024 We released xGen-MM-Vid (BLIP-3-Video): An Efficient Video-Language Model. Visit our website! 👈
September 2024 Our paper is accepted by WACV 2025. Check the paper: Domain-Guided Weight Modulation for Semi-Supervised Domain Generalization.
August 2024 We released xGen-VideoSyn-1: High-fidelity Text-to-Video Synthesis with Compressed Representations.
August 2024 We released xGen-MM (BLIP-3): A Family of Open Large Multimodal Models. Visit our project page! 👈
August 2024 Dive into our new survey on video self-supervised learning. Explore our organized list of related works and be sure to star our repository. Your contributions are highly valued and greatly appreciated! 🤝
July 2024 I am an invited panelist at the Stanford AI4ALL's Career Panel.
July 2024 We will organize a new edition of the Multimodal Algorithmic Reasoning Workshop at NeurIPS 2024.
June 2024 I am an organizer for the CVPR 2024 Multimodal Algorithmic Reasoning Workshop.
Selected Projects
Selected Projects
[ICCV 2025 Workshop] Strefer: Empowering Video LLMs with Space-Time Referring and Reasoning via Synthetic Instruction Data
[ICCV 2025 Workshop] Strefer: Empowering Video LLMs with Space-Time Referring and Reasoning via Synthetic Instruction Data
[EMNLP 2025] Contra4: Evaluating Contrastive Cross-Modal Reasoning in Audio, Video, Image, and 3D
[EMNLP 2025] Contra4: Evaluating Contrastive Cross-Modal Reasoning in Audio, Video, Image, and 3D
[CVPR 2025] ViUniT: Visual Unit Tests for More Robust Visual Programming
[CVPR 2025] ViUniT: Visual Unit Tests for More Robust Visual Programming
[ICML 2025] MERV: Unifying Specialized Visual Encoders for Video Language Models
[ICML 2025] MERV: Unifying Specialized Visual Encoders for Video Language Models
[arXiv 2024] xGen-MM-Vid (BLIP-3-Video): You Only Need 32 Tokens to Represent a Video Even in VLMs
[arXiv 2024] xGen-MM-Vid (BLIP-3-Video): You Only Need 32 Tokens to Represent a Video Even in VLMs
[ECCV 2024 AI4VA] xGen-VideoSyn-1: High-fidelity Text-to-Video Synthesis with Compressed Representations
[ECCV 2024 AI4VA] xGen-VideoSyn-1: High-fidelity Text-to-Video Synthesis with Compressed Representations
[arXiv 2024] xGen-MM (BLIP-3): A Family of Open Large Multimodal Models
[arXiv 2024] xGen-MM (BLIP-3): A Family of Open Large Multimodal Models
[CVPR 2024] Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos
[CVPR 2024] Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos
[CVPR 2023] Procedure-Aware Pretraining for Instructional Video Understanding
[CVPR 2023] Procedure-Aware Pretraining for Instructional Video Understanding
[ECCV 2022] COMPOSER: Compositional Reasoning of Group Activity in Videos with Keypoint-Only Modality
[ECCV 2022] COMPOSER: Compositional Reasoning of Group Activity in Videos with Keypoint-Only Modality
[CIKM 2022 Best Paper Award] D-HYPR: Harnessing Neighborhood Modeling and Asymmetry Preservation for Digraph Representation Learning
[CIKM 2022 Best Paper Award] D-HYPR: Harnessing Neighborhood Modeling and Asymmetry Preservation for Digraph Representation Learning
More about me & Fun stuff...
Coffee, nature, family and friends, cuddles with my dog and cat — my sources of happiness.
Last Update: Sep. 7, 2025
Page updated
Google Sites
Report abuse