Home

Watch and Buy

The 1st Workshop On Multimodal Product Identification in Livestreaming and WAB Challenge 2021

Organized in conjunction with ACM MM 2021

Overview

With the rapid development of E-commerce livestreaming, consumers could enjoy shopping while watching videos on various livestreaming platforms. During a live broadcast, a live streamer would introduce hundreds of products, and the consumer has to find the specific product from the long shopping list, which is unfriendly and laboursome. Besides, spectators may find products appearing in movies and television appealing, and want to buy them. Hence, finding products that appeared in multimedia content is desirable. However, product identification still remains a challenge in real-world applications, because of large deformations, occlusions, motion blur, the similarity of appearance between products and discrepancies across domains between videos and e-shop images. Previous public benchmarks and proposed methods are mainly focused on retrieval real-world images against e-shop images, performing product identification for multimedia content with additional temporal, textual and audio information is rarely explored.

This workshop allows researchers in the area of multimodal to present their progress, communication and co-develop novel ideas that potentially shape the future of this area. Besides, we launch a“Watch and Buy: Multimodal Product Identification”(WAB) Challenge with the largest multimodal product retrieval dataset, which could help researchers further advance the performance and applicability of correspondingly built systems in real-world conditions.

Announcements

WAB 2021 Workshop will be held on Oct. 20 at Chengdu!
We have launched WAB Challange as part of the workshop.
"Watch and Buy: Multimodal Product Identification" Challenge has started on April 20, 2021, click here for registration.

Keynote Speaker

Dr. Tat-Seng Chua is the KITHCT Chair Professor at the School of Computing, National University of Singapore (NUS). He is also the Distinguished Visiting Professor of Tsinghua University and the Visiting Chair Professor of Zhejiang University. Dr. Chua was the Founding Dean of the School of Computing from 1998-2000. His main research interests include unstructured data analytics; multimodal information retrieval, recommendation and conversation; and the emerging applications in E-commerce and Fintech. Dr Chua is the co-Director of NExT, a joint research Center between NUS and Tsinghua, focusing on Extreme Search.