In-Workshop Tutorial

Doubly Robust Estimation for Position-Biased Clicks

14:00 - 14:50 on Tuesday, September 19th in room 331

Abstract

Search and recommendation systems are vital for the accessibility of content on the internet. The basis for these systems are ranking models that turn collections of items into rankings: small, ordered lists of items to be displayed to users. Modern ranking models are mostly optimized based on user interactions. Generally, learning from user behavior leads to systems that receive more user engagement than those optimized based on expert judgements. However, user interactions are biased indicators of user preference: often whether something is interacted has less to do with preference and more with where and how it was presented.

In response to this bias problem, recent years have seen the introduction and development of the counterfactual Learning to Rank (LTR) field. This field covers methods that learn from historical user interactions, i.e. click logs, and aim to optimize ranking models w.r.t. the actual user preferences. In order to achieve this goal, counterfactual LTR methods have to correct the biases that affect clicks.

In this talk I will present a recently introduced doubly robust method for correcting position-bias in user interactions with rankings.

Presenter: Harrie Oosterhuis (Radboud University)

Harrie Oosterhuis is an assistant professor at the Data Science Group of the Institute of Computing and Information Sciences (iCIS) of the Radboud University. His research lies on the intersection of machine learning and information retrieval, it primarily concerns learning from user interactions on rankings. In particular, it focuses on methods that correct for the effects of interaction biases. He received his PhD cum laude from the University of Amsterdam under supervision of prof. dr. Maarten de Rijke on the thesis titled "Learning from User Interactions with Rankings: A Unification of the Field". He is also a recipient of the 2021 Google Research Scholar Award and a 2022 NWO Veni for early career researchers, in addition to several best paper awards at WSDM'21, SIGIR'21 and ICTIR'22.