Publications

2023

  • Tao Yang, Zhichao Xu, Zhenduo Wang, Anh Tran, Qingyao Ai. Marginal-Certainty-aware Fair Ranking Algorithm. In the Proceedings of the 16th ACM International Conference on Web Search and Data Mining (WSDM'23), Singapore, February 27- March 3, 2023. [pdf]

  • Dan Luo, Lixin Zou, Qingyao Ai, Zhiyu Chen, Dawei Yin, Brian Davison. Model-based Unbiased Learning to Rank. In the Proceedings of the 16th ACM International Conference on Web Search and Data Mining (WSDM'23), Singapore, February 27- March 3, 2023. [pdf]

2022

  • Yinqiong Cai, Jiafeng Guo, Yixing Fan, Qingyao Ai, Ruqing Zhang, Xueqi Cheng. Hard Negatives or False Negatives: Correcting Pooling Bias in Training Neural Ranking Models. In Proceedings of the 31st ACM International Conference on Information and Knowledge Management (CIKM’22), Atlanta, Georgia, USA, Octobor 17-21, 2022. [pdf]

  • Yixiao Ma, Qingyao Ai, Yueyue Wu, Yunqiu Shao, Yiqun Liu, Min Zhang and Shaoping Ma. Incorporating Retrieval Information into the Truncation of Ranking Lists in the Legal Domain. In the Proceedings of the 45th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’22), Madrid, July 11-15, 2022. [pdf] [code]

  • Tao Yang, Chen Luo, Hanqing Lu, Parth Gupta, Bing Yin, Qingyao Ai. Can clicks be both labels and features? Unbiased Behavior Feature Collection and Uncertainty-aware Learning to Rank. In the Proceedings of the 45th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’22), Madrid, July 11-15, 2022. [pdf] [code][video]

  • Yurou Zhao, Zechun Niu, Feng Wang, Jiaxin Mao, Qingyao Ai, Tao Yang, Junqi Zhang, Yiqun Liu. Overview of the NTCIR-16 Unbiased Learning to Rank Evaluation (ULTRE) Task. In the Proceedings of the NTCIR-16 Conference on Evaluation of Information Access Technologies. [pdf]

  • Zhenduo Wang, Qingyao Ai. Simulating and Modeling the Risk of Conversational Search. ACM Transactions on Information Systems (TOIS) [pdf] [code][data]

2021

  • Anh Tran, Tao Yang, and Qingyao Ai. ULTRA: An Unbiased Learning To Rank Algorithm Toolbox. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management (CIKM’21), Gold Coast, Queensland, Australia, November 1-5, 2021. [pdf] [video] [PyTorch] [Tensorflow]

  • Qingyao Ai* and Lakshmi Narayanan R.*. Model-agnostic vs. Model-intrinsic Interpretability for Explainable Product Search. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management (CIKM’21), Gold Coast, Queensland, Australia, November 1-5, 2021. [pdf] [video][code] [data]

  • Zhichao Xu, Hansi Zeng, Qingyao Ai. Understanding the Effectiveness of Reviews in E-commerce Top-N Recommendation. In Proceedings of the 7th ACM International Conference on the Theory of Information Retrieval (ICTIR'21), Virtual, July 11, 2021. [pdf] [video]

  • Keping Bi, Qingyao Ai, W. Bruce Croft. Asking Clarifying Questions Based on Negative Feedback in Conversational Search. In Proceedings of the 7th ACM International Conference on the Theory of Information Retrieval (ICTIR'21), Virtual, July 11, 2021. [pdf]

  • Yurou Zhao, Jiaxin Mao, Qingyao Ai. ULTRE framework: a framework for Unbiased Learning to Rank Evaluation based on simulation of user behavior. In Workshop on Simulation within Information Retrieval with SIGIR 2021 (Sim4IR-SIGIR'21), Virtual, July 15, 2021. [pdf]

  • Keping Bi, Qingyao Ai, W. Bruce Croft. A Review-based Transformer Model for Personalized Product Search. In the Proceedings of the 44th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’21), Virtual, July 11-15, 2021. [pdf] [code]

  • Zhenduo Wang, Qingyao Ai. Controlling the Risk of Conversational Search via Reinforcement Learning. In Proceedings of the 30th International Conference on World Wide Web (WWW '21), Ljubljana, Slovenia, April 19-23, 2021. [pdf] [code] [video]

  • Tao Yang, Qingyao Ai. Maximizing Marginal Fairness for Dynamic Learning to Rank. In Proceedings of the 30th International Conference on World Wide Web (WWW '21), Ljubljana, Slovenia, April 19-23, 2021.[pdf] [code] [video]

  • Hansi Zeng, Zhichao Xu, Qingyao Ai. A Zero Attentative Relevance Matching Network for Review Modeling in Recommender System. Accepted in Proceedings of the 43rd European Conference on Information Retrieval (ECIR‘21), Lucca, March 28 - April 1, 2021. [pdf] [code][video]

  • Qingyao Ai, Tao Yang, Huazheng Wang, Jiaxin Mao. Unbiased Learning to Rank: Online or Offline? ACM Transactions on Information Systems (TOIS) [pdf] [code][video]

2020

  • Zhichao Xu, Yi Han, Yongfeng Zhang, and Qingyao Ai. E-commerce Recommendation with Weighted Expected Utility. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM’20), Virtual, October 19-23, 2020. [pdf] [video]

  • Tao Yang, Shikai Fang, Shibo Li, Yulan Wang, and Qingyao Ai. Analysis of Multivariate Scoring Functions for Automatic Unbiased Learning to Rank. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM’20), Virtual, October 19-23, 2020. [pdf] [video]

  • Zhimeng Pan, Wenzheng Tao, and Qingyao Ai. Review Regularized Neural Collaborative Filtering. In Proceedings of the 2nd International Workshop on Deep Learning Practice for High-Dimensional Sparse Data with KDD 2020 (DLP-KDD’20), August 23 - 27, 2020, San Diego, California, USA. [pdf]

  • Liang Pang, Jun Xu, Qingyao Ai, Yanyan Lan, Xueqi Cheng, and Jirong Wen. Setrank: Learning a permutation-invariant ranking model for information retrieval. In the Proceedings of the 43rd International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’20), Xi'an, China, July 25-30, 2020. [pdf] [code]

  • Keping Bi, Qingyao Ai, W. Bruce Croft. A Transformer-based Embedding Model for Personalized Product Search. In the Proceedings of the 43rd International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’20), Xi'an, China, July 25-30, 2020. [pdf] [code]

2019

  • Qingyao Ai, Yongfeng Zhang, Keping Bi, W. Bruce Croft. Explainable Product Search with a Dynamic Relation Embedding Model. ACM Transactions on Information Systems (TOIS) 38, no. 1 (2019): 4.. [pdf] [code]

  • Keping Bi, Qingyao Ai, Yongfeng Zhang and W. Bruce Croft. Conversational Product Search Based on Negative Feedback. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM’19), Beijing, China, November 3-7, 2019. [pdf][code]

  • Qingyao Ai, Daniel Hill, Vishy Vishwanathan and W. Bruce Croft. A Zero Attention Model for Personalized Product Search. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM’19), Beijing, China, November 3-7, 2019. [pdf]

  • Xiaohui Xie, Jiaxin Mao, Yiqun Liu, Maarten de Rijke, Qingyao Ai, Yufei Huang, Min Zhang and Shaoping Ma. Improving Web Image Search with Contextual Information. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM’19), Beijing, China, November 3-7, 2019. [pdf]

  • Ruey-Cheng Chen, Qingyao Ai, Gaya Jayasinghe, W. Bruce Croft. Correcting for Recency Bias in Job Recommendation. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM’19), Beijing, China, November 3-7, 2019. [pdf]

  • Qingyao Ai, Xuanhui Wang, Sebastian Bruch, Nadav Golbandi, Michael Bendersky and Marc Najork. Learning Groupwise Multivariate Scoring Functions Using Deep Neural Networks. In Proceedings of the 5th ACM International Conference on the Theory of Information Retrieval (ICTIR'19), Santa Clara, California, October 2-5, 2019. [pdf] [code] [video]

  • Jiafeng Guo, Yixing Fan, Liang Pang, Liu Yang, Qingyao Ai, Hamed Zamani, Chen Wu, W. Bruce Croft, Xueqi Cheng. A Deep Look into Neural Ranking Models for Information Retrieval. In Information Processing and Management. July 9, 102067. [pdf]

  • Yukun Zheng, Yiqun Liu, Zhen Fan, Cheng Luo, Qingyao Ai, Min Zhang, Shaoping Ma. Investigating Weak Supervision in Deep Ranking.In Data and Information Management (DIM). [pdf]

  • Keping Bi, Qingyao Ai, W. Bruce Croft. Iterative Relevance Feedback for Answer Passage Retrieval with Passage-level Semantic Match. In Proceedings of the 41st European Conference on Information Retrieval (ECIR‘19), Cologne, Germany, April 14-18, 2019. [pdf]

2018

  • Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, W. Bruce Croft. Towards Conversational Search and Recommendation: System Ask, User Respond. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM’18), Lingotto, Turin, Italy, October 22-26, 2018 [pdf]

  • Qingyao Ai, Vahid Azizi, Xu Chen, Yongfeng Zhang.Learning Heterogeneous Knowledge Base Embeddings for Explainable Recommendation. In Algorithms, Special Issue Collaborative Filtering and Recommender Systems 2018, 11(9) [pdf] [code].

  • Qingyao Ai, Keping Bi, Cheng Luo, Jiafeng Guo, W. Bruce Croft. Unbiased Learning to Rank with Unbiased Propensity Estimation. In Proceedings of the 41th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’18), Ann Arbor, Michigan, USA, July 8-12, 2018 [pdf] [code] [slides]

  • Qingyao Ai, Keping Bi, Jiafeng Guo, W. Bruce Croft. Learning a Deep Listwise Context Model for Ranking Refinement. In Proceedings of the 41th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’18), Ann Arbor, Michigan, USA, July 8-12, 2018 [pdf] [code] [slides]

  • Qingyao Ai, Brendan O'Connor, W. Bruce Croft. A Neural Passage Model for Ad-hoc Document Retrieval. In Proceedings of 40th European Conference on Information Retrieval (ECIR 2018), Grenoble, France, March 26-29, 2018. [pdf]

2017

  • Yongfeng Zhang*, Qingyao Ai*, Xu Chen and W. Bruce Croft. Joint representation learning for top-n recommendation with heterogeneous information sources. In Proceedings of the 26th ACM International Conference on Information and Knowledge Management (CIKM’17), Singapore, November 6-10, 2017 [pdf] [code]

  • Qingyao Ai, Hamed Zamani, Stephen Harding, Shahrzad Naseri, James Allan, W. Bruce Croft. UMass at TREC 2017 Common Core Track. [pdf]

  • Qingyao Ai, Yongfeng Zhang, Keping Bi, Xu Chen and W. Bruce Croft. Learning a Hierarchical Embedding Model for Personalized Product Search. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’17), Japan, Tokyo, August 7-11, 2017 [pdf] [code] [data] [slides]

  • Xu Chen, Yongfeng Zhang, Qingyao Ai, Hongteng Xu, Junchi Yan and Zheng Qin. Personalized Key Frame Recommendation. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’17), Japan, Tokyo, August 7-11, 2017 [pdf]

  • Qingyao Ai, Susan T. Dumais, Nick Craswell, and Dan Liebling. Characterizing Email Search using Large-scale Behavioral Logs and Surveys. In Proceedings of the 26th International Conference on World Wide Web (WWW '17), Australia, Perth, April 3-7, 2017. [pdf]

  • Narang, Kanika, Susan T. Dumais, Nick Craswell, Dan Liebling, and Qingyao Ai. Large-Scale Analysis of Email Search and Organizational Strategies. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval (CHIIR 2017), Oslo, Norway, March 7-11, 2017. [pdf]

  • Zeyang Liu, Jiaxin Mao, Chao Wang, Qingyao Ai, Yiqun Liu, and Jian-Yun Nie. Enhancing click models with mouse movement information. Information Retrieval Journal, 2017. [pdf]

2016

  • Jiafeng Guo, Yixing Fan, Qingyao Ai, W. Bruce Croft. A Deep Relevance Matching Model for Ad-hoc Retrieval. In Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM 2016), Indianapolis, USA. October 24-28, 2016. [pdf] [code]

  • Jiafeng Guo, Yixing Fan, Qingyao Ai, W. Bruce Croft. Semantic Matching by Non-Linear Word Transportation for Information Retrieval. In Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM 2016), Indianapolis, USA. October 24-28, 2016. [pdf] [code]

  • Liu Yang, Qingyao Ai, Jiafeng Guo, W. Bruce Croft. aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model. In Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM 2016), Indianapolis, IN, USA. October 24-28, 2016. [pdf] [code]

  • Qingyao Ai, Liu Yang, Jiafeng Guo, and W. Bruce Croft. Analysis of the Paragraph Vector Model for Information Retrieval. In Proceedings of the 2nd ACM International Conference on the Theory of Information Retrieval (ICTIR 16), Newark, DE, USA, September 12-16, 2016. [pdf] [code] [slides]

  • Cohen Daniel, Qingyao Ai and W. Bruce Croft , Adaptability of Neural Networks on Varying Granularity IR Tasks. In Proceedings of The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’16), NeuIR: Workshop on Neural Information Retrieval , Pisa, Italy, July 17-21, 2016. [pdf]

  • Qingyao Ai, Liu Yang, Jiafeng Guo, and W. Bruce Croft. Improving Language Estimation with the Paragraph Vector Model for Ad-hoc Retrieval. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR’16), Pisa, Italy, July 17-21, 2016. [pdf] [code]

  • Liu Yang, Qingyao Ai, Damiano Spina, Ruey-Cheng Chen, Liang Pang, W. Bruce Croft, Jiafeng Guo, and Falk Scholer. Beyond Factoid QA: Effective Methods for Non-factoid Answer Sentence Retrieval. In Proceedings of 38th European Conference on Information Retrieval (ECIR 2016), Padova, Italy, March 20-23, 2016. [pdf]

2015

  • Lee Chia-Jung*, Qingyao Ai*, W. Bruce Croft, and Daniel Sheldon. An Optimization Framework for Merging Multiple Result Lists. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management (CIKM 2015), Melbourne, Australia, pp. 303-312. [pdf] [code]

[∗ equal contribution]