Over the last years, the field of Computer Vision has experienced a tremendous growth. This is evident in the ever-growing number of participants of the main Computer Vision conferences, as well as industrial and public interest in this area of research. As part of this growth, the number of paper submissions is increasing at a rapid pace. Unfortunately, the number of experienced reviewers and area chairs is not increasing at the same rate. This could be linked to the fact that many senior researchers are nowadays (partially) affiliated with industry, and thus do not have the time to be part of the reviewing process in senior roles and to educate their PhD students about writing reviews. Another reason is the ever-increasing range of topics presented at CVPR/ECCV/ICCV, which makes it harder and harder to find experts for each submission. As a result, the quality of the reviews seems to be decreasing, leading to more random decisions and thus frustration in the community. It is left to us as a research community to make an effort to actively work on increasing the quality of the review process.
This tutorial is a follow-up to a successful CVPR 2020 tutorial (the video recording of the tutorial has been watched more than 15k times on YouTube). Last year’s tutorial had a broad focus, covering the process from writing a paper, going over writing reviews and rebuttals, and finally, to how reviews are used by Area Chairs (AC). Based on questions from the audience, this year’s edition focuses on the latter parts of the process:
from an AC’s perspective: what is useful in a review and in a rebuttal? What are the types of reviews and discussions that are helpful in the decision process?
from a program chair’s (PC) perspective: how can we improve the review and the decision process? How can we educate our authors, reviewers, and area chairs? How is the process currently structured and where are the current bottlenecks?
In order to achieve these goals, we plan to provide diverse perspectives from both relatively young and well-established researchers, area chairs and program chairs from recent conferences. We believe that by providing multiple perspectives on the topic, attendees will be able to better understand the review process and, as a consequence, help us as a community to improve its quality. We hope that by educating the community, we will make the process more transparent, thus increasing the trust in the system.
Konstantinos G. Derpanis (York University) is an Associate Professor in the Department of Electical Engineering and Computer Science at York University, Toronto. He received the Honours Bachelor of Science (BSc) degree in Computer Science from the University of Toronto, in 2000, and the MSc and PhD degrees in Computer Science from York University, Canada, in 2003 and 2010, respectively. Subsequently, he was a postdoctoral researcher in the GRASP Laboratory at the University of Pennsylvania. He currently serves as an adjunct Professor at York University, a Vector Institute Faculty Affiliate, and a Vision: Science to Applications (VISTA) Faculty Affiliate. Konstantinos is an area chair for CVPR 2021 and ICCV 2021 and is highly outspoken about the review process. His regular AC report for CVPR 2021 has been well-received on academic Twitter and he is regularly asked to answer questions about the review process.
Cees G.M. Snoek (University of Amsterdam) is a full professor in computer science at the University of Amsterdam, where he heads the Video & Image Sense Lab. He is also a director of three public-private AI research labs: QUVA Lab with Qualcomm, Atlas Lab with TomTom and AIM Lab with the Inception Institute of Artificial Intelligence. He received the M.Sc. degree in business information systems (2000) and the Ph.D. degree in computer science (2005) both from the University of Amsterdam, The Netherlands. He frequently serves as an area chair of the major conferences in computer vision and multimedia. He is currently an associate editor for Computer Vision and Image Understanding and the IEEE Transactions on Pattern Analysis and Machine Intelligence.
Cess is an area chair for CVPR 2021 and ICCV 2021 and will talk about his experiences.
Dima Damen (University of Bristol) is a Reader (Associate Professor) in Computer Vision at the University of Bristol, United Kingdom. She received her PhD from the University of Leeds, UK (2009). Dima is currently an EPSRC Fellow (2020-2025), focusing on her re- search interests in the automatic understanding of object interactions, actions and activities using static and wearable visual (and depth) sensors. She was selected as a Nokia Research collaborator in 2016, and as an Outstanding Reviewer in CVPR2020, ICCV17, CVPR13 and CVPR12. Dima is a program chair for ICCV 2021 in Montreal, associate editor of IJCV (2020-), IEEE TPAMI (2019-) and Pattern Recognition (2017-).
Georgia Gkioxari (Facebook AI Research) is a research scientist at FAIR. She received her PhD from UC Berkeley in 2016, where she was advised by Jitendra Malik. She did her bachelors in ECE at NTUA in Athens, Greece in 2010, where she worked with Petros Maragos. Georgia also works as part of the African Master’s of Machine Intelligence at AIMS, an incentive which provides young Africans with state-of-the-art training in machine learning and its applications. Georgia has been awarded an outstanding reviewer award at CVPR 2017, has won the Marr Prize at ICCV 2017, has been an area chair for CVPR 2018-2020, and is a program chair for CVPR 2021.
David Forsyth (University of Illinois at Urbana-Champaign) is currently a full professor at the University of Illinois at Urbana-Champaign, where he has occupied the Fulton-Watson- Copp chair in Computer Science since 2014. Prior to UIUC, he was a full professor at UC Berkeley. David has served as program co-chair for CVPR in 2000, 2011, 2018, and 2021, general co-chair for CVPR 2006 and 2015, program co-chair for the ECCV 2008, and is a regular member of the program committee of all major international conferences on computer vision. David has served six years on the SIGGRAPH program committee, and is a regular reviewer for that conference. David has received best paper awards at ICCV and ECCV. David received an IEEE technical achievement award for 2005 for his research. He became an IEEE Fellow in 2009, and an ACM Fellow in 2014. David has served two terms as Editor in Chief for IEEE TPAMI.