ABS4IRE
Agent-Based Simulation for Information Retrieval Evaluation
The project
This project aims at studying the use of agent-based simulation for solving problems posed by standard evaluation methods of IR systems, in particular their frequent ignorance of human factors involved, and the lack of human subjects.
Falk Scholer will be visiting UGA (MAGMA team, LIG) from April to May 2016 with a UJF visiting grant.
Pour participer à notre enquête, cliquez sur ce lien. Merci !
Study ethics approval was obtained on July 20 (CERNI, COMUE Université Grenoble Alpes, IRB00010290).
Falk Scholer
Dr Falk Scholer is an Associate Professor at RMIT University in Melbourne, Australia. He is an active researcher in the field of information retrieval (IR), where his key interests include: the evaluation of search systems; relevance and user perceptions; interactive search and user modelling; document summarisation; and efficient indexing.
One key focus of Falk's research has been the effectiveness measurement of retrieval systems. His work has demonstrated that performance results based on test collections -- the most widely-used IR evaluation framework -- often don't reflect the search performance of users carrying out real-world search tasks. Subsequent studies have examined factors that contribute to this mismatch, including variability in user behaviour and human factors, search context, and issues around the concept of relevance and the judging process.
At RMIT University, Falk teaches courses on information retrieval, web programming, databases, and file structures. He currently supervises 5 PhD students in the information retrieval area. He is the deputy chair of the RMIT Science, Engineering and Health ethics review board, and is particularly interested in the implications of new technologies such as crowd sourcing on research that includes human participants.