IR Questioner: QA-based interactive retrieval system

Abstract

Image retrieval from a given text query (text-to-image retrieval) is one of the most essential systems, and it is effectively utilized for databases on the Web. To make them more versatile and familiar, a retrieval system that is adaptive even for personal DBs such as images in smartphones and lifelogging devices should be considered. In this paper, we present a novel text-to-image retrieval system that is specialized for personal DBs. With the cross-modal scheme and the question-answering scheme, the developed system enables users to obtain the desired image effectively even from personal DBs.

Demo

Our demo will be released soon

Publications

・R. Yanagi, R. Togo, T. Ogawa and M. Haseyama, “IR Questioner: QA-based interactive retrieval system,” ACM International Conference on Multimedia Retrieval (ICMR), Taiwan, 2021. (Accepted)

・R. Yanagi, R. Togo, T. Ogawa and M. Haseyama, “Interactive re-ranking for cross-modal retrieval based on object-wise question answering,” in Proceedings of 2020 ACM International Conference on Multimedia in Asia (ACMMM asia 2020), 2020, (accepted for publication), Best Paper Runner-up Award.

Presentation Video (Pass: 0ZhjBfPq, ACMM Asia 2020 official password)

Bibtex

@inproceedings{yanagi2021ir,

title={IR Questioner: QA-based interactive retrieval system},

author={Rintaro, Yanagi and Ren, Togo and Takahiro, Ogawa and Miki Haseyama},

booktitle={ICMR},

year={2021}

}

@inproceedings{yanagi2020interactive,

title={Interactive re-ranking for cross-modal retrieval based on object-wise question answering},

author={Rintaro, Yanagi and Ren, Togo and Takahiro, Ogawa and Miki Haseyama},

booktitle={ACMMMAsia},

year={2020}

}