CryptOQA

About This Task

We are thrilled to announce the CryptoQA track, hosted by the Indian Institute of Technology, Kharagpur and the Indian Institute of Science Education and Research, Kolkata, at FIRE 2026 – the 18th annual meeting of the prestigious Forum for Information Retrieval Evaluation.

The CryptoQA track aims to identify different categories of posts published on social media related to CryptoCurrencies. Further, it will try to find out the answers for CryptoCurrency related questions.

This track presents a unique opportunity for researchers, students, and professionals to showcase their expertise in IR, natural language processing, and machine learning. Join us at FIRE 2026 and be part of this exciting endeavor. We look forward to your participation and contributions to this exciting track! 

Task Details

Task 1: Opinion Classification from CryptoCurrency-related Social Media Posts 

Classify social media posts into either subjective or objective categories.

Task 2: Question Answering from CryptoCurrency-related Social Media Post

The task uses two data sources:

• Reddit: given a set of question-comment pairs collected from reddit, the task is to identify the relevance of the comment with respect to a given set of cryptocurrency-related social media posts.  

• YouTube: given a set of questions with their source video transcripts, there are two sub-tasks:

1. Open-Ended Text Generation: generate the answer to each question from the transcript.

2. Multiple Choice (MCQ): select the correct option (1 of 4) for each question.

About the Organizers

Indian Institute of Technology Kharagpur (IIT Kharagpur) is a public institute of technology and research university, an autonomous institute established by the Government of India in Kharagpur, West Bengal. Established in 1951, the institute is the first of the IITs to be established and is recognized as an Institute of National Importance. In 2019 it was awarded the status of Institute of Eminence by the Government of India. IIT Kharagpur is ranked among the most prestigious academic institutions in India.

Indian Institute of Science Education and Research Kolkata (IISER Kolkata) was established in 2006 by the Ministry of Human Resource Development (now Ministry of Education), Government of India. IISER Kolkata is an autonomous institution awarding its own degrees. The central theme of the IISER Kolkata is to integrate education with research so that undergraduate teaching as well as doctoral and postdoctoral research work could be carried out in basic sciences. In 2022, it was ranked fourth among the academic institutions in India by the Nature Index in 2022.