I’m currently involved in two research projects: one with Prof. Pushpendra Singh (IIIT Delhi) and Prof. Mohan Kumar (Rochester Institute of Technology), on developing HCAI solutions for mental health using wearables and emotional data. The second, started in August 2024, is a collaboration with Prof. Mukesh Mohania (IIIT Delhi) is on contextually aware citation recommendation algorithms for research papers.
EEVR (Emotion Elicitation in Virtual Reality) is a novel dataset for emotion recognition tasks, combining physiological signals (EDA, PPG) from 360-degree VR videos with emotional descriptions from semi-structured qualitative interviews. Featuring data from 37 participants, it pairs text with signals, offering richer context for emotion classification. We also introduce the Contrastive Language Signal Pre-training (CLSP) algorithm, which enhances emotion recognition by learning from both signals and text. Our results show improved performance over baseline models and strong zero-shot transferability, demonstrating the effectiveness of contextualized learning.
The proof-of-concept paper examines the growing interest among children in evaluating diverse interactive elements through a book on the Indian freedom struggle. I contributed to a research project on designing virtual and augmented reality tools. I used visual projection mapping and gesture tracking to build interactive learning experiences for children
Springer series ACM India-HCI 2023
Developing a mental health tracker based on physiological signals, such as EDA and PPG, and user textual input; managing datasets; developing new benchmarks and foundational strategies and algorithms for emotion prediction models for stress and emotional analysis.
Melange Lab, IIIT-DELHI February'24 - Present
Developing an automated citation recommendation system that exploits the local and global context by the FASIS-based RAG architecture, which implies context-aware entity matching for relevant suggestions.
Data Science Lab, IIIT Delhi August'24 - Present
I have developed a gesture-tracking game with child-specific stimuli to augment educational outcomes. Using RAGs and Realsense deep motion, the project greatly enhanced children's learning and interest, particularly with regard to learning Hindi.
Creative Interface Lab, IIIT Delhi September'23 - May'24
Developed a CI/CD pipeline chatbot for power grid woekers, leveraging RAG-based framework, and optimized ML & NLP algorithms.
E.ON Digital Technology June'24 – August'24
Designed and deployed an automated Microsoft Azure pipeline, increasing task-specific image classification efficiency to 95% and reducing computational overhead by 5%.
E.ON SE June'23 – August'23