Debaditya Roy - Sponsored Projects

Sponsored Projects

Egocentric Memory Assistant: Scalable Vision-Language Model with Hierarchical Memory and Visual Chain-of-Thought Reasoning

Principal Investigator

2026-2029

Funded by – PMECRG, ANRF (72,00,000) and FSRG, IITKGP (25,00,000)

A hierarchical memory framework for storing long interaction histories using Frequently-Interacted Object (FIO) tables with multi-resolution, question-aware multi-level summaries, a dialogue-grounded egocentric VLM for temporally coherent reasoning, and a Visual Chain-of-Thought (V-CoT) module for transparent, provenance-backed responses. Together, these innovations enable scalable, interpretable, and trustworthy query answering, benchmarked on EgoLife dataset.

AMRIT: AI for Metabolic Resistance

Co-Principal Investigator

2026-2027

Funded by – IITKGP (10,00,000)

M2Smart: Smart city with multimodal regional traffic information

Member

2018-2020

Funded by – JICA and JST

Developed a dataset called SkyEye for analyzing lane-less traffic behavior at intersections.

Published 3 papers in IEEE ITSC and IEEE Transactions on ITS

Deep Learning based Tracker on Embedded Hardware

Member

2017

Funded by – RCI, DRDO

Developed a real-time tracking algorithm for aerial tracking in IR streams and deployed on an embedded platform (NVIDIA Jetson TX-1). [code]

test.avi

Multi-stage aerial tracking

Member

2016

Funded by - RCI, DRDO

Developed a multi-stage deep learning based tracking algorithm for rapidly descending projectiles.

output.mp4

Transportation Flow Modelling and Visualisation for Disaster Management Applications

2015

Funded by - ANURAG, DRDO

Developed a macro evacuation model for a city with real-time visualization of safe routes to be taken in case of emergency. [code]

test-2017-07-04_10.52.27.mp4

Page updated

Google Sites

Report abuse