Projects

[Ongoing Research]

Conditional Flow Matching (CFM) models for text-to-speech often generate mel-spectrograms with unstable frequency evolution—low-frequency components grow too quickly while high-frequency details lag behind. This project introduces a training-free, frequency-selective boosting technique that dynamically adjusts spectral sub-bands during ODE integration using the Discrete Wavelet Transform (DWT). By enhancing lagging frequencies and tempering overly dominant ones, the method stabilizes the generative process and improves audio quality. Integrated with F5-TTS and Voicebox, it achieves significantly better perceptual quality (Frechet Audio Distance) without sacrificing intelligibility (Word Error Rate), offering a new level of control over CFM-based TTS generation.

[Work under review]

This supervised RnD exposition project investigates the use of automatic music transcription (AMT) techniques for monophonic Western and Carnatic guitar melodies. It examines core AMT components—onset detection, pitch estimation, note tracking, and technique recognition—focusing on expressive articulations such as slides, bends, vibrato, hammer-ons, and pull-offs. A dedicated dataset of recorded guitar articulations, complemented by publicly available Carnatic performances, supports a systematic evaluation of established methods including spectral-flux onset detection, probabilistic pitch estimation, and the TENT framework. While current approaches perform reliably for Western guitar, they struggle with the rapid slides and microtonal nuances characteristic of Carnatic style. The project highlights key limitations in existing AMT systems and emphasizes the need for algorithms that more effectively capture stylistic subtleties across diverse musical traditions.

Project lead, maintainer, and principal contributor for 3 years to one of the most critical applications of IIT Bombay, recording 4,000,000+ meals at 14+ hostels and 10+ devices, with 13,000+ daily active users.

MongoGBackup

Python package for automated encrypted MongoDB backups on Google Drive

InstiApp

IIT Bombay's one-stop application - from daily events to jobs and internships

RFID-based Inventory Management System

End-to-end handheld hardware-software system for robust inventory management and tracking