Ongoing Research Projects
Ongoing Research Projects
Embedded Files
Real-Time Audio-Visual Music Information Processing for Interactive AI Performance System
Real-Time Audio-Visual Music Information Processing for Interactive AI Performance System
Supported by National Research Foundation of Korea (NRF)
Supported by Yamaha Music (2023-2026)
Publications
Publications
2025
2025
| Conferences & Workshops
| Conferences & Workshops
PianoVAM: A Multimodal Piano Performance DatasetYonghyun Kim, Junhyung Park, Joonhyung Bae, Kirak Kim, Taegyun Kwon, Alexander Lerch, and Juhan Nam
Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Predicting Flutist Onset Timing in Duet Performance: A Multimodal Analysis of Gesture and Breath CuesJaeran Choi, Taegyun Kwon, and Juhan Nam
Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Matchmaker: an Open Source Library for Real Time Piano Score Following and Systematic EvaluationJiyun Park, Carlos Eduardo Cancino-Chacón, Suhit Chiruthapudi, and Juhan Nam
Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Proceedings of the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Dialogue in the Resonance: a Piece for the Piano and the Real-time Automatic Music TranscriptionHayeon Bang, Taegyun Kwon, and Juhan Nam
Proceedings of the International Computer Music Conference (ICMC), 2025 [paper]
Proceedings of the International Computer Music Conference (ICMC), 2025 [paper]
| Abstracts and Late-Breaking/Demos
| Abstracts and Late-Breaking/Demos
Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering AnnotationJunhyung Park, Yonghyun Kim, Joonhyung Bae, Kirak Kim, Taegyun Kwon, Alexander Lerch, and Juhan Nam
Late Breaking Demo in the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Late Breaking Demo in the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Designing a Multimodal Viewer for Piano Performance Analysis - a Pedagogy-First ApproachJoonhyung Bae, Hyeyoon Cho, Kirak Kim, Dawon Park, Taegyun Kwon, Yoon-Seok Choi, Hyeon Hur, Shigeru Kai, Yohei Wada, Satoshi Obata, Akira Maezawa, Jaebum Park, Jonghwa Park, and Juhan Nam
Late Breaking Demo in the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
Late Breaking Demo in the 26th International Society for Music Information Retrieval Conference (ISMIR), 2025 [paper]
2024
2024
| Journals
| Journals
Towards Efficient and Real-Time Piano Transcription Using Neural Autoregressive ModelsTaegyun Kwon, Dasaem Jeong, and Juhan Nam
IEEE/ACM Transactions on Audio, Speech and Language Processing, 2024 [paper]
IEEE/ACM Transactions on Audio, Speech and Language Processing, 2024 [paper]
| Conferences & Workshops
| Conferences & Workshops
A Real-Time Lyrics Alignment System Using Chroma And Phonetic Features For Classical Vocal PerformanceJiyun Park, Sangeon Yong, Taegyun Kwon, and Juhan Nam
Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024 [paper]
Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024 [paper]
| Abstracts and Late-Breaking/Demos
| Abstracts and Late-Breaking/Demos
Matchmaker: A Python library for Real-time Music AlignmentJiyun Park, Carlos Cancino-Chacón, Taegyun Kwon, Juhan Nam
Late Breaking Demo in the 25th International Society for Music Information Retrieval Conference (ISMIR), 2024 [paper]
Late Breaking Demo in the 25th International Society for Music Information Retrieval Conference (ISMIR), 2024 [paper]
Real-time Flutist Gesture Cue Detection System for Auto-AccompanimentJaeran Choi, Taegyun Kwon, Joonhyung Bae, Jiyun Park, Yonghyun Kim, Juhan Nam
Late Breaking Demo in the 25th International Society for Music Information Retrieval Conference (ISMIR), 2024 [paper]
Late Breaking Demo in the 25th International Society for Music Information Retrieval Conference (ISMIR), 2024 [paper]
| Domestic
| Domestic
자동연주 피아노를 활용한 AI 공연 기술 (AI Performance Technology and Examples Using Self-Playing Piano)Sein Lee, Jaeran Choi, Jiyun Park, Taegyun Kwon, Juhan Nam
<공연예술문화연구 (Korean Journal of Research on Performing Arts and Culture)> 제3호, 국립극장 공연예술박물관, 2024 [paper]
<공연예술문화연구 (Korean Journal of Research on Performing Arts and Culture)> 제3호, 국립극장 공연예술박물관, 2024 [paper]
2023
2023
| Conferences & Workshops
| Conferences & Workshops
Automated Gap-filling Algorithm for Kinetic Data of Finger Movement: Pianist Hand Motion Cleaning Using Spatio-temporal ImputationTaegyun Kwon, Dawon Park, Joonhyung Bae, Jonghwa Park, Jaebum Park, and Juhan Nam
Proceedings of the 29th Congress of International Society of Biomechanics, 2023 [paper]
Proceedings of the 29th Congress of International Society of Biomechanics, 2023 [paper]
Multivariate Kinematic Analysis of Piano Performance: a Case Study of a Professional PianistDawon Park, Taegyun Kwon, Joonhyung Bae, Jonghwa Park, Juhan Nam, and Jaebum Park
Proceedings of the 29th Congress of International Society of Biomechanics, 2023 [paper]
Proceedings of the 29th Congress of International Society of Biomechanics, 2023 [paper]
Google Sites
Report abuse