Muhammad Yeza Baihaqi
PhD. Student at Nara Institute of Science and Technology
Research Assistant at Guardian Robot Project, RIKEN and Institute of Science Tokyo
I am a Ph.D. student in Information Sciences with a multidisciplinary background in Electrical Engineering, Automation, and Human-Centered AI. My research focuses on human-first social robotics, where I develop intelligent agents—especially dialogue robots—guided by social and psychological theories that prioritize human experience through grounded, explainable evaluation methods.
I have developed rapport-building dialogue strategies and oral test examiner robots capable of reducing student anxiety. These agents span a range of technologies—from rule-based systems to statistical models and LLM-based architectures. To evaluate these systems, I conduct multi-layered human evaluation frameworks that include subjective assessments (Likert, pairwise, thematic), behavioral observations, emotion recognition, and physiological analysis.
At the core of my work is the belief that social robots should not only function—but connect. I aim to build agents that are understandable, emotionally intelligent, and grounded in real human experience—moving beyond performance into meaningful interaction.
Research field: Social robotics, human-robot interaction, dialogue systems.
Educations:
Nara Institute of Science and Technology, Japan
Doctor of Philosophy - PhD, Information Sciences
Oct 2023 - Sep 2026 (Expectedly)
Research themes: Working on social robotics research
Supervisors: Prof. Koichiro Yoshino, Prof. Taro Watanabe
Laboratory: (1) Knowledge Acquisition and Dialogue Research Team, RIKEN. (2) Natural Language Processing Laboratory, NAIST.
National Taiwan University of Science and Technology, Taiwan
Master of Science - M.Sc, Graduate Institute of Automation and Control
Sep 2021 - Aug 2023
Research themes: Working on social robotics research
Supervisor: Prof. Sendren Sheng-Dong Xu
Laboratory: Intelligent System Laboratory
Teikyo University, Japan
Exchange program, Mechanical Engineering
Apr 2019 - May 2019
Research themes: Working on a Real Driving Test using JC08 for Nissan Serena
Supervisor: Prof. Akira Kato
President University, Indonesia
Bachelor of Engineering - B.Eng, Electrical Engineering
Sep 2016 - Aug 2020
Thesis title: Quasi-Dynamic Walking Optimization of Humanoid Robot Using Genetic Algorithm
Supervisor: Dr.-Ing. Erwin Sitompul, M.Sc.
Working Experiences:
Apr 2025 - Present Research Assistant, Institute of Science Tokyo, Tokyo, Japan.
Nov 2023 - Present Research Assistant, Guardian Robot Project, RIKEN, Kyoto, Japan.
Apr 2023 - Jul 2023 Teaching Assistant for Signal Processing Course, National Taiwan University of Science and Technology, Taipei, Taiwan.
Feb 2022 - Jul 2022 Teaching Assistant for Physics Course, National Taiwan University of Science and Technology, Taipei, Taiwan.
Jun 2021 - Oct 2021 Associate Information Technology Consultant, Deloitte, Jakarta, Indonesia
Mar 2021 - Jun 2021 Co-Project Manager, PT. Technova Optima Prima, Jakarta, Indonesia.
Mar 2020 - Mar 2021 IoT and Business Analyst, PT. Technova Optima Prima, Jakarta, Indonesia.
Jan 2019 - Apr 2019 Teaching Assistant for Linear Circuit Analysis 1 and 2, President University, Bekasi, Indonesia.
Publications:
International Journal:
A. Rospawan, C. L. Angelina, F. Samsuri, M. Y. Baihaqi, E. Halawa, et al, "Direct control strategy using polynomial fuzzy-based adaptive fractional order PID controller," Makara Journal of Technology, vol. 29, no. 2, pp. 90-100, September 2025.
M. Y. Baihaqi and S. S.-D. Xu, "Human behavioral, subjective, and physiological assessments under an oral test with a humanoid robot examiner," International Journal of Social Robotics, vol. 17, pp. 1-19, March 2025.
M. Y. Baihaqi and S. S.-D. Xu, "Impact of showing robot demonstration on introducing social robotics field to university students," International Journal of Humanoid Robotics, vol. 21, no. 2, pp. 1-23, December 2023.
S. S.-D. Xu, I. G. D. Pancev, and M. Y. Baihaqi, “Design and implementation of a 6LoWPAN-based lightweight wireless embedded platform for IoT applications,” Journal of Internet Technology, vol. 24, no. 2, pp. 323-332, March 2023.
E. Sitompul and M. Y. Baihaqi, “Quasi-dynamic walking optimization of humanoid robot using genetic algorithm,” International Journal of Artificial Intelligence, vol. 20, no. 1, pp. 24-45, March 2022.
International Conferences:
M. Y. Baihaqi, A. G. Contreras, S. Kawano, and K. Yoshino, "LLM-driven approach for motion control in human-robot dialogue for elevating engagement," in Proc. IEEE RO-MAN 2025, 2025. (Accepted)
M. Y. Baihaqi, A. G. Contreras, S. Kawano, and K. Yoshino, "Co-Speech motion for virtual agents in dialogue using LLM-driven primitive action selection," in Proc. INTERSPEECH 2025, 2025. (Accepted)
M. Y. Baihaqi, A. G. Contreras, S. Kawano, and K. Yoshino, "Rapport-building dialogue strategies for deeper connection: Integrating proactive behavior, personalization, and aizuchi backchannels," in Proc. INTERSPEECH 2025, 2025. (Accepted)
M. Y. Baihaqi, "Social agents for positively influencing human psychological states," in Proc. Workshop of Young Researchers' Roundtable on Spoken Dialogue Systems, Kyoto, Japan, September 16-17, 2024.
M. Y. Baihaqi, A. G. Contreras, S. Kawano, and K. Yoshino, "Rapport-driven virtual agent: Rapport building dialogue strategy for improving user experience at first meeting," in Proc. INTERSPEECH 2024, Kos, Greece, September 1-5, 2024.
V. A. Samor, M. Y. Baihaqi, E. Halawa, L. R. M. Asvinigita, S. N. Hakim, and M. S. Rofika, "Evaluating LLMs as pharmaceutical care decision support tools across multiple case scenarios," in Proc. International Conference on Medical Sciences and Health, Lampung, Indonesia, August 7-8, 2024.
A. A. Christian, M. Y. Baihaqi, and S. S.-D. Xu, "Retrospective and prospective approach innovations of masked face recognition," in Proc. International Conference on System Science and Engineering, Ho Chi Minh City, Vietnam, July 27-28, 2023.
M. Y. Baihaqi and S. S.-D. Xu, “The past and future of the fuzzy technique in social robots,” in Proc. International Conference on Fuzzy Theory and Its Applications, Kaohsiung, Taiwan, November 3-6, 2022.
M. Y. Baihaqi and S. S.-D. Xu, “Seven stages of action for the interaction design of the customer service of a robot in a shopping mall,” in Proc. International Conference on Advanced Robotics and Intelligent Systems, Taipei, Taiwan, August 24-27, 2022.
M. Y. Baihaqi and S. S.-D. Xu, “A survey on practical applications of small robots as social robots,” in Proc. International Conference on System Science and Engineering, Taichung, Taiwan, May 26–29, 2022.
M. Y. Baihaqi, V. Vincent, and J. W. Simatupang, “Real-time hand gesture recognition for humanoid robot control using python CVZone,” in Proc. International Conference on Networking, Information Systems & Security, Bandung, Indonesia, March 30-31, 2022.
Non-Peer-Reviewed Japan-Domestic Conference
M. Y. Baihaqi, A. G. Contreras, S. Kawano, and K. Yoshino, "Exploring user feedback: A thematic and sentiment analysis of user interactions with LLM-based dialogue robots," in Proc. ANLP 2025, Nagasaki, Japan, March 10-14, 2025.
M. Y. Baihaqi, A. G. Contreras, S. Kawano, and K. Yoshino, "Comparing Likert scale and pairwise comparison for human evaluation in rapport-building dialogue systems," in Proc. SIG-SLP/NL 2024, Nagoya, Japan, December 12-14, 2024.
Research Presentation in Japanese
M. Y. Baihaqi, A. G. Contreras, S. Kawano, and K. Yoshino, "Positive Initial Interaction: Rapport-Building Dialogue Strategies to Enhance User Experience with Virtual Agents," in Kansai Joint Speech Seminar, Shiga, Japan, July 2024.
Peer-reviewed Indonesian Journal:
M. Y. Baihaqi, E. Halawa, R. A. S. Syah, A. Nurrahma, and W. Wijaya, "Emotion classification in Indonesian Language: A CNN approach with hyperband tuning," Jurnal Buana Informatika, vol. 14, no. 2, pp. 137-146, November 2023. Sinta 3 Journal.
M. Y. Baihaqi, V. Vincent, and J. W. Simatupang, “Humanoid robot application as COVID-19 symptoms checker using computer vision and multiple sensors,” ELKHA: Jurnal Teknik Elektro, vol. 13, no. 2, pp. 105-112, October 2021. Sinta 3 Journal.
M. Y. Baihaqi, C. W. D. Lumoindong, and V. Vincent, “Simulasi perbandingan filter savitzky golay dan filter low pass butterworth pada orde ketiga sebagai pembatal kebisingan,” Jurnal Konstelasi, vol. 1, no.2, pp. 226-232, April 2021 (in Indonesian). Sinta 4 Journal.
M. Y. Baihaqi and W. Wijaya, “Penerapan filter kalman untuk meningkatkan akurasi dan presisi sensor suhu LM35,” Jurnal Konstelasi, vol. 1, no. 1, pp. 93-101, April 2021 (in Indonesian). Sinta 4 Journal.
M. Y. Baihaqi, W. Wijaya, M. A. R. Widyoko, and T. Wikaningrum, “The prospect of using smart dustbin for reducing garbage pickup time (a simulation in Padang city),” Journal of Environmental Engineering and Waste Management, vol. 3, no. 2, pp. 61-67, October 2018. Sinta 5 Journal.
Peer-reviewed Indonesian-Domestic Conference
M. Y. Baihaqi, C. W. D. Lumoindong, and A. Suhartomo, “Development of fiber loss calculator based on Visual Basic and MATLAB,” in Proc. Seminar Nasional Microwave, Antenna, and Propagation, Bandung, Indonesia, October 2, 2019.
M. Y. Baihaqi and M. Galina, “Comparative analysis on blocking probability of PLMN and PSTN,” in Proc. Seminar Nasional Energi dan Teknologi, Bekasi, Indonesia, June 19, 2019.
M. Y. Baihaqi and J. W. Simatupang, “Aplikasi metode kontrol bluetooth pada robot humanoid berbasis Arduino Mega 2560,” in Proc. Seminar Nasional Energi dan Teknologi, Bekasi, Indonesia, June 7, 2018 (in Indonesian).
Reviewer Experiences:
Sep 2024 - Present IEEE/ACM Transactions on Audio, Speech, and Language Processing, IEEE, 5 reviews.
Apr 2024 - Present IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, IEICE, 1 review.
Apr 2024 - Present International Journal of Control, Automation and Systems, Springer, 5 reviews.
Feb 2024 - Present International Journal of Fuzzy Systems, Springer, 13 reviews.
Jan 2024 - Present Neural Processing Letters, Springer, 1 review.
Aug 2023 - Present IEEE Transactions on Industrial Informatics, IEEE, 18 reviews.
Scholarships and Grants:
MEXT Scholarship for Ph.D. Studies (airplane ticket, tuition fee and living cost scholarship) (2023).
NTUST Scholarship for Master's Studies (tuition fee and living cost scholarship) (2021).
Exchange Study Scholarship, Sakura Science Program JST to Teikyo University, Tokyo, Japan (2019).
Republic of Indonesia Ministry of Education and Culture PPA Scholarship (living cost scholarship) (2019).
President University Scholarship for Bachelor's Studies (tuition fee scholarship) (2016).
Academic Achievements:
National Taiwan University of Science and Technology, College of Engineering, excellent student (2023).
National Taiwan University of Science and Technology, College of Engineering, outstanding student (2023).
National Taiwan University of Science and Technology, College of Engineering, Graduate Institute of Automation and Control, excellent student (2023).
Best Poster at International Conference on Networking, Information Systems, and Security (2022).
Speaker at Campus Corner held by PPI Taiwan (2022).
Speaker at Electrical Engineering Night held by President University (2021).
Employee of the Year at Technova Optima Prima, PT (2020).
The Best Presenter at the National Seminar of Technology and Information Systems (2020).
The Best Paper at National Seminar of Technology and Information Systems (2020).
Top three students of the Faculty of Engineering, President University (2020).
Best graduate with the highest CGPA for the Electrical Engineering Study Program, Faculty of Engineering, President University (2020).
1st place winner of the Research Poster and Presentation at President University (2018).
Non-Academic Achievements:
2nd place winner of the 24th Annual Japanese Speech Contest for International Students (2024).
Speech Title: 未来をつくるロボットたち:ソーシャルロボティクスの挑戦と展望
(Robots Creating the Future: Challenges and Prospects of Social Robotics).
Computer Software:
Visual Studio Code
XAMPP.
CX Developer & GX Developer.
Dev C++ & Visual Studio (C++/C).
Arduino IDE & STM32Cube IDE.
Netbeans (Java).
MATLAB & Simulink.
Pycharm (Python).
Proteus & Fritzing.
SolidWorks.
SPSS.
Draw.io.
Trainings and Certificates:
Machine Learning: Natural Language Processing in Python V2 (2023).
Questionnaire Design by Science Hunter (2022).
Cloud Foundations by AWS (2022).
Introduction to AWS by AWS (2021).
Introduction to Data Science with R by DQ Lab (2020).
Introduction to Data Science with Python by DQ Lab (2020).
IBM Cloud Pak for Data V2.1.x Data Steward by IBM (2020).
IBM Cloud Pak for Data V2.1.x Data Governance by IBM (2020).
IBM Cloud Pak for Data V2.1.x Essential by IBM (2020).
MATLAB for Data Analysts by Goritma Tech (2020).
Basic MATLAB by Goritma Tech (2020).
Mitsubishi PLC Training by Dharma Group (2019).
Computer Vision Training by Cognex Machine Vision (2019).
Omron PLC Training by Omron Electronics (2019).
Pneumatics Training by Festo Pneumatics (2019).
Collaborative Robotic Arm Training by Dharma Precision Tools (2019).
Arduino and Sensor Training by President University (2018).
Computer Application Training (Website Programming & VB) by Computer Division Salib Suci Foundation (2016).
Industrial Projects:
Road map implementation of smart villages and technology-ready society for underdeveloped regions in Indonesia (2021).
Medical machine monitoring system for Fujifilm, PT. (2020).
Smart delivery order system for fast food restaurants (2020).
Smart city and smart home projects (2020).
Engine storage project for Toyota Motor Manufacturing Indonesia, PT. (2019).
Coolant monitoring system for Toyota Motor Manufacturing Indonesia, PT. (2019).
Automatic barcode generator for Dharma Polimetal, PT. (2019).
JC08-based real driving tests using Nissan Serena 2008 in Utsunomiya City (2019).
Language:
Bahasa Indonesia (Native).
English (TOEIC: 945)
Japanese (Enough for paper presentation)