[Project page]

PROJECTS (Research Portfolio)

Flagship Research Initiatives

1. Multimodal Sign Language AI (2018-2025)
- Multimodal sign language recognition system

Technical Innovations:

• Hybrid architecture combining 3D CNNs with temporal attention mechanisms

• Novel data augmentation techniques for limited sign language datasets

• Multi-modal fusion of visual and inertial sensor data

Applications:

• Educational tools for deaf communities

• Real-time interpretation services

• Automated sign language content generation

2. DDC3N: Doppler-Based Action Recognition (2022-2024)
- Contactless human activity monitoring using RF signals

Key Features:

• Micro-Doppler signature analysis

• 3D convolutional neural network architecture

• Privacy-preserving implementation

Deployments:

• Elderly care facilities (fall detection)

• Smart home systems

• Healthcare monitoring

3. Generative Models for Facial Animation (2020-2023)
- Creating realistic and controllable 3D facial avatars

Methodologies:

• Style-based GAN architectures

• Emotion-preserving voice-to-face synthesis

• Cross-identity expression transfer

Applications:

• Virtual assistants

• Digital avatars for accessibility

• Entertainment industry

Publications List

SCIE Journal Articles:

• Toshpulatov, M., et al. (2024). "Hyperspectral Anomaly Detection with Enhanced Spectral Graph Transformer Network ". IEEE Access, 12, 9546-9567. [Impact Factor: 4.82]

• Toshpulatov, M., Lee, W., & Lee, S. (2025). "Deep learning pathways for automatic sign language proessing ". Pattern Recognition, 164, 111475. [Impact Factor: 9.32] 

• Toshpulatov, M., et al. (2024). "DDC3N : Doppler-Driven Convolutional 3D Network for Human Action Recognition ". IEEE Access, 12, 93546-93567. [Impact Factor: 4.82]

-- Open-source implementation: https://github.com/muxiddin19/DDC3N

• M Toshpulatov, W Lee, S Lee, Talking human face generation: A survey , Expert Systems with Applications, 2023. [Impact Factor: 9.29]

• M Toshpulatov, W Lee, S Lee, A H. Roudsari, Human pose, hand and mesh estimation using deep learning: a survey , The Journal of Supercomputing, 2022. [Impact Factor: 3.96]

• M Toshpulatov, W Lee, S Lee, Generative adversarial networks and their application to 3D face generation: A survey , Image and Vision Computing, Elsevier, 2021. [Impact Factor: 4.3]

International Conference Papers:

• Toshpulatov, M., et al. (2024). "Human Action Recognition Utilizing Doppler-Enhanced Convolutional 3D Networks ". Proceedings of BigComp 2024.  

• Toshpulatov, M., et al. (2024). "A Novel Scholarly Approach to Action Recognition: A CNN Architecture Enhanced with Innovative Preprocessing Techniques ". Proceedings of BigDAS 2024., Best Paper Award recipient

• Toshpulatov, M., et al. (2024). "Voice Cloning with Minimal Samples ". Proceedings of BigComp 2024.

• Toshpulatov, M., et al. (2022). "Privacy-preserving of human identification in CCTV data using a novel deep learning-based method ". Proceedings of BigComp 2022., Best Paper Award recipient

• Toshpulatov, M., et al. (2020). "Research Issues on Generative Adversarial Networks and Applications. ". Proceedings of BigComp 2024.

Local Conference Papers:

• YR Mixlievich, Toshpulatov, M. (2014). "Linguistic Modelling of the Theory of Indistinct Selections as the Basis of the Assessment of Quality of Education" 정보화연구 (구 정보기술아키텍처연구) 11 (2), 125-130 

• T Mukhiddin, W Lee, N Maftuna, J Jamoliddin, I Ziyoda (2024) "The Language of Silence: A Deep Dive into Interpretable Sign Language Recognition " 한국정보과학회 학술발표논문집, 129-131

• Toshpulatov M., Tursunboyev (2024) "Tracking and Rotational Cycle Detection of Micro-Objects via YOLOv8 and Grid-Based Approach " KSC2024, https://ksc2024.kiise.or.kr/proceedings/

• Toshpulatov Mukhiddin, Wookey Lee, Narzullaeva Maftuna, Jabborov Jamoliddin (2024)"The Language of Silence: A Deep Dive into Interpretable Sign Language Recognition " KSC2024, https://ksc2024.kiise.or.kr/proceedings/

• Toshpulatov Mukhiddin (2024) "Recent Technological and Theoretical Advances in Sign Language Studies " The 6th Artificial Intelligence and Big Data Model 6 (1), 73

• U Asatullaev, T Mukhiddin, C Tursunbaev, BC Nguyen, W Lee (2024) "Deep-CSRNet: Crowd-Flow Monitoring and Risk Assessment in Dense Scenes using drones"  한국정보과학회 학술발표논문집, 1248-1249

• M Toshpulatov, W Lee, C Tursunbaev, A Nirmal, B Toshboev (2024) "Streamlining Computational Complexity: A Novel Data Processing Approach for Enhanced 3DCNN Performance in Human Action Recognition" 한국정보과학회 학술발표논문집, 107-109

• W Lee, M Toshpulatov, U Asatullaev, O Tursunboyev (2024) "A Study on a Detection of Multi Object Trajectory of Soft Robotics using Deep Learning Visual Exploration" 한국정보과학회 학술발표논문집, 672-674

• Tursunbaev Chingiz , Mukhiddin Toshpulatov, Wookey Lee (2024) "A Study on a Detection of Multi Object Trajectory of Soft Robotics using Deep Learning Visual Exploration" KCC2024 3 (1), 19-42

• Mukhiddin Toshpulatov, Chingiz Tursunbaev (2024) "Streamlining Computational Complexity: A Novel Data Processing Approach for Enhanced 3DCNN Performance in Human Action Recognition" KCC2024 3 (1), 73

• Ubaydullo Asatullaev, Toshpulatov Mukhiddin, Chingiz Tursunbaev, Bui Cong ... (2024) "Deep-CSRNet: Crowd-Flow Monitoring and Risk Assessment in Dense Scenes using drones" KCC2024 1 (3), 73

• Toshpulatov Mukhiddin (2024) "Motion Embedded Convolutional 3D Networks for Effective Human Action Recognition" INNOVATIVE TECHNOLOGIES IN THE DIGITALIZED ENVIRONMENT OF HIGHER EDUCATION …

• SK Mukhiddin Toshpulatov (Inha University, South Korea), Wookey Lee (Inha ... (2024) "Human Action Recognition Utilizing Doppler-Enhanced Convolutional 3D Networks" 2024 IEEE International Conference on Big Data and Smart Computing (BigComp …

• Mukhiddin Toshpulatov, Wookey Lee, Suan Lee, Hoyoung Yoon (2024) "Efficient 3D CNNs with Doppler Enhancement for Accurate Human Action Recognition" Global Journal of Computer Science and Technology 23 (3), 19-42

• Mukhiddin Toshpulatov, Wookey Lee (2024) "Doppler-Augmented Convolutional 3D Networks for Robust Human Motion Recognition" XVoice, 6th AI+DB workshop, Sookmyung Women’s University (Myeongshin Hall …

• Mukhiddin Toshpulatov (2023) " Athletes' action recognition through skeleton-based human pose estimation and 3D convolutional networks." System Engineering Conference 2023, South Korea

• Mukhiddin Toshpulatov, Wookey Lee (2023) "Recognition of athletes' actions through skeleton-based human pose estimation methods" The 3rd X-Voice Workshop and Voice AI Symposium

• UK Toshpulatov Mukhiddin, Asatullayev Ubaydullo, Wookey Lee. Park Woojin (2022) "Action prediction of sports athletes through deep learning based human pose estimation tools"2022 INHA BK21 & MRC International Symposium

• SL Ubaydullo Asatullaev, Toshpulatov Mukhiddin, Chang Seon Park, MinJi Kwon ... (2022) "Human Pose Estimation with Deep Neural Network for Joint Points Prediction" The 5rd Artificial Intelligence and Big Data Model Workshop 2022, Sejong …

• SL Toshpulatov Mukhiddin, Ubaydullo Asatullaev, Chang Seon Park, MinJi Kwon ... (2022) "Solving classification problem of athletes' actions through novel deep learning based human pose estimation methods" The 3rd Artificial Intelligence and Big Data Model Workshop 2022, Inha …

• SL Bea Keewoong, Mukhiddin Toshpulatov, Wookey Lee (2024) "Bimodal Classification with CNN and Sequence Models" Transactions on Computational Science & Computational Intelligence 5 (3), 100

• Ubaydullo Asatullaev, Toshpulatov Mukhiddin (2022) "Synthesizing Talking Face Animation with order Motion" Korea Computer Congress, KCC 2022 5 (5), 100

• WL Toshpulatov Mukhiddin, Ubaydullo Asatullaev, Chang Seon Park, MinJi Kwon (2022) "Classification of Athletes actions through Deep Learning based Human Pose Estimation methods" ICT for Sustainable Development of Uzbekistan, 26-27 July, 2022 y. 5 (3), 100

• Ubaydullo Asatullaev, Toshpulatov Mukhiddin, Chang Seon Park, MinJi Kwon (2022) "Animatronics for Synthesized Speaking with Generative Adversarial Network" ICT for Sustainable Development of Uzbekistan, 26-27 July, 2022 y. 1 (3), 73

• U Asatullaev, T Mukhiddin, W Lee (2022) "Synthesizing Talking Face Animation with order Motion" 한국정보과학회 학술발표논문집, 270-272

• Toshpulatov Mukhiddin (2021) "Deep Learning-based Human face privacy-preserving in CCTV video data" 제 2 희 BMSE Research Fair 3 (5), 130

• WL Toshpulatov Mukhiddin (2020) "Deep Learning-Based Human Pose Estimation" 제 1 희 BMSE Research Fair 5 (5), 220

• Mixlievich, Toshpulatov M. (2014) "Linguistic Modelling of the Theory of Indistinct Selections as the Basis of the Assessment of Quality of Education" 정보화연구 (구 정보기술아키텍처연구) 11 (2), 125-130

• Yusupov R.M., Tavboyev S.A., M.Tashpulatov (2014) "Linguistic Modeling of the Theory of Indistinct Sets as the Basis of the Estimation of Quality of Formation" “Young scientist USA”, Applied science 23 (3), 22-27

• MA Toshpulatov, S Lee, W Lee, J Jun (2011) "Survey of Deep Learning-Based Automatic Sign Language Processing" Available at SSRN 4990875

Key Note Speeches and Invited Talks

• ICT for Sustainable Development of Uzbekistan, 26-27 July, 2022 y. Sambhram university, Djizakh, Uzbekistan.

• INNOVATIVE TECHNOLOGIES IN THE DIGITALIZED ENVIRONMENT OF HIGHER EDUCATION: PROBLEMS AND SOLUTIONS-2024, 11-12 Mart, 2024 y. Djizakh Polytechnical Institute, Djizakh, Uzbekistan.

• “ACTUAL PROBLEMS AND SOLUTIONS IN THE FIELD OF DIGITALIZATION OF THE HIGHER EDUCATION SYSTEM” international scientific and practical CONFERENCE, 21-22 Fevral, 2025 y. Djizakh Polytechnical Institute, Djizakh, Uzbekistan.

• "Development of Digital Technologies and Innovative Engineering Solutions: Modern Trends and Prospects", 17-18-april 2025 y. Tashkent Institute of Management and Economics, Tashkent, Uzbekistan

Paper Reviewing

International Scientific Conference and Journals

• IEEE Access

• Big Data Computing Conference

• Image and Vision Computing

• The Journal of Supercomputing

• Expert system and Applications

• Journal of the Kosse

• International Conference on Computer Science and Application Engineering

• Global Journal of Computer Science and Technology, USA

• Social and Personality Psychology Compass

• International Journal of Cognitive Computing in Engineering

• International Journal of Machine Learning and Cybernetics 

• CMC-Computers, Materials & Continua 

• The Visual Computer, Springer Nature 

• Signal, Image and Video Processing