Human-Media Laboratory
The Best Science for Better Lives
Embedded Files
Our lab is interested in working with IoT systems and Data Analysis based on Artificial Intelligence.
Internet of Things (IoT) sensors, including robots, detect massive data flows in real-time in manufacturing, medical, aerospace, defense(military), transportation, smart cities, agriculture, fisheries, and artificial intelligence (AI) analyze patterns to provide users with the necessary intelligence.
로봇을 포함한 사물인터넷(IoT) 센서를 사용하여 헬스케어, 문화, 수산업, 방위, 운송, 제조, 항공우주, 스마트시티, 농업 분야 등에서 거대한 데이터흐름을 실시간으로 감지하고, 이 데이터를 분석하여 사용자에게 필요한 지능을 제공하기 위해 인공지능(AI) 모델 개발/개선 및 활용을 연구/개발
Research
Research
Research Interests
News
News
Eashita Wazed, Jimin Lee, Hieyong Jeong, "Deep learning for heart sound abnormality of infants: Proof of conceptual study of 1D and 2D representations," children, 2025 (https://doi.org/10.3390/children12091221).
Science Citation Index Expanded (Clarivate Analytics))
Woojae Kim, Myoungjae Jun, Yeong-Jun Cho, and Hieyong Jeong, "Time-Series Decomposition Model combined with pre-trained LSTM: Real-time prediction of dissolved oxygen concentration suitable for automated aquaculture feeding system," International Journal of Data Science and Analytics, 2025 (https://doi.org/10.1007/s41060-025-00826-8).
Science Citation Index Expanded (Clarivate Analytics))
Thi-Oanh Ha, Huong-Giang Doan, and Hieyong Jeong, "EEG-based Eye Tracking with Combination of Self-Attention and Long-Short-Term Memory Model," IEEE International Conference on Advanced Visual and Signal-Based Systems (AVSS 2025), August 11~13, 2025, Tainan, Taiwan.
(Computer Science Top-Tier Conference, IF: 1)
Thi-Oanh Ha, Huong-Giang Doan, and Hieyong Jeong, "Heart Disease Classification using FusionNet to Extract Spatiotemporal Features from ECG Signal," IEEE International Conference on Advanced Visual and Signal-Based Systems (AVSS 2025), August 11~13, 2025, Tainan, Taiwan.
(Computer Science Top-Tier Conference, IF: 1)
Hang Thi Phuong Nguyen and Hieyong Jeong, "Capillary Dataset: A dataset of nail-fold capillaries captured by microscopy for diabetes detection," 31st SIGKDD Conference on Knowledge Discovery and Data Mining (ACM KDD 2025) - Datasets and Benchmarks Track, August 3~August 7, 2025, Toronto, ON, Canada.
(Computer Science Top-Tier Conference, IF: 4).
박현주, 정희용 "임베딩 부분 공간의 유사도 분석을 통한 이미지 분류", 2025 한국스마트미디어학회 & 한국전자거래학회 춘계학술대회, 2025년 5월 1일~3일, 중앙대학교 100주년기념관.
김보경, 정희용 "적응형 모델 선택기능: 메타 학습과 강화 학습 기반 사전 훈련 모델 최적화 접근법", 2025 한국스마트미디어학회 & 한국전자거래학회 춘계학술대회, 2025년 5월 1일~3일, 중앙대학교 100주년 기념관.
김찬규, Nguyen Thi Phuong Hang, 정희용, "근감소증 진단을 위한 초음파 기반 근두께 자동 측정 방법", 한국정보처리학회 학술발표대회 (ASK 2025), 2025년 5월29일~31일, 경북대학교 대구캠퍼스.
전명재, 신춘성, 정희용, "무인자동 양식어류 급이공급 시스템 개발 및 검증" 스마트미디어저널, Vol. 13, No. 11, 2024년 11월.
Y. Woo, and H. Jeong, "Exercise Assessment based on Human Pose Estimation and Relative Phase for Real-Time Remote Exercise System," IEEE Access, 2025 (DOI: https://ieeexplore.ieee.org/document/10928987).
Science Citation Index Expanded (Clarivate Analytics))
K. Fumimoto, S. Okada, R. Tsuji, Y. Sakaue, N. Shiozawa, H. Jeong, M. Makikawa, "Noncontact evaluation of autonomic nervous system activity during exercise by using video analysis," Frontiers in Digital Health, 2025 (https://doi.org/10.3389/fdgth.2025.1536492).
Science Citation Index Expanded (Clarivate Analytics))
H.T.P. Nguyen, and H. Jeong, "Automated Morphology Detection of Nail-Fold Capillaries Through Enhanced Object Detection Network," IEEE Access, Vol. 13, pp. 1697-1713, Jan 2025 (DOI: 10.1109/ACCESS.2024.3521937).
(Science Citation Index Expanded (Clarivate Analytics))
W. Choi, H. Jeong, S. Oh, and T. Jung, "Instant Gait Classification for Hip Osteoarthritis Patients: A Non-Wearable Sensor Approach Utilizing Pearson Correlation, SMAPE, and GMM," Biomedical Engineering Letters, 09 JAN 2025 (https://doi.org/10.1007/s13534-024-00448-2).
(Science Citation Index Expanded (Clarivate Analytics))
H.T.P. Nguyen and H. Jeong, "What is the best way to merge multiple images from recorded video for diabetes classification using Vision Transformer?," Proceedings of 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2024), Lisbon, Portugal, December 3-6, 2024.
(Computer Science Top-Tier Conference, IF: 1)
Y. Woo and H. Jeong, "Effect of Extended Relative Phase on Velocity-Based Training Assessment," Proceedings of 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2024), Lisbon, Portugal, December 3-6, 2024.
(Computer Science Top-Tier Conference, IF: 1)
H.T.P. Nguyen, M. Jun, H. Jeong, "Real-time estimation of Olive Flounder growth in indoor aquaculture using cameras combined with a grid," Journal of the World Aquaculture Society, vol. 56, no. 1, e13108, Feb 2025 (DOI: https://doi.org/10.1111/jwas.13108).
(Science Citation Index Expanded (Clarivate Analytics))
E. Wazed, J. Lee, C. Shin, H. Jeong, "CHSD-NET: Children Heart Sound Abnormality Detection Network," Proceedings of 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2024), Lisbon, Portugal, December 3-6, 2024.
(Computer Science Top-Tier Conference, IF: 1)
A. Jeong, Y. Woo, H. Kim, G. Suh, C. Heo, Y. Cho, H. Jeong, "Missing person recognition algorithms based on image captioning and visual grounding," 27th International Conference on Pattern Recognition (ICPR 2024), Kolkata, India, December 01-05, 2024.
(Computer Science Top-Tier Conference, IF: 1)
W. Kim, M. Jun, and H. Jeong, "Real-Time Prediction of Dissolved Oxygen Levels in Automated Aquaculture Feeding Systems Using a Combined Time Series Decomposition and Pretrained TCN Model," BigDAS '24: Proceedings of the 2024 International Conference on Big Data Applications and Services (ACM Proceedings), Jeju, South Korea, 22-24 Aug, 2024.
(Computer Science 분야 우수 국제학술대회 논문)
Y. Woo, H. Nguyen, and H. Jeong, "Velocity-based training assessment: Effect of Extended-Relative-Phase-based extracted features on classification," 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2024) Workshop (AIDSH), Barcelona, Spain, August 25-29, 2024.
(Computer Science Top-Tier Conference, IF: 4)
박민수, 전명재, 정희용, "ROS2 기반 멀티로봇 제어를 위한 Map Sharing", 제39회 제어로봇시스템학회 학술대회 (ICROS 2024), 대전컨벤션센터 제1전시장, 2024년7월2일-4일.
김우재, 정희용, "딥러닝 기반 시계열 분해를 통한 랜덤 이벤트를 포함한 데이터 예측 - 용존 산소량 예측 방법 제안 및 검증", 2024스마트미디어춘계학술대회, 광주실감콘텐츠큐브(GCC) 및 광주CGI센터, 2024년5월17일-18일.
우영주, 주지용, 김영관, 정희용, "RGB 이미지 기반 인간 동작 추정을 통한 투구 동작 분석", 스마트미디어저널, vol. 13, No. 4, pp. 16-22, 2024 (https://dx.doi.org/10.30693/SMJ.2024.13.4.16).
N. Huynh, M. Jun, and H. Jeong, "Effect of light-emitting grid panel on indoor aquaculture for measuring fish growth," Sensors, vol. 24, no. 3, 852, 2024 (https://www.mdpi.com/1424-8220/24/3/852).
Science Citation Index Expanded (Clarivate Analytics))
"Deep-Learning-based smartphone application for automatic recognition of ingredients on curved containers," Journal of Korean Society of Industrial Information System, vol. 28, no. 6, Dec, 2023 (https://ksiis.jams.or.kr/co/com/EgovMenu.kci?s_url=/sj/search/sjSereClasList.kci&s_MenuId=MENU-000000000053000&accnId=AC0000000015). (indexed in KCI).
H.T.P. Nguyen, S. Ko, and H. Jeong, "Deep-Learning-based Capillary Detection," Proceedings of IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2023), Istanbul, Turkey, December, 4-8, 2023.
(Computer Science Top-Tier Conference, IF: 1)
2023.10,
한국스마트미디어 심포지엄
2023.11,
한국정보처리학회 (ACK 2023)
Prof. Jeong is invited to give a special lecture at 30 September 2023, in Ritsumeikan University, Japan.
Web告知ページ
https://www.ritsumei.ac.jp/events/detail/?id=1401
"Detection of Abnormal Changes on the Dorsal Tongue Surface Using Deep Learning," Medicina, vol 59, no. 7, 1293, 2023.
"Design of 3D-printed Foot Interface for Operating Multiple Monitors in a Surgical Robot System," Sensors and Materials, 2023 (Accepted).
This study aimed to propose an inverted pendulum model on the WBB (Wobble Balance Board) for scoring the HBAWBB (Human Balance Ability on WBB) through kinematics and geometric method with a new point - projected center of mass (pCoM) and to visualize the difference between excellent and poor balance states through principal components analysis (PCA) with scoring data.
This study is related to Smart Aqua Farm, which combines artificial intelligence (AI) and Internet of Things (IoT) technology. This study aimed to monitor fish growth in indoor aquaculture while automatically measuring the average size and area in real time.
This study aims to propose an Extended Relative Phase (ERP) indicator for assessing velocity-based training through Human Pose Estimation (HPE) and verifying its feasibility while demonstrating the difference between experts and novices and a method for extracting features for machine learning from ERP.
정아영, 박민수, 정희용, "이동로봇모델기반 A* 탐색 알고리즘의 개선", 2023년도 스마트미디어 국내 학술대회 발표, 2023년 4월.
우수논문상 (구두)
김우재, 전명재, 정희용, "머신러닝 기반 유수식 양식장의 용존산소량 예측", 2023년도 스마트미디어 국내 학술대회 발표, 2023년 4월.
Sohyun Ahn, Wiha Choi, Hieyong Jeong, Sehoon Oh and Tae-Du Jung,
"One-Step Gait Pattern Analysis of Hip Osteoarthritis Patients
based on Dynamic Time Warping through Ground Reaction
Force," Applied Sciences (Accepted).
The 14th International Conference on Internet (ICONI) 2022
Software approach for fish tracking
One-Step gait for hip osteoarthritis patients
Outstanding Paper Award
Outstanding Paper Award
Morphology classification of nailfold capillaries
Consideration of Positive and Negative Effect of Multisensory Environment Interventions on Disabled Patients through Electrocardiography
Consideration of Positive and Negative Effect of Multisensory Environment Interventions on Disabled Patients through Electrocardiography
published in electronics (SICE).
https://doi.org/10.3390/electronics11223692
한국스마트미디어학회 2022년 종합학술대회
포스터 발표 (2022년 6월 24일)
"PoseNet 기반 2차원 웹툰제작"
한국방송∙미디어공학회 (2022년 9월)
"인간자세 추정방법에 의한 2차원 웹툰 캐릭터 포즈 생성"
정희용 and 신춘성. (2022). 인간자세 추정방법에 의한 2차원 웹툰 캐릭터 포즈 생성. 방송공학회 논문지, 27(5), 718-727.
"Scoring of human body balance ability on wobble board based on the geometric solution,"
published in Applied Sciences (SCIE).
(https://doi.org/10.3390/app12125967)
"Evaluation of human body balance ability through geometric solution based on an equivalent model using RGB camera,"
published in The 9th IEEE RAS/EMBS International Conference on Biomedical Robotics & Biomechatronics (IEEE BioRob 2022).
"Blurring of Swear Words in Negative Comments through Convolutional Neural Network"
"컨볼루션 신경망 모델에 의한 악성 댓글 모자이크처리 방안"
published in the Journal of the Korean Industrial Information Systems Research
(https://www.researchgate.net/publication/360671432_Blurring_of_Swear_Words_in_Negative_Comments_through_Convolutional_Neural_Network)
Reconstruction of Human Pose (2D->3D)
Reconstruction of Human Pose (2D->3D)
AI-based exercise coach (Evaluation of Exercise Pose)
AI-based exercise coach (Evaluation of Exercise Pose)
Reconstruction of Human Pose (2D->3D)
Reconstruction of Human Pose (2D->3D)
AI-based exercise coach (Evaluation of Exercise Pose)
AI-based exercise coach (Evaluation of Exercise Pose)
AI-based Image Animation Demo 1
AI-based Image Animation Demo 1
AI-based Image Animation Demo 2
AI-based Image Animation Demo 2
2022.02, Blurring of Swear Words in Negative Comments through Convolutional Neural Network (Accepted in Journal indexed in KCI).
Mrs Hang got the award from the BK+ project. Her research topic was related to "Development of AI coach for the personal home training".
Mrs Hang got the award from the BK+ project. Her research topic was related to "Development of AI coach for the personal home training".
Mrs Hang talked about her research topic of "Evaluation of Human Balance Ability on Wobble Board by using Single RGB Camera" in the CNU Harvest Event.
Mrs Hang talked about her research topic of "Evaluation of Human Balance Ability on Wobble Board by using Single RGB Camera" in the CNU Harvest Event.
Miss Kim got the Award at the ACK 2021.
Miss Kim got the Award at the ACK 2021.
Mr Woo got the President Award at R-BIZ challenge.
Mr Woo got the President Award at R-BIZ challenge.
전남대 학생팀
로봇사업화 아이디어 경진대회 ‘대통령 상’
전남대학교 학생들이 ‘2021년 국제로봇콘테스트 및 로봇사업화 아이디어 경진대회’에서 대통령상을 수상했다.
전남대 학생들로 구성된 Castle Zero팀은 지난 10월 30일 한국로봇산업진흥원(원장 손웅희)이 주관한 이 대회의 '제우스 산업용로봇 ZERO 미션 챌린지' 부문에서 전국 22개 참가팀을 제치고 대통령상인 금상을 수상했다.
이들은 산업용 수직다관절 로봇으로 젠가 블록을 인식해 집어 도미노를 구성하는 동작을 완벽하게 구현했으며, 비전 기반으로 로봇의 경로를 생성하는 제어 기법을 제시해 높은 점수를 받았다.
Castle Zero팀은 안시헌, 첸롱완 대학원생과 정고운 학부생(기계공학과(부), 의료로봇 및 지능제어 연구실. 지도교수 고성영), 우영주 대학원생(인공지능융합학과, 휴먼-미디어 연구실. 지도교수 정희용)로 구성됐다.
전남대는 산업통상자원부의 ‘로봇기반 혁신선도 전문인력양성 사업’(책임교수 고성영)을 통해 매년 20여명의 대학원생을 지원하고 있으며, 산학프로젝트, 현장실습, 단기교육 등 다양한 교육프로그램을 통해 우수한 로봇 전문 인력을 양성하고 있다.
고성영 교수는 “지정 미션에서는 전남대 팀이 유일하게 성공했고, 자율 미션에서는 비전을 이용한 인간-로봇 인터페이스를 통해 로봇을 제어함으로써 창의력을 인정받았다.”며 “그동안 열심히 연구하고 도전해 온 학생들이 자랑스러우며, 더 많은 성과를 낼 수 있도록 지도하겠다.”고 말했다.
Mr. Woo talked about "AutoML-based Refrigerant Leakage Detection of Air-Conditioning System" in ACK 2021 (https://www.manuscriptlink.com/society/kips/conference/ack2021?societyAbbr=kips).
Mr. Woo talked about "AutoML-based Refrigerant Leakage Detection of Air-Conditioning System" in ACK 2021 (https://www.manuscriptlink.com/society/kips/conference/ack2021?societyAbbr=kips).
Miss Kim talked about "Swear Word Detection through Convolutional Neural Network" in ACK 2021 (https://www.manuscriptlink.com/society/kips/conference/ack2021?societyAbbr=kips).
Miss Kim talked about "Swear Word Detection through Convolutional Neural Network" in ACK 2021 (https://www.manuscriptlink.com/society/kips/conference/ack2021?societyAbbr=kips).
Prof Jeong was invited as Speaker.
Prof Jeong was invited as Speaker.
Prof Jeong was invited as Speaker.
Prof Jeong was invited as Speaker.
http://m.mdilbo.com/detail/SexeuZ/656567
Prof Shin published his research results.
Prof Shin published his research results.
The title was "Analysis and Design of Arts and Culture Content Creation Tool powered by Artificial Intelligence".
https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002761278
Miss Ko and Ahn talked about their results of study in ICCAS 2021.
The title was "Development of Fitness Personal Trainer with 3D Human Pose Estimation from 2D Images".
(2021년 9월), Journal paper (https://doi.org/10.3390/app11199029) was published.
(2021년 7월), 한국정보과학회 학부생/주니어논문경진대회 우수상 수상 (https://www.kiise.or.kr/academy/board/academyNewsView.fa?MENU_ID=080100&sch_add_bd=학회소식&NUM=2180)
(2021년 7-8월), 하계 고교학점제 부전공연수
(2021년 8월), Frontiers of Computer Vision, Book Editor, Springer, (https://link.springer.com/book/10.1007/978-3-030-81638-4)
(2021년 6월), 한국연구재단 개인기초연구사업 최종 선정
(2021년 6월), 고등학생 대상으로 운영하는 반기는 전공체험 실시
(2021년 5월), 공공기술기반 시장연계 창업탐색 지원사업 실험실창업탐색팀 최종 선정
(2021년 5월), 한국산업정보학회논문지(KCI) 게재
April 2021, K-MOOC Lecture is on air (http://www.kmooc.kr/courses/course-v1:JNUk+JNUk_12+2021_T1/about).
Journal paper (https://doi.org/10.3390/app11083460) was published (April 2021).
Yeongju Woo participated with us in ICAIIC 2021 (April 2021).
Hang Nguyen Thi Phuong received the Excellent Paper Award in ICAIIC 2021 (April 2021).
Hang Nguyen Thi Phuong received the Best Student Paper Award in IW-FCV 2021 (February 2021).
(2020년 7월), 한국산업기술평가관리원 최종 선정
Pizarroso Troncoso Carlos Andres graduated, and prepared to study in Germany (February 2021).
Dey Dmitrity graduated, and started working at the global company (January 2021).
(2019년 9월), 4단계 BK21사업 최종 선정
Health Promotion
Health Promotion
Data Science
Gait / Rehabilitation
Hip OA patients
Capillary
Malicious (=Negative) Comments Detection
2. Healthcare Devices / Applications
Development of Endoscope for Pelvic Organ Prolapse
Smartphone Application for Automatic Recognition of ingredients (OCR)
Human Pose Applications
Human Pose Applications
1. Human Balance Ability (HBA)
Scoring the HBA
Development of Wobble Board for Dynamic Balance Ability
2. Exercise Pose
YOGA
Baseball Pitching
Korean Traditional Dance
Velocity-based Training Assessment
3. Cartoon/WebToon Assisting Tools
Pose Generation
Facial Emotion Expression
Robot Intelligence
1. Swarmming Robot
2. Human-Robot Interaction
Automatic Operation of Toilet Seat through Human Intentions
Foot Interface
Smart Aquaculture
Smart Aquaculture
1. Data Analysis
Prediction of Sensing Data with / without irregular patterns
2. Fish Growth
Development of Grid Panel with / without Camera
Sensor Fusion
Page updated
Google Sites
Report abuse