Intelligent Vision and Sensing Lab
I am an Assistant Professor at University of Georgia. Before joining UGA, I was an assistant professor at RIT, a research scientist on autonomous driving at Ford, and research engineer at Disney ESPN Advanced Technology Group. I finished my PhD and MS at University of Delaware. Before coming to UD, I was in European Master in Informatics (EuMI) Erasmus Mundus program. I obtained Master degree in Computer Science at University of Trento and Master degree in Media Informatics at RWTH Aachen University. I was also a visiting scholar at Auckland University of Technology. I was a research intern at Siemens Corporate Research in Princeton and Bosch Research in Palo Alto. I finished my Bachelor degree in Software Engineering at Nanjing University of Posts & Telecommunications, with a minor in Business Administration and Management.
I have served as PI for projects funded by NSF (CAREER, CSSI, CRII, CCF Core), USDA, DoD, Georgia Department of Agriculture, Ford, GM, Georgia Peanut Foundation, Qualcomm, Tencent, Mackinac, and more. I am honored to have received the NSF CAREER Award, USDA New Investigator Award, Aharon Katzir Young Investigator Award from the International Neural Network Society (INNS), Ford URP Award, Tencent Rhino-bird Young Faculty Award, Frank A. Pehrson Award, and Erasmus Mundus Scholarship. I am also serving as the Chair of the IEEE Atlanta Signal Processing Society Chapter and the Co-Chair of the IEEE Robotics & Automation Society (RAS) Technical Committee on Agricultural Robotics and Automation, which is one of the three Blue Ribbon Technical Committees in RAS. My research interests include robotic perception, computer vision, AI, deep/machine learning, multimedia, and AI-based infrastructure systems.
I also recruit multiple PhD students for 2024 Spring/Fall. Please contact me (guoyulu62@gmail.com ) if you are interested.
Publication
Journals:
1. Shekhar Thapa, Glen C. Rains, Wesley M. Porter, Guoyu Lu, Xianqiao Wang, Canicius J Mwitta, Simerjeet S Virk, Robotic Multi-Boll Cotton Harvester System Integration and Performance Evaluation, AgriEngineering, 2024
2. Peng Shu, Huaqin Zhao, Hanqi Jiang, Yiwei Li, Shaochen Xu, Yi Pan, Zihao Wu, Zhengliang Liu, Guoyu Lu, Le Guan, Gong Chen, Xianqiao Wang Tianming Liu "LLMs for Coding and Robotics Education." arXiv, 2024.
3. Guoming Li, Baoming Li, Zhengxiang Shi, Guoyu Lu, Lilong Chai, Khaled M Rasheed, Prafulla Regmi, Ahmad Banakar, Inter-Individual Distances and Orientations of Laying Hens under Eight Stocking Densities Measured by Integrative Deep Learning Techniques, Poultry Science, 2023
4. Manushi Trivedi, Yuwei Zhou, Jonathan Hyun Moon, James Meyers, Yu Jiang, Guoyu Lu, and Justine Vanden Heuvel, A Preliminary Method for Tracking in Season Grapevine Cluster Closure Using Image Segmentation And Image Thresholding, Australian Journal of Grape and Wine Research, 2023
5. Tingting Xu, Xiubin Yang, Zongqiang Fu, Ge Jin, Wei Chen, Miaoran Huang, Guoyu Lu, A Star Map Matching method for Optical Circular Rotation Imaging based on Graph Neural Networks, Journal of the Optical Society of America A, 2023
6. Ge Jin, Rongjing Hong, Yanghe Liu, Peiliang Qin, Tingting Xu, Guoyu Lu, “An End-to-End Steel Surface Classification Approach based on EDCGAN and MobileNet V2,” Sensors, 2023
7. Jiacheng He, Ruonan Peng, Henry Yuqing, Mohammad Rafiul Karim, Juhong Chen, Guoyu Lu, Ke Du, Superhydrophobic Rotation-Chip for Computer-Vision Identification of Drug-Resistant Bacteria, ACS Applied Materials & Interfaces, 2023
8. Guoyu Lu, Sheng Li, Gengchen Mai, Jin Sun, Dajiang Zhu, Lilong Chai, Haijian Sun, Xianqiao Wang, Haixing Dai, Ninghao Liu, Rui Xu, Daniel Petti, Changying Li, Tianming Liu, Changying Li, AGI for Agriculture, Arxiv, 2023
9. Ehsan Latif, Gengchen Mai, Matthew Nyaaba, Xuansheng Wu, Ninghao Liu, Guoyu Lu, Sheng Li, Tianming Liu, and Xiaoming Zhai. "Artificial general intelligence (AGI) for education." arXiv preprint arXiv:2304.12479, 2023.
10. Xiao Yang, Haixing Dai, Zihao Wu, Ramesh Bist, Sachin Subedi, Jin Sun, Guoyu Lu, Changying Li, Tianming Liu, and Lilong Chai. "SAM for Poultry Science." arXiv preprint arXiv:2305.10254, 2023.
11. Dou, F., Ye, J., Yuan, G., Lu, Q., Niu, W., Sun, H., Guan, L., Lu, G., Mai, G., Liu, N. and Lu, J., Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges. arXiv preprint arXiv:2309.07438., 2023
12. Mengdi Bao, Shuhuan Zhang, Chad ten Pa, Stephen Dollery, Ruth Bushnell, Yuqing Fnu, Rui Liu, Guoyu Lu, Gregory Tobin, Ke Du, “Computer Vision Enabled Funnel Adapted Sensing Tube (FAST) for Power-Free and Pipette-Free Nucleic Acid Detection,” Lab on a Chip, 2022
13. Zhelin Yu, Lidong Zhu, Guoyu Lu “Tightly-coupled Fusion of VINS and Motion Constraint for Autonomous Vehicle,” IEEE Transactions on Vehicular Technology, 2022.
14. Yawen Lu, Yuxing Wang, Devarth Parikh, Awais, Khan, Guoyu Lu “Simultaneous Direct Depth Estimation and Synthesis Stereo for Single Image Plant Root Reconstruction,” IEEE Transactions on Imaging Processing, 2021.
15. Yawen Lu, Guoyu Lu, “SuperThermal: Matching Thermal As Visible Through Thermal Feature Exploration,” IEEE Robotics and Automation Letters, 2021.
16. Yawen Lu, Guoyu Lu, “Self-supervised Single-image Depth Estimation From Focus and Defocus Clues,” IEEE Robotics and Automation Letters, 2021.
17. Zhihua Xie, Jieyi Niu, Yi Li, Guoyu Lu, “Regularization and Attention Feature Distillation base on Light CNN for Hyperspectral Face Recognition,” Journal of Multimedia Tools and Applications, 2021.
18. Zhihua Xie, Yi Li, Jieyi Niu, Ling Shi, Zhipeng Wang, and Guoyu Lu, “Hyperspectral face recognition based on sparse spectral attention deep neural networks,” Optics Express, 2020.
19. Yawen Lu, Yuxing Wang, Zhanjie Chen, Awais Khan, Carl Salvaggio, Guoyu Lu, “3D Plant Root Reconstruction Based on Fusion of Deep Structure-from-Motion and IMU,” Journal of Multimedia Tools and Applications, 2020
20. Zhelin Yu, Lidong Zhu, Guoyu Lu, “An Improved Phase Correlation Method for Stop Detection of Autonomous Driving,” IEEE Access, 2020.
21. Zhen Wang, Guoshan Xu, Yong Ding, Bin Wu, Guoyu Lu, “A vision-based active learning convolutional neural network model for concrete surface crack detection,” Advances in Structural Engineering, 2020.
22. Guoyu Lu, Liqiang Nie, Scott Sorenson, Chandra Kambhamettu, “Large-scale Tracking for Images with Few Textures,” IEEE Transactions on Multimedia, 2017.
23. Guoyu Lu, Yan Yan, Nicu Sebe, Chandra Kambhamettu, “Indoor Localization via Multi-View Images and Videos,” Journal of Computer Vision and Image Understanding, 2017.
24. Gaowen Liu, Yan Yan, Ramanathan Subramanian, Jingkuan Song, Guoyu Lu, and Nicu Sebe, “Active domain adaptation with noisy labels for multimedia analysis,” Journal of World Wide Web, 2016.
25. Guoyu Lu, Li Ren, Abhishek Kolagunda, Xiaolong Wang, Ismail B. Turkbey, Peter L. Choyke, Chandra Kambhamettu, “Representing 3D Shapes based on Implicit Surface Functions Learned From RBF Neural Network,” Journal of Visual Communication and Image Representation, 2016.
26. Guoyu Lu, Yan Yan, Li Ren, Philip Saponaro, Nicu Sebe, Chandra Kambhamettu, “Where am I in the Dark: Exploring Active Transfer Learning on the Use of Indoor Localization based on Thermal Imaging,” Journal of Neurocomputing, 2016.
27. Guoyu Lu, Nicu Sebe, Congfu Xu, Chandra Kambhamettu, “Memory Efficient large-scale Image-based Localization,” Journal of Multimedia Tools and Applications, 2014.
Conferences:
1. Guoyu Lu, Morphable-SfS: Enhancing Shape-from-Silhouette Via Morphable Modeling, IEEE International Conference on Robotics and Automation (ICRA), 2024
2. Guoyu Lu, SLAM Based on Camera-2D LiDAR Fusion, IEEE International Conference on Robotics and Automation (ICRA), 2024
3. Guoyu Lu, TVFusionGAN: Thermal-Visible Image Fusion Based on Multi-Level Adversarial Network Strategy, IEEE International Conference on Robotics and Automation (ICRA), 2024
4. Guoyu Lu, Bird-view 3D Reconstruction for Crops with Repeated Textures, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023
5. Guoyu Lu, Object Detection Based on Raw Bayer Images, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023
6. Guoyu Lu, Deep Unsupervised Visual Odometry Via Bundle Adjusted Pose Graph Optimization, IEEE International Conference on Robotics and Automation (ICRA), 2023
7. Guoyu Lu, RawSeg: Grid Spatial and Spectral Attended Semantic Segmentation Based on Raw Bayer Images, British Machine Vision Conference (BMVC), 2023.
8. Yu Feng, Paul Whatmough, Patrick Hansen, Guoyu Lu, Yuhao Zhu, Fast and Accurate: Video Enhancement Using Sparse Depth, IEEE Winter Conference on Applications of Computer Vision (WACV) 2023
9. Yawen Lu, Michel Sarkis, Ning Bi, Guoyu Lu, Local to Holistic: Self-supervised Single Image 3D Face Reconstruction Via Multi-level Constraints, IEEE International Conference on Intelligent Robots and Systems (IROS) 2022
10. Devarth Parikh, Yawen Lu, Nikola Kasabov, Guoyu Lu, MVG-Gaze: Weakly-supervised Gaze Estimation Based on Multi-view Geometric Neural Network, 21st IEEE IEEE International Joint Conference on Neural Network (IJCNN) 2022
11. Yawen Lu, Guoyu Lu, Self-supervised Depth Estimation from Spectral Consistency and Novel View Synthesis, 21st IEEE IEEE International Joint Conference on Neural Network (IJCNN) 2022
12. Yawen Lu, Guoyu Lu, An Unsupervised Approach for Simultaneous Visual Odometry and Single Image Depth Estimation, 21st IEEE IEEE International Joint Conference on Neural Network (IJCNN) 2022
13. Guoyu Lu, Image-based Localization for Self-driving Vehicles Based on Online Network Adjustment in A Dynamic Scope, 21st IEEE IEEE International Joint Conference on Neural Network (IJCNN) 2022
14. Yawen Lu, Guoyu Lu, 3D Modeling Beneath Ground: Plant Root Detection and Reconstruction Based on Ground-Penetrating Radar, IEEE Winter Conference on Applications of Computer Vision (WACV) 2022
15. Christopher Walker, Yuxing Wang, Yawen Lu, Guoyu Lu, “Inferring Camera Intrinsics Based on Surfaces of Revolution: A Single Image Geometric Network Approach for Camera Calibration,” International Conference on Acoustics, Speech, & Signal Processing (ICASSP), 2022
16. Yuxing Wang, Yawen Lu, Zhihua Xie, Guoyu Lu, “Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment,” ACM Multimedia (MM), 2021.
17. Yawen Lu, Nikola Kasabov and Guoyu Lu, “Multi-view Geometry Consistency Network for Facial Micro-Expression Recognition From Various Perspectives,” International Joint Conference on Neural Networks (IJCNN), 2021.
18. Yawen Lu, Guoyu Lu, Bridging the Invisible and Visible World: Translation between RGB and IR Images through Contour Cycle GAN,” The 17th IEEE International Conference on Advanced Video and Signal-based Surveil-lance (AVSS), 2021.
19. Hao Wang, Tao Zhang, Guoyu Lu, “Unsupervised HDR Image Reconstruction Based on Over/Under-Exposed LDR Image Pair,” IEEE International Conference on Multimedia & Expo (ICME), 2021.
20. Zhelin Yu, Lidong Zhu, Guoyu Lu, “VINS-Motion: Tightly-coupled Fusion of VINS and Motion Constraint,” IEEE International Conference on Robotics and Automation (ICRA), 2021.
21. Yuxing Wang, Yawen Lu, Guoyu Lu, “Stereo Rectification Based on Epipolar Constrained Neural Network,” International Conference on Acoustics, Speech, & Signal Processing (ICASSP), 2021.
22. Bhavesh Deshpande, Sourabh Hanamsheth, Yawen Lu, Guoyu Lu, “Matching As Color Images: Thermal Image Local Feature Detection And Description,” International Conference on Acoustics, Speech, & Signal Processing (ICASSP), 2021.
23. Yawen Lu, Guoyu Lu, “An Alternative of LIDAR in Nighttime: Unsupervised Depth Estimation Based on Single Thermal Image,” IEEE Winter Conference on Applications of Computer Vision (WACV), 2021.
24. Yawen Lu, Yuxing Wang, Di Wu, Yuan Xin, Guoyu Lu, “Unsupervised Gaze: Exploration of Geometric Constraints for 3D Gaze Estimation,” International Conference on Multimedia Modeling (MMM), 2021.
25. Yu Feng, Patrick Hansen, Paul N. Whatmough, Guoyu Lu, Yuhao Zhu, “A LiDAR-Guided Framework for Video Enhancement”. CoRR abs/2103.08764, 2021.
26. Yawen Lu, Yuxing Wang, Guoyu Lu, “Single Image Shape-from-Silhouettes,” 28th ACM Multimedia (MM), 2020.
27. Yawen Lu, Michel Sarkis, Guoyu Lu, “Multi-task Learning for Single Image Depth Estimation and Segmentation Based on Unsupervised Network,” International Conference on Robotics and Automation (ICRA), 2020.
28. Yawen Lu, Yuxing Wang, Devarth Parikh, Guoyu Lu, “Extending Single Beam Lidar To Full Resolution By Fusing with Single Image Depth Estimation,” International Conference on Pattern Recognition (ICPR), 2020.
29. Guoyu Lu, “Bring Light to the Night: Classifying Thermal Image via Convolutional Neural Network based on Visible Domain Transformation,” IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019.
30. Yawen Lu, Guoyu Lu, “A Geometric Convolutional Neural Network for 3D Object Detection,” IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019.
31. Devarth Parikh, Yawen Lu, Jeff Pelz, Guoyu Lu, “Where am I Looking: Localizing Gaze in Reconstructed 3D Space,” IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019.
32. Yawen Lu*, Sophia Kourian*, Carl Salvaggio, Chenliang Xu, Guoyu Lu, “Single Image 3D Vehicle Pose Estimation for Augmented Reality,” IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019.
33. Guoyu Lu, Xue-Iuan Wong, “Taking Me To The Correct Place: Vision-based Localization for Autonomous Vehicles,” 26th IEEE International Conference on Image Processing (ICIP), 2019.
34. Guoyu Lu, Yahong Han, “3D Shape Retrieval Through Multilayer RBF Neural Network,” 26th IEEE International Conference on Image Processing (ICIP), 2019.
35. Guoyu Lu, Xue-Iuan Wong, James McBride, “From Mapping to Localization: A Complete Framework to Visually Estimate Position and Attitude for Autonomous Vehicles,” 26th IEEE International Conference on Image Processing (ICIP), 2019.
36. Yawen Lu, Guoyu Lu, “Deep Unsupervised Learning for Simultaneous Visual Odometry and Depth Estimation,” 26th IEEE International Conference on Image Processing (ICIP), 2019.
37. Guoyu Lu, Huili Yu, Chun Yuan, “Getting Rid of Night: Thermal Image Classification Based on Feature Fusion,” 24th IEEE International Conference on Image (ICIP), 2018.
38. Guoyu Lu, Jingkuan Song, “3D Image-based Indoor Localization Joint With WiFi Positioning,” ACM International Conference on Multimedia Retrieval (ICMR), 2018.
39. Guoyu Lu, Li Ren, Jeffrey Caplan, Chandra Kambhamettu, “Stromule Branch Tip Detection Based on Accurate Cell Image Segmentation,” 24th IEEE International Conference on Image Processing (ICIP), 2017.
40. Guoyu Lu, Abhishek Kolagunda, Yan Yan, Nicu Sebe, Chandra Kambhamettu, “A Fast 3D Indoor-localization Approach Based on Video Queries,” 22nd Multimedia Modelling Conference (MMM), 2016 (oral).
41. Guoyu Lu, Li Ren, Abhishek Kolagunda, Chandra Kambhamettu, “Neural Network Shape: Organ Shape Representation with Radial Basis Function Neural Networks,” 41st IEEE International Conference on Acoustics, Speech and Signal Processing Conference (ICASSP) (NSF travel grant), 2016.
42. Guoyu Lu, Yan Yan, Li Ren, Jingkuan Song, Nicu Sebe, Chandra Kambhamettu, “Localize Me Anywhere and Any-time: A Multi-task Point Retrieval Approach,” 15th IEEE International Conference on Computer Vision (ICCV), 2015.
43. Abhishek Kolagunda, Guoyu Lu, Chandra Kambhamettu, “Hybrid Hierarchical Shape Representation for Medical Shapes,” 26th British Machine Vision Conference (BMVC), 2015.
44. Guoyu Lu, Yan Yan, Nicu Sebe, Chandra Kambhamettu, “Knowing Where I Am: Exploiting Multi-Task Learning for Mult-view Indoor Image-based Localization,” 25th British Machine Vision Conference (BMVC) 2014.
45. Guoyu Lu, Yingjie Hu, Chandra Kambhamettu, “Weighted SIFT Feature Learning with Hamming Distance for Face Recognition,” The 9th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), 2014 (oral).
46. Guoyu Lu, Scott Sorensen, Chandra Kambhamettu, “Fast Ice Image Retrieval Based on A Multilayer System,” Proceedings of International Society for Optics and Photonics (SPIE&IST), 2014.
47. Guoyu Lu, Chandra Kambhamettu, “Image-based indoor localization system on the use of 3D SfM model,” Proceedings of International Society for Optics and Photonics (SPIE&IST), 2014.
48. Guoyu Lu, Vincent Ly, Chandra Kambhamettu, “Structure-from-Motion Reconstruction Based on Weighted Hamming Descriptors,” 24th IEEE The annual International Joint Conference on Neural Networks (IJCNN), 2014 (oral).
49. Guoyu Lu, Vincent Ly, Haoquan Shen, Abhishek Kolagunda, Chandra Kambhamettu,. “Improving Image-Based Localization through Increasing Correct Feature Correspondences,” The 9th International Symposium on Visual Computing (ISVC), 2013 (oral).
50. Guoyu Lu, Vincent Ly, Xiaolong Wang, Rohith MV, Orlando Ayala, Lian-Ping Wang, Chandra Kambhamettu. “A Tool for Visualizing Large-Scale Interactions between Turbulence and Particles in 3D Space through 2D Trajectory Visualization,” 9th International Symposium on Visual Computing (ISVC), 2013 (oral).
51. Guoyu Lu, Vincent Ly, Chandra Kambhamettu, “Large-scale Structure-from-Motion Reconstruction with small memory consumption,” The 11th International Conference on Advances in Mobile Computing and Multimedia (MoMM), 2013.
52. Xiaolong Wang, Vincent Ly, Guoyu Lu, Chandra Kambhamettu. “Could We Minimize the Influence Brought by Gender and Race Difference in Age Estimation?” The 12th IEEE International Conference of Machine Learning and Application (ICMLA), 2013 (oral).
53. Rohith MV, Stephen Rhein, Guoyu Lu, Scott Sorensen, Andrew R. Mahoney, Hajo Eicken, G. Ray, Chandra Kambhamettu, “Iterative reconstruction of large scenes using heterogeneous feature tracking,” The Conference on Computer Vision and Pattern Recognition workshop (Big Data Computer Vision), 2013.
54. Ammar Mohemmed, Guoyu Lu, Nikola Kasabov, “Evaluating SPAN Incremental Learning for Handwriting Digit Recognition,” 19th International Conference on Neural Information Processing Conference (ICONIP), 2012 (oral).
55. Guoyu Lu, “Lane departure warning and vehicle tracking system based on vision,” poster on the event “Ph.D. Students Competition on Innovation in the Automotive Sector– the WINNERS Day,” 2011.
US PATENTS
Bloom removal for vehicle sensors (10,593,029) 2019.
Teaching
Machine Learning for Computer Vision (2023)
Introduction to Robotics Engineering (2023, 2024)
Multi-view Imaging (Spring 2018, 2019, 2020, 2021, 2022)
Robot Vision (Fall 2018, 2021)
Image Processing and Computer Vision (Spring 2019, 2020)
Services
Leading Program Chair: International Workshop on Visual Odometry and Computer Vision Applications Based on Location Clues, in conjunction with CVPR (2023)
Leading Program Chair : International Workshop on Visual Odometry & Computer Vision Applications Based on Location Clues, in conjunction with CVPR 2022
Leading Program Chair : International Workshop on Visual Odometry & Computer Vision Applications Based on Location Clues, in conjunction with CVPR 2021
Leading Program Chair : Joint Workshop on Long-Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM, in conjunction with CVPR 2020
Leading Program Chair : International Workshop on Visual Odometry & Computer Vision Applications Based on Location Clues, in conjunction with CVPR 2019
Leading Program Chair : International Workshop on Visual Odometry & Computer Vision Applications Based on Location Clues, in conjunction with CVPR 2018
Leading Program Chair : International Workshop on Visual Odometry & Computer Vision Applications Based on Location Clues, in conjunction with CVPR 2017
Associate Editor, Journal of Knowledge-Based Systems (IF: 8.8)
Associate Editor, IEEE Robotics and Automation Letters (IF: 5.2)
Associate Editor, SPIE/IST Journal of Electronic Imaging (IF: 1.1)
Area Chair, CVPR 2024
Associate Editor, IEEE ICRA (2023, 2024)
Area Chair, ACM MM 2022
NSF CISE Panel (2021, 2022, 2023)
Guest Editor for Springer Journal of Multimedia Tools and Applications (2016-17, 2020-21)
Guest Editor for Frontier Robotics and AI (2021)
Leading Program Chair for International Workshop on Visual Odometry and Computer Vision Applications Based on Location Clues in conjunction with CVPR (2023, 2022, 2021, 2019, 2018, 2017)
Leading Program Chair for Joint workshop on Long Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM in conjunction with CVPR (2020)
Perception and Vision Chair, 4th Ford Global Control Conference (2017)