2026 - present, Android XR, Google
2023 - 2025, Reality Labs, Meta
2018 - 2023, Autonomous Vehicle, Nvidia
F. Hu, N. Avadhanam, Y. Ren, et al, "Gaze Detection using One or More Neural Networks", U.S. Patent US11144754B2 [pdf]
F. Hu, Y. Ren, N. Avadhanam, et al, "System and Method for Optimal Camera Calibration", U.S. Patent US11657535B2 [pdf]
F. Hu, S. Yu, "Under Vehicle Reconstruction for Vehicle Environment Visualization", U.S. Patent US20230316772A1 [pdf]
F. Hu, N. Avadhanam, S. Baker, et al, "Automatically-adjusting Mirror for Use in Vehicles", U.S. Patent US20250170958A1 [pdf]
F. Hu, N. Avadhanam, "Machine Learning-based Seatbelt Detection and Usage Recognition Using Fiducial Marking", U.S. Patent US12005855B2 [pdf]
F. Hu, "Restraint Device Localization", U.S. Patent US20250058739A1 [pdf]
M. Zurauskas, A. Fix, F. Hu, et al, "Eye-Tracking System With Dynamic Illumination and Sensor Fusion", U.S. Patent App. P210434US00
A. Jain, R. Kumar, F. Hu, et al, "Using Gestures to Control Machines for Autonomous Systems and Applications", U.S. Patent US20230356728A1 [pdf]
N. Avahadnam, F. Hu, S. Yu, et al, "Surround View Optimization for Autonomous Systems and Applications", U.S. Patent App. 63/326,724
F. Hu, N. Avadhanam, R. Kumar, et al, "自动调节用于车辆中使用的后视镜", China Patent CN114630769B [pdf]
F. Hu, N. Avadhanam, Y. Ren, et al, "使用一个或更多个神经网络进行视线检测", China Patent CN112389443A [pdf]
F. Hu, S. Yu, "用于车辆环境可视化的车辆下方重建", China Patent CN118715139A [pdf]
F. Hu, N. Avadhanam, "使用基准标记的基于机器学习的安全带检测和使用识别", China Patent CN113815561A [pdf]
F. Hu, "约束设备定位", China Patent CN114684062B [pdf]
A. Jain, R. Kumar, F. Hu, et al, "Managing Glare in Image Detection Using Artificial Intelligence", U.S. Patent App. 16/363,648
R. Kumar, F. Hu, N. Avadhanam, et al, "System and Method for Gaze, Body, and Gesture Recognition in Advanced AI-assisted Vehicles", U.S. Patent App. 62/742,923
R. Kumar, S. Baker, F. Hu, et al, "System and Method for Advanced AI-assisted Vehicles", U.S. Patent App. 62/648,358
F. Hu, N. Avadhanam, Y. Ren, et al, "１つ又は複数のニューラル・ネットワークを使用した視線検出", Japan Patent JP7403293B2 [pdf]
F. Hu, N. Avadhanam, "基準マーキングを使用するマシン学習ベースのシートベルト検出及び使用認識", Japan Patent JP2022002947A [pdf]
F. Hu, "拘束デバイスのローカリゼーション", Japan Patent JP7652587B2 [pdf]
F. Hu, N. Avadhanam, Y. Ren, et al, "Blickerkennung Unter Verwendung Eines Oder Mehrerer Neuronaler Netzwerke", Gemany Patent DE102020120201A1 [pdf]
F. Hu, S. Yu, "Unter-Fahrzeug-Rekonstruktion zur Visualisierung einer Umgebung eines Fahrzeugs", Gemany Patent DE112023000391T5 [pdf]
F. Hu, N. Avadhanam, S. Baker, et al, "Automatisch einstellbarer Spiegel zur Verwendung in Fahrzeugen" Germany Patent DE112021000051T5 [pdf]
F. Hu, "Lokalisierung von Rückhaltevorrichtungen", Germany Patent DE102021132987A1 [pdf]
F. Hu, N. Avadhanam, "Maschinenlern-basierte Sicherheitsgurt-Detektion und Benutzungserkennung unter Verwenden von Messmarkierung", Gemany Patent DE102021206235A1 [pdf]
F. Hu, N. Avadhanam, S. Baker, et al, "Automatically-adjusting Mirror for Use in Vehicles", Worldwide Patent WO2021154830A1 [pdf]
F. Hu, S. Yu, W. Zhou, "‘Seeing’ the Invisible: Under Vehicle Reconstruction (UVR) for Surround View Visualization", Journal of Physics, 2022 [pdf]
F. Hu, "Non-intrusive Automatic 3D Gaze Ground-truth System", International Conference on Artificial Intelligence and Pattern Recognition, 2022 [pdf]
F. Hu, "Robust Seatbelt Detection and Usage Recognition for Driver Monitoring Systems", AAAI22 Workshop on Trustworthy Autonomous Engineering, 2022 [pdf]
Y. Ren, F. Hu, "Camera Calibration with Pose Guidance", IEEE International Conference on Acoustics, Speech and Signal Processing, 2021 [pdf]
F. Hu, N. Duan, J. Huang, W. Sun, Z. Zhu, "Mining Personalized Climate Preferences for Assistant Driving", arXiv preprint arXiv:2006.08846, 2020 [pdf]
F Hu, "Vision-based Assistive Indoor Localization", Ph.D thesis, 2018 [pdf]
F. Hu, H. Tang, A. Tsema, Z. Zhu, "Computer Vision to See: Access, Understand and Explore Environments using Vision", Computer Vision for Assistive Healthcare, CVPR Series, Elsevier, 2018 [pdf]
J. Huang, N. Duan, P. Ji, C. Ma, F. Hu, Y. Ding, Y. Yu, Q. Zhou, W. Sun, "A Crowdsource-based Sensing System for Monitoring Fine-grained Air Quality in Urban Environments", IEEE Internet of Things Journal, 2018 [pdf]
C. Ma, N. Duan, W. Sun, F. Hu, J. Huang, P. Ji, R. Yao, "Reducing Air Pollution Exposure in A Road Trip". 24rd World Congress on Intelligent Transportation Systems, 2017 [pdf]
F. Hu, Z. Zhu, J. Mejia, H. Tang, J. Zhang, “Real-time Indoor Assistive Localization with Mobile Omnidirectional Vision and Cloud GPU Acceleration”, AIMS Electronics and Electrical Engineering, 2017 [pdf]
W. Sun, N. Duan, P. Ji, R. Yao, C. Ma, J. Huang, F. Hu, "Intelligent In-Vehicle Air Quality Management: A Smart Mobility Application Dealing With Air Pollution In The Traffic". 23rd World Congress on Intelligent Transportation Systems, 2016 [pdf]
H. Tang, N. Tsering, F. Hu, "Automatic Pre-Journey Indoor Map Generation Using AutoCAD Floor Plan", Journal on Technology & Persons with Disabilities, 2016 [pdf]
F. Hu, N. Tsering, H. Tang, Z. Zhu, "Indoor Localization for the Visually Impaired Using a 3D Sensor", Journal on Technology & Persons with Disabilities, 2016 [pdf]
F. Hu, J. Zhang, Z. Zhu, "GPU-accelerated Hierarchical Panoramic Image Feature Retrieval for Indoor Localization", arXiv preprint arXiv:2006.08861, 2016 [pdf]
F. Hu, Z. Zhu, J. Zhang, “Mobile Panoramic Vision for Assisting Blind via Indexing and Localization”, 2014 European Conference on Computer Vision Workshops, 2014 [pdf]
T. Li, F. Hu, Z. Geng, "Structured-light 3D Surface Imaging Technology". Journal of Network New Media, 2012 [pdf]
F. Hu, T. Li, Z. Geng, “Constraints-Based Graph Embedding Optimal Surveillance-Video Mosaicing”, Asian Conference on Pattern Recognition, 2011 [pdf]
T. Li, F. Hu, Z. Geng, “Geometric Calibration of a Camera-Projector 3D Imaging System”, The 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, 2011 [pdf]
T. Li, F. Hu, Z. Geng, "Real-Time Dense 3D Reconstruction with Active Vision System via Graphic Hardware Acceleration", International Conference on Opto-Electronics Engineering and Information Science, 2011 [pdf]
F. Hu, K. Yamamoto, Z. Zhu, "3D Assistive Indoor Localization with a Google Glass", CIE-USA/GNYC Annual Convention (poster), 2016
J. Mejia, F. Hu, H. Tang, Z. Zhu, "iPhone Indoor Navigation System for Visually Impaired People", Emerging Researchers National Conference in STEM (poster), 2016
N. Tsering, F. Hu, H. Tang, "RGB-D Sensor Based Indoor Localization for Visually Impaired", Emerging Researchers National Conference in STEM (poster), 2016
K. Yamamoto, F. Hu, Z. Zhu, "Assistive 3D Indoor Localization With a Wearable Glass", Emerging Researchers National Conference in STEM (poster), 2016
J. Mejia, F. Hu, H. Tang, Z. Zhu, "Assistive Indoor Navigation System for Visually Impaired People", Emerging Researchers National Conference in STEM (poster), 2015
F. Hu, J. Zhang, Z. Zhu, “A Smartphone-based Navigation System for Visually-impaired People”, 7th Annual Graduate Student Symposium, CCNY (Third Prize Winning poster), 2014
F. Hu, Z. Zhu, “Where am I? -Indoor Localization and Navigation for the Visually-Impaired People”, 2nd Annual Computer Science Student Workshop, CUNY (poster), 2014
F. Hu, Z. Zhu, “Vertical Line Detection and Matching for an iPhone Navigation System with a Portable Omnidirectional Lens”, 3rd GNY Area Multimedia and Vision Meeting (poster), 2013
Meta Orion AR Glass: "The Most Advanced Glass The World Has Ever Seen"
- Delivered core calibration and 3D vision infrastructure for AR eye tracking, enabling high-fidelity data collection and model development
Meta Quest: "Expand Your World"
- Delivered core calibration and 3D vision infrastructure for VR eye tracking, enabling high-fidelity data collection and model development
NVIDIA DRIVE: "Accelerating the Future of Autonomous Vehicles"
- Built a calibration platform spanning camera intrinsics, mirror-based camera localization, 3D reconstruction, and nonlinear optimization, enabling millions of 3D gaze ground-truth samples and multiple production releases
[NSF abstract]: "EFRI-M3C: Mobility Skill Acquisition and Learning through Alternative and Multimodal Perception for Visually Impaired People"
Intelligent Panoramic Surveillance System (863 prgram) – Full-stack solution with wide-area coverage, auto camera control, and fisheye correction for enhanced situational awareness
Head-shoulder-based pedestrian detection using HOG and SVM