ByungIn Yoo (유병인)

 architectmind at gmail.com; byungin.yoo at samsung.com

 Google Scholar

 Facebook

Employment History 

 * Military Service as a Professional Research Staff., 1999.2 – 2004.2



Education 

Statistical Inference and Information Theory Lab., KAIST, Daejeon, Korea. 

Dissertation: Exploiting data expansion and generation for visual recognition based on deep models

Advisor: Dr. Junmo Kim (2013 – 2021)

Montreal Institute for Learning Algorithm, Quebec, Canada.  

Research topic: Joint Learning of Generative Translator and Classifier for Visually Similar Classes 

Advisor: Dr. Yoshua Bengio (2018 – 2019)

Parallel and Distributed Algorithm Lab., Dongguk Univ., Seoul, Korea. 

Thesis: Improving the performance of TCP over mobile computing environments based on wireless link states and data characteristics

Advisor: Dr. Young-Sik Hong (1997 – 1999)

Dept. of Computer Science and Engineering, Dongguk Univ., Seoul, Korea. (1993 – 1997)



Award & Honors 

First contributor

Hyundai Electronics / Maeil Business News Paper / Hyundai Information Technology, 1997.8.22.


Co-contributor



Research Interests

Fusion algorithms and architectures that combine machine learning, computer vision, parallel & distributed system,

computer graphics, and software engineering



Technical Skills 

Pytorch; TensorFlow; Caffe; Python;

C; C++; C#; MATLAB; UML; Design Pattern;

OpenCV; OpenGL; Direct X; OpenMP; MPI(Message Passing Interface)



Academic Activity

  


Publication 

International Journal      

"Joint Learning of Generative Translator and Classifier for Visually Similar Classes", 

IEEE Access, Volume 8, Dec. 2020. doi: 10.1109/ACCESS.2020.3042302

“Deep Facial Age Estimation using Conditional Multitask Learning with Weak Label Expansion”, 

IEEE Signal Processing Letters, Volume: 25, Issue: 6, June 2018. doi: 10.1109/LSP.2018.2822241

“Deep Neural Network using Color and Synthesized Three-dimensional Shape for Face Recognition”, 

Journal of Electronic Imaging. 26(2), 020502, Mar. 2017. doi: 10.1117/1.JEI.26.2.020502

“Novel LCDs with IR-sensitive Backlights”, 

Journal of Society for Information Display, vol. 19, issue 1 , pp 48-56, Jan. 2011.  doi: /10.1889/JSID19.1.48 


Domestic Journal

“Research Trend for Approaching Human-Level Image Recognition based on Deep Learning”,

COMMUNICATIONS OF THE KOREA INFORMATION SCIENCE SOCIETY 33(9), 2015.9, 32-41. (Invited paper)


arXiv

"Deep generative-contrastive networks for facial expression recognition", arXiv:1703.07140


International Conference 

"MBFusion: A New Multi-modal BEV Feature Fusion Method for HD Map Construction", 

IEEE International Conference on Robotics and Automation (ICRA), 2024.

"Efficient Learning on Successive Test Time Augmentation", 

IEEE Conf. on Accoustics, Speech and Signal Processing (ICASSP), 2024.

British Machine Vision Conference (BMVC), 2023. (Oral,  arXiv:2303.06800)

"Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentation", 

Computer Vision and Pattern Recognition (CVPR), 2022. (Poster,  arXiv:2112.08949)

"Large Scale Multi-Illuminant (LSMI) Dataset for Developing White Balance Algorithm under Mixed Illumination", 

International Conference on Computer Vision (ICCV), 2021. (Poster) 

"Learning Generalized Intersection Over Union for Dense Pixelwise Prediction", 

Thirty-eighth International Conference on Machine Learning (ICML), 2021. (Short Talk)  

"RaSNet: Learning Tiny Models by Raster-Scanning Images", 

Computer Vision and Pattern Recognition (CVPR), 2021. (Poster) 

"Controllable Image Restoration for Under-Display Camera in Smartphones", 

Computer Vision and Pattern Recognition (CVPR), 2021. (Poster)

"Order Regularization on Ordinal Loss for Head Pose, Age and Gaze Estimation", 

the Thirty-Fifth AAAI Conference on Artificial Intelligence 2021

"AFOD: Adaptive Focused Discriminative Segmentation Tracker", 

Eight (8th) Visual Object Tracking Challenge Workshop in ECCV 2020

"A Generalized and Robust Method Towards Practical Gaze Estimation on Smart Phone", 

Gaze Estimation and Prediction in the Wild Workshop in ICCV 2019

"Residual Encoder Decoder Network and Adaptive Prior for Face Parsing", 

the Thirty-Second AAAI Conference on Artificial Intelligence 2018. (Oral)

"Rotating Your Face Using Multi-task Deep Neural Network", 

IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015. (Poster) 

"Randomized Decision Bush: Combining Global Shape Parameters and Local Scalable Descriptors for Human Body Parts Recognition", 

IEEE International Conference on Image Processing (ICIP), 2014. (Poster)

"HDO: A novel local image descriptor", 

IEEE International Conference on Image Processing (ICIP), 2014. (Poster)

“RoVatar: Semi-autonomous Robot Boxing Game by Miniature Avatars”, 

ACM CHI '14 Extended Abstracts on Human Factors in Computing Systems, 2014. (Poster)

“Real-time 3D Human Pose Recognition from Reconstructed Volume via a Voxel Classifier”, 

IS&T/SPIE Electronic Imaging 2014. (Oral)

“Recognition combined human pose tracking using single depth images”, 

IS&T/SPIE Electronic Imaging 2014. (Oral)

“Real-Time Hand Shape Recognition by Orientation Invariant Data Learning for Smart TV”, 

International Conference on Consumer Electronics, 2013. (Oral)

“Novel Interactive Display with IR-sensitive backlights for touch and hover sensing”, 

International Display Workshop, Dec. 2011. (Invited talk, Oral)

“3D Remote Interface for Smart Displays”,  

ACM CHI '11 Extended Abstracts on Human Factors in Computing Systems, 2011. (Oral)

“Novel LCD with a Sensible Backlight”,  

SID 2010 Symposium, 2010. (Distinguished Paper Award, Oral)

“3D User Interface Combining Gaze and Hand Gestures for Large-Scale Display”, 

ACM CHI '10 Extended Abstracts on Human Factors in Computing Systems, 2010. (Poster)

“The seamless browser: enhancing the speed of web browsing by zooming and preview thumbnails”, 

the 17th ACM International Conference on World Wide Web, 2008. (Poster)


Domestic Conference

“Efficient Learning methods for a Randomized Decision Forest using a Supercomputer”, 

the Institute of Electronics Engineers of Korea, Summer Conference 2013. (Invited paper, Oral)

“Improving the performance of TCP over Mobile Computing Environments based on Wireless Link States and Data Characteristics”, 

the Korea Information Science Society, 25th Fall Conference, Korea Institute of Information Scientists and Engineers 1998. (Oral)

“Design and Implementation of a Syntax Directed SGML Editor Supporting Unicode Chinese Characters”, 

the Korea Information Science Society, 25th Spring Conference, Korea Institute of Information Scientists and Engineers 1998. (Oral)


Samsung Best Paper Award

“Live Face or Not? Towards Real Biometric for Robust Face Unlock on Mobile Devices”, 

Samsung Tech. Conference, Oct. 2017. (Silver Award)

“Light-Weight High-Performance Deep Neural Network Architecture for Mobile Devices”, 

Samsung Tech. Conference, Nov. 2016. (Silver Award)

“A Highly Reliable Authentication using Finger-print and Face Recognition for Mobile Devices”, 

Samsung Tech. Conference, Nov. 2015. (Bronze Award)

“Real-time User Extraction using a Consumer Depth Camera”, 

Samsung Tech. Conference, Nov. 2013.

“Real-Time Hand Shape Recognition System for Smart TV”,  

Samsung Tech. Conference, Nov. 2013.

“Real-Time Human Pose Estimation from a Single Depth Image Using Ensemble of Recognition and Tracking”, 

Samsung Tech. Conference, Nov. 2013.

“3D Human Volume Reconstruction from a Single Depth Image”, 

Samsung Tech. Conference, Nov. 2012.

“Smart 3D TV User Interface Combining LoS and Hand Motion”, 

Samsung Tech. Conference, Nov. 2010.

“Gesture Recognition for Large Display of Next Generation”, 

Samsung Tech. Conference, Nov. 2009.  


Domestic Magazine Articles


Invited Seminar



Patents / International Standards

Google Patents 

      Over 70 patents were granted in US, Europe, China, Japan and Korea.

      Over 110 patent applications have been filed in US, Europe, China, Japan, and Korea.

 

International Standards

ISO/IEC JTC1/SC29/WG11/M20138 "Hand based interaction for intuitive manipulation", 2011

ISO/IEC   JTC1/SC29/WG11  MPEG-U 23006-2: Advanced User Interface

–   Hand Shape and Hand Gesture Description

  


Professional Experience – Major Projects

 

Samsung Advanced Institute of Technology, Samsung Electronics Co. Ltd.  (2005.12.-Present, http://www.sait.samsung.co.kr/)

Multimodal Foundation Model: 2023.11 - 

     - Project Leader

     - Research in SAM (Samsung AI Model for Semiconductor Unleashing the Next-generation Growth)

Autonomous Machine Perception: 2022.11 - 2023.10

     - Project Leader

     - Research in multi-modal vision foundation model and data intelligence for autonomous driving

Sensor Vision: 2022.1 - 2022.10

     - Project Leader

     - Research in core computer vision algorithms on AI sensors

Deep Image Processing: 2019.5 - 2021.12

     - Project Leader

     - Research in deep image processing and computer vision algorithms for Samsung's inherent image sensors

     - Samsung Tech. Fair 2021, “Scanning Tele Cam. Auto Tracking” exhibition

Unsupervised Generative Model: 2017.12 - 2019.4

     - Research in fusing generative and classification models

Deep Learning based Emotion Recognition: 2015.12 - 2017.11

     - Research in facial expression emotion, and personality recognition

     - Research in facial attributes such as gender, age, and ethnicity

     - Research in body/face segmentation

     - Research in gaze and head orientation estimation

     - Samsung Tech. Fair 2016, “Facial expression based emotion recognition” exhibition

Deep Learning based Face Recognition: 2014.1 - 2017.11

     - Research in liveness detection

     - Research in guide learning for discriminative visual features

     - Research in multi-task learning for facial attributes and identification

     - Samsung Tech. Fair 2015, “Robust face recognition” exhibition

Deep Learning based Object Recognition: 2013.11-2014.2

     - Research in convolutional neural network based objects recognition

Human Recognition: 2013.5 - 2013.11

    - Research in human activity recognition and user identification algorithms without face related information 

        by fusing color-depth images

Spatial Interface: 2009.1-2013.5

    - Research in human structure analysis algorithms which are related to human pose estimation, shape reconstruction, 

        and motion recognition from depth sequences

    - Development of machine learning algorithms which use big data and super-computers

    - Research in user interface methods which are related to human-device interactions and human-robot interactions

    - Research in 3D spatial touch interface methods based on hands gesture recognition and line-of-sight estimation

    - Implementation of immersive wall computing architectures which provide immersive user experiences 

        based on employing a huge screen

    - Development of software prototypes to verify the proposed algorithms and interfaces

    - Samsung Tech. Fair 2012, “Depth camera based human pose estimation and gaming experiences” exhibition

    - Mobile World Congress 2012, “Depth camera based human pose estimation and gaming experiences” exhibition.

Virtual Reality Entertainment System: 2008.6-2010.1

    - Research in virtual reality platforms with motion sensors, sensing algorithms and 3D graphics processing hardware

    - Integration software services which distribute control information from multiple sensors to the proposed virtual world system

    - Development of prototypes to verify the proposed system

    - Samsung Tech. Fair 2009, “Human motion sensing based virtual reality system prototype” exhibition

Interactive Display Computing Architecture: 2008.6-2009.1

    - Research in interactive display architectures with a sensible backlight and hand detection algorithms 

        to control 3D contents far from a display

    - Development of system prototypes to verify the proposed architectures

Semantic Browser Platform for IPTV: 2007.2-2008.5

    - Research in a zoomable semantic browser platform which converts web pages to summarized contents for fitting a TV display

    - Development of semantic web browser prototypes to verify the proposed algorithms and interfaces

    - Samsung Tech. Fair 2008, “Semantic browser prototype” exhibition

Multimodal I/O System: 2005.12-2007.1

    - Research in multi modality based interactions for mobile devices such as mobile phones and cameras

    - Development of camera prototypes to verify the proposed interfaces

    - Samsung Tech. Fair 2007, “Display button prototype” exhibition


AhnLab, Inc. (2002.3.-2005.12, http://www.ahnlab.com/)

V3 Internet Security:  2004.12 - 2005.11

    - Design and development of core software modules as a software architect

ACA (AhnLab Common Architecture) 1.0 for Windows: 2004.4 – 2004.12

    - Design and development of core software modules as a software architect

    - Proposal of a unified platform which enables integrating antivirus modules, firewall modules, and anti-spyware modules

    - Proposal of a reusable framework which supports core functions for developing security software

    - Migration of 32bit software modules to a 64bit platform

    - Guidance of writing secure codes

V3Pro 2004: 2003.3 – 2004.3

V3Pro 2002: 2002.3 – 2003.2

    - Design and development of core software modules as a technical leader

    - Proposal of novel functions such as start-up monitoring and system optimizations

    - Localization of software modules for Japan and China products


UNITECH Co. Ltd. (1999.2.-2002.3, http://www.unitech.co.kr/)

SimFL (Simulator Framework Library) 1.0: 2001.6-2002.2

    - Design and development of core software modules as a team leader

    - Proposal of a novel simulator framework which consists of reusable software modules based on the development experiences

    - The framework has been used frequently in library form

KAAV (Korean Amphibious Assault Vehicle) Simulator System: 2001.7-2002.2

ASU1.5-6000-540RPSA Simulator System: 2000.6-2001.2

HAWK Anti Air Guided Missile Combat Simulator System: 1999.2-2001.6

    - Design of core software architectures of simulator systems as a team leader

    - Development of simulations server systems which control overall simulator systems


Etc.

Management Information System for Young-San Chem., Ltd.: 1998.10-1999.2

    - Development of a management information system for a small chemistry company as a freelance

Construction of Wireless Fax Network, KT(Korea Telecom): 1996.8-1997.2

    - Development of an automatic system which measures availability of constructing network as a freelance