Education

Work Experience

  • Jan. 2020 – Pres., Associate Director, Joint AI Research Labs, Univ. of Washington, USA and National Chiao Tung University, Taiwan

  • July 2015 – July 2016, Visiting Professor, IBM Thomas J. Watson Research Center, New York, USA

  • Aug. 2006 – Pres., National Chiao Tung University (NCTU), Hsinchu, Taiwan

    • Professor, Department of Computer Science

    • Director, Division of Industry Cooperation, Office of International Affairs

    • Associate Director, Computer Vision Research Center

    • Secretariat, EECS Center for Circuit Theory, Communications, and Signal Processing

  • Aug. 2011 – Pres., Industrial Technology Research Institute International (ITRI-USA), USA

  • Nov. 2000 – Nov. 2001, Intern, Intel Microprocessor Research Lab, California, USA

Memberships

Research Interests

  • ITU-T/MPEG video coding standards (e.g. HEVC/H.265, Screen Content coding, 360 Video)

  • Machine learning for video understanding (e.g. visual question answering)

  • Multi-modality data fusion for data analytics

  • Graph computing and mining

  • Low-power computer vision

  • Incremental learning

Research Highlights

  • Machine/deep learning

    • Participated in JPEG AI challenge on learned image compression

    • Participated in challenge on learned image compression at 2018, 2019, 2020 CVPR

    • Explored feature-graph-based incremental learning

    • Explored cross-domain/task adaptation through data disentanglement and learning similarity metrics

    • Applied deep reinforcement learning to video encoder control and video prediction

    • Developed structured priors for generative models

    • Explored neural graph learning and knowledge base reasoning

  • Computer vision

    • Conducted joint study with IBM System G group on cross-domain data fusion for multimedia analytics

    • Explored video/image understanding and retrieval (e.g. visual question answering and visual search)

  • ISO/IEC & ITU-T video coding standards

    • Contributed actively to the development of international ITU-T/MPEG standards since 2003

    • Submitted responses (one of the few university teams) to MPEG/ITU Call-for-Proposals on

      • Scalable Video Coding (2004)

      • High-Efficiency Video Coding (2011)

      • HEVC Screen Content Coding Extensions (2014)

    • Coordinated several Core Experiments related to these standards

    • Main inventor of Non-square Intra Block Copy in the HEVC Screen Content Coding Extensions

  • Published 60+ technical papers and 60+ MPEG/ITU standards contributions, and hold 10+ patents

Professional Activities

  • Associate EiC for Digital Communications, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, ’20 - ’21

  • Associate Editor, IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), ’19 - ’20

  • Organizer, IEEE TCSVT Special Section on Learning-based Image and Video Compression, ’20

  • Senior Editorial Board Member, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, ’17 - ’19

  • Guest Editor, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, ’18

  • Guest Editor, IEEE Transactions on Circuits and Systems II (TCAS-II): Express Briefs, ’19

  • Lead Guest Editor, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, ’16 (TOC)

  • Area Chair, IEEE Visual Communications and Image Processing Conference (VCIP), ’20

  • Area Chair, Picture Coding Symposium (PCS), ’19

  • Track Chair, IEEE Int. Symposium on Circuits and Systems (ISCAS), ’18 – Pres.

  • Publication Co-chair, IEEE Int. Conference on Image Processing (ICIP), ’19

  • Distinguished Lecturer, Asia Pacific Signal and Information Processing Association (APSIPA), ’17-’18

  • Technical Program Co-chair, APSIPA Annual Summit Conference, ’18

  • Technical Program Co-chair, Int. Symp. on Intelligent Signal Process. and Comm. Syst. (ISPACS), ’17

  • Area Chair, IEEE Int. Conference on Multimedia and Expo (ICME), ’15, ’18

  • Area Chair, Visual Communications and Image Processing Conference (VCIP), ’15, ‘16

  • Best Reviewer Award, Visual Communications and Image Processing Conference (VCIP), ’13

  • Technical Program Co-chair, Visual Communications and Image Processing Conference (VCIP), ’11

  • Review Committee Member, IEEE Int. Symposium on Circuits and Systems (ISCAS), ’12 – Pres.

  • Best Paper Committee Member, IEEE Int. Conference on Multimedia & Expo (ICME), ’10

  • Special Session Organizer, 2017 IEEE ISPACS, 2014 and 2010 APSIPA ASC; 2010 IEEE ICME

    • Video/Image Processing for New Media (ISPACS 2017)

    • HEVC Screen Content Coding (ASC 2014)

    • High-Efficiency Video Coding (ASC 2010)

    • High-Quality Video Coding (ICME 2010)

  • Technical Program Committee Member, IEEE Int. Symposium on Multimedia (ISM), ’08 – ’15

  • Technical Program Committee Member, IEEE Int. Symposium on Consumer Electronics (ISCE), ’13

  • Technical Program Co-chair, IEEE Workshop on Scalable Video Coding and Transport, ’07

  • Technical Program Committee Members/Reviewers for major conferences/journals:

    • IEEE Computer Vision and Pattern Recognition (CVPR)

    • IEEE Winter Conference on Applications of Computer Vision (WACV)

    • European Conference on Computer Vision (ECCV)

    • Asian Conference on Computer Vision (ACCV)

    • IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

    • IEEE ICCV Workshop on Low-Power Computer Vision

    • IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS)

    • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

    • IEEE Transactions on Multimedia (TMM)

    • IEEE Transactions on Image Processing (TIP)

    • Journal on Visual Communications and Image Processing (JVCI)

    • IEEE International Conference on Multimedia and Expo (ICME)

    • IEEE Visual Communications and Image Processing (VCIP)

    • IEEE International Symposium on Circuits and Systems (ISCAS)

    • IEEE International Conference on Image Processing (ICIP)

    • IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

    • Asia-Pacific Signal and Information Processing and Association Annual Summit Conference (ASC)

    • IEEE International Symposium on Multimedia (ISM)

    • IEEE Workshop Signal Processing and Systems (SiPS)

Invited Talks (Selected)

  • Tutorial, “Recent Advances in End-to-End Learned Image and Video Compression,” in IEEE Visual Communications and Image Processing Conference (VCIP), Macau, Dec. 2020.

  • Talk, “Reinforcement Learning for Video Encoder Control and Video Prediction,” at Leibniz Universität Hannover, Hannover, Germany, Oct. 2019.

  • Talk, “Reinforcement Learning for Video Encoder Control and Video Prediction,” at RWTH Aachen Univ., Aachen, Germany, Oct. 2019.

  • Talk, “Reinforcement Learning for Video Encoder Control and Video Prediction,” at Poznan Univ. of Technology, Poznan, Poland, Oct. 2019.

  • APSIPA Distinguished Lecturer Talk, “Reinforcement Learning for Video Encoder Control and Video Prediction,” at Sungkyunkwan Univ., Suwon, Korea, Mar. 2019.

  • APSIPA Distinguished Lecturer Talk, “Reinforcement Learning for HEVC/H.265 Video Rate Control,” at Tongji Univ., Shanghai, China, Nov. 2018.

  • Talk, “What's trending in CVPR/ICML 2016?” at IBM Thomas J. Watson Research Center, New York, July 2016

  • Guest Lecture, “Large-scale multimedia analysis: MPEG video and visual search,” in EECS E6895: Advanced Big Data Analytics at Columbia University, New York, Apr. 2016

  • Tutorial, “HEVC screen content coding (SCC) – standardization and technologies,” in IEEE Visual Communications and Image Processing Conference (VCIP), Singapore, Dec. 2015

  • Talk, “Recent advances in ITU-T/MPEG video coding standards,” at IBM Thomas J. Watson Research Center, New York, Sep. 2015

Publications (Selected)

  • Y. H. Ho, C. C. Chan, W. H. Peng, H. M. Hang, "End-to-End Learned Image Compression with Augmented Normalizing Flows," IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop, June 2021.

  • Y. C. Huang, Y. H. Chen, C. Y. Lu, H. P. Wang, W. H. Peng and C. C. Huang, "Video Rescaling Networks with Joint Optimization Strategies for Downscaling and Upscaling, " IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2021.

  • S. P. Lee, S. C. Chen, W. H. Peng, "GSVNet: Guided Spatially-Varying Convolution for Fast Semantic Segmentation on Video," IEEE International Conference on Multimedia and Expo (ICME), July 2021.

  • S. Y. Pan*, C. Y. Lu*, S. P. Lee, W. H. Peng, "Weakly-Supervised Image Semantic Segmentation Using Graph Convolutional Networks," IEEE International Conference on Multimedia and Expo (ICME), July 2021.

  • C. H. Lei, Y. H. Chen, W. H. Peng, W. C. Chiu, "Class-incremental Learning with Rectified Feature-Graph Preservation," Asian Conference on Computer Vision (ACCV), Japan, Nov. 2020.

  • W. C. Lee, C. P. Chang, W. H. Peng, and H. M. Hang, "A Hybrid-based Layered Image Compressor," IEEE International Workshop on Multimedia Signal Processing (MMSP), Sep. 2020.

  • Y. H. Ho, C. C. Chan, and W. H Peng, "Deep Video Prediction through Sparse Motion Regularization," IEEE International Conference on Image Processing (ICIP), Oct. 2020.

  • S. Tanujaya, T. Chu, J. H. Liu, and W. H. Peng, "Semantic Segmentation on Compressed Video Using Block Motion Compensation and Guided Inpainting," IEEE International Symposium on Circuits and Systems (ISCAS), Spain, Oct. 2020.

  • Y. H. Ho, C. C. Chan, D. Alexandre, W. H. Peng, C. P. Chang, "P-frame Coding Proposal by NCTU: Parametric Video Prediction through Backprop-based Motion Estimation," IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2020.

  • Y. H. Ho, C. Y. Cho, W. H Peng, and G. L. Jin "SME-Net: Sparse Motion Estimation for Parametric Video Prediction through Reinforcement Learning," IEEE International Conference on Computer Vision (ICCV), Oct. 2019.

  • C. P. Chang, D. Alexandre, W. H. Peng and H. M. Hang, "Description of Challenge Proposal by NCTU: An Autoencoder-based Image Compressor with Principle Component Analysis and Soft-Bit Rate Estimation," CVPR Workshop and Challenge on Learned Image Compression, June 2019.

  • Y. H. Ho, C. Y. Cho, and W. H Peng, "Deep Reinforcement Learning for Video Prediction," IEEE International Conference on Image Processing (ICIP), Sep. 2019.

  • D. Alexandre, C. P. Chang, W. H. Peng, H. M. Hang, "Learned Image Compression with Soft Bit-based Rate-Distortion Optimization," IEEE International Conference on Image Processing (ICIP), Sep. 2019.

  • Y. W. Chang and W. H. Peng, "Learning Goal-oriented Visual Dialogue: Imitating and Surpassing Analytic Experts," IEEE International Conference on Multimedia and Expo (ICME), July 2019.

  • W. L. Chang*, H. P. Wang*, W. H. Peng and W. C. Chiu, "All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation," IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.

  • M. Wien, J. M. Boyce , T. Stockhammer, and W. H. Peng, "Immersive Video Coding Standardization Status," IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Mar. 2019.

  • D. Alexandre, C. P. Chang, W. H. Peng and H. M. Hang, "An Autoencoder-based Learned Image Compressor: Description of Challenge Proposal by NCTU", CVPR Workshop and Challenge on Learned Image Compression, June 2018.

  • L. C. Chen*, J. H. Hu* and W. H. Peng, "Reinforcement Learning for HEVC/H.265 Frame-level Bit allocation," in Proc. IEEE International Conference on Digital Signal Processing (DSP), Dec. 2018.

  • H. P. Wang, W. J. Ko, and W. H. Peng, "Learning Priors for Adversarial Autoencoders," in Proc. Asia-Pacific Signal and Information Processing Association (APSIPA), 2018.

  • J. H. Hu, W. H. Peng, and C. H. Chung, "Reinforcement learning for HEVC/H.265 intra-frame rate control," in Proc. IEEE Int. Symposium on Circuits and Systems (ISCAS), May 2018.

  • C. H. Chung, W. H. Peng and J. H. Hu, "HEVC/H.265 coding unit split decision using deep reinforcement learning," in Proc. IEEE Int. Symposium on Intelligent Signal Processing and Communications Systems (ISPACS), Nov. 2017.

  • W.-H. Peng, F. Walls, R. A. Cohen, J. Xu, J. Ostermann, S. MacInnis, and T. Lin, “Overview of screen content video coding: technologies, standards, and beyond,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 6, no. 4, pp. 393 - 408, Dec. 2016

  • C.-C. Chen and W.-H. Peng, “Intra line copy for HEVC screen content intra-picture prediction,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 27, no. 7, pp. 1568 - 1579, July 2017

  • W.-L. Ku, H.-C. Chou, W.-H. Peng, “Discriminatively-learned global image representation using CNN as a local feature extractor for image retrieval”, in Proc. IEEE Visual Communications and Image Processing Conference (VCIP), Dec. 2015