Publications [Google Scholar]

2021

Suzhen Wang, Lincheng Li, Yu Ding, Changjie Fan, Xin Yu: Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion. International Joint Conference on Artificial Intelligence (IJCAI), 2021. (13.9% acceptance rate)

Ruijie Quan, Xin Yu, Yi Yang: Removing Raindrops and Rain Streaks in One Go. CVPR, 2021

Zongxin Yang, Xin Yu, Yi Yang: DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistency. CVPR, 2021

Yujiao Shi, Hongdong Li, Xin Yu: Self-Supervised Visibility Learning for Novel View Synthesis. CVPR, 2021

Dongxu Li*, Chenchen Xu*, Kaihao Zhang*, Xin Yu, Yiran Zhong, Wenqi Ren, Hanna Suominen, Hongdong Li: ARVo: Learning All-Range Volumetric Correspondence for Video Deblurring. CVPR, 2021

Hehe Fan, Xin Yu, Yuhang Ding, Yi Yang, Mohan Kankanhalli: PSTNet: Point Spatio-Temporal Convolution on Point Cloud Sequences. ICLR, 2021

Heming Du, Xin Yu, Liang Zheng: VTNet: Visual Transformer Network for Object Goal Navigation. ICLR, 2021.

Yuhang Ding, Xin Yu, Yi Yang: Modeling the Probabilistic Distribution of Unlabeled Data for One-shot Medical Image Segmentation. AAAI, 2021.

Lincheng Li*, Suzhen Wang*, Zhimeng Zhang*, Yu Ding*, Yixing Zheng, Xin Yu, Changjie Fan: Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation. AAAI, 2021

Yizhak Ben-Shabat, Xin Yu, Fatemeh Saleh, Dylan Campell, Cristian Rodriguez-Opazo, Hongdong Li, Stephen Gould: The Ikea ASM dataset: Understanding People Assembling Furniture through actions, objects and pose. WACV, 2021.

Tianqi Tang, Xin Yu, Xuanyi Dong, Yi Yang: Auto-Navigator: Decoupled Neural Architecture Search for Visual Navigation. WACV, 2021.

Fan Ma, Yu Wu, Xin Yu, Yi Yang: Learning with Noisy Labels via Self-Reweighting from Class Centroids. (TNNLS), 2021

Ruijie Quan, Yu Wu, Xin Yu, Yi Yang: Progressive Transfer Learning for Face Anti-Spoofing. IEEE Transactions on Image Processing (TIP). 2021

Yang Zhang, Ivor Tsang, Yawei Luo, Changhui Hu, Xiaobo Lu, Xin Yu: Recursive Copy and Paste GAN: Face Hallucination from Shaded Thumbnails. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021.

Yunqiu Xu, Chunluan Zhou, Xin Yu, Bin Xiao, Yi Yang: Pyramid Multiple Instance Detection Network with Mask Guided Self-correction for Weakly Supervised Object Detection. IEEE Transactions on Image Processing (TIP), 2021.

Yang Zhang, Ivor Tsang, Jun Li, Ping Liu, Xiaobo Lu, Xin Yu: Face Hallucination with Finishing Touches. IEEE Transactions on Image Processing (TIP), 2021.

Hehe Fan, Tao Zhuo, Xin Yu, Yi Yang, Mohan Kankanhalli: Understanding Atomic Hand-Object Interaction with Human Intention. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2021.

2020

Liyuan Pan, Richard Hartley, Cedric Scheerlinck, Miaomiao Liu, Xin Yu, Yuchao Dai: High Frame Rate Video Reconstruction based on an Event Camera. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020.

Dongxu Li*, Chenchen Xu*, Xin Yu, Kaihao Zhang, Benjamin Swift, Hanna Suominen, Hongdong Li: TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation. NuerIPS, 2020.

Zhibo Wang, Xin Yu, Ming Lu, Quan Wang, Chen Qian, Feng Xu: Single Image Based Portrait Relighting via Explicit Multiple Channel Modeling. Siggraph Asia, (ACM Transactions on Graphics), 2020

Xin Yu, Zheyu Zhuang, Piotr Koniusz, Hongdong Li: 6DoF Object Pose Estimation via Differentiable Proxy Voting Loss. BMVC 2020.

Peike Li, Xuanyi Dong, Xin Yu, Yi Yang: When Humans Meet Machines: Towards Efficient Segmentation Networks. BMVC 2020.

Heming Du, Xin Yu, Liang Zheng: Learning Object Relation Graph and Tentative Policy for Visual Navigation. ECCV 2020.

Yujiao Shi, Xin Yu, Dylan Campbell, Hongdong Li: Where am I looking at? Geo-localization by Cross-view Image Alignment. CVPR, 2020.

Jing Zhang, Xin Yu, Aixuan Li, Peipei Song, Bowen Liu, Yuchao Dai: Weakly-supervised Salient Object Detection via Scribble Annotations. CVPR, 2020.

Dongxu Li, Xin Yu, Chenchen Xu, Lars Petersson, Hongdong Li: Transferring Cross-domain Knowledge for Video Sign Language Recognition. CVPR, 2020. (Oral) (Nominated for Best Paper Award)

Yang Zhang, Ivor Tsang, Yawei Luo, Changhui Hu, Xiaobo Lu, Xin Yu: Copy and Paste GAN: Face Hallucination from Shaded Thumbnails. CVPR, 2020. (Oral)

Zheyu Zhuang, Xin Yu, Robert Mahony: LyRN (Lyapunov Reaching Network): A real-time closed loop approach from monocular vision, IEEE International Conference on Robotics and Automation (ICRA), 2020.

Yujiao Shi, Xin Yu, Liu Liu, Tong Zhang, Hongdong Li: Optimal Feature Transport for Cross-View Image Geo-Localization. AAAI , 2020 (Oral).

Dongxu Li, Cristian Rodriguez Opazo, Xin Yu, Hongdong Li: Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison. WACV, 2020, (Best Paper Honorable Mention) Project

Xin Yu, Basura Fernando, Fatih Porikli, Richard Hartley: Hallucinating Unaligned Face Images by Multiscale Transformative Discriminative Networks. International Journal of Computer Vision (IJCV), 2020.

2019

Xin Yu, Basura Fernando, Richard Hartley, Fatih Porikli: Semantic Face Hallucination: Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019.

Xin Yu, Fatemeh Shiri, Bernard Ghanem, Fatih Porikli: Can We See More? Joint Frontalization and Hallucination of Non-frontal Tiny Faces by Transformative Adversarial Neural Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019.

Yujiao Shi, Liu Liu, Xin Yu, Hongdong Li, Spatial-Aware Feature Aggregation for Cross-View Image Based Geo-Localization. NeurIPS, 2019.

Yupei Zheng*, Xin Yu*, Miaomiao Liu, Shunli Zhang: Residual Multiscale Based Single Image Deraining. BMVC, 2019, (equal contributions, spotlight)

Liyuan Pan, Cedric Scheerlinck, Xin Yu, Richard Hartley, Miaomiao Liu, Yuchao Dai: Bringing a Blurry Frame Alive at High Frame-Rate with an Event Camera. CVPR, 2019. (Oral)

Yurun Tian, Xin Yu, Bin Fan, Fuchao Wu, Huub Heijnen, Vassileios Balntas: SOSNet: Second Order Similarity Regularization for Local Descriptor Learning. CVPR, 2019. (Oral)

Xin Yu, Yurun Tian, Fatih Porikli, Richard Hartley, Hongdong Li, Huub Heijnen, Vassileios Balntas: Unsupervised Extraction of Local Image Descriptors via Relative Distance Ranking Loss. International Workshop on Compact and Efficient Feature Representation and Learning in Computer Vision (in conjunction with ICCV), 2019.

Fatima Shiri, Xin Yu, Richard Hartley, Fatih Porikli, Piotr Koniusz: Recovering Faces from Portraits with Auxiliary Facial Attributes. WACV, 2019.

2018

Xin Yu, Basura Fernando, Bernard Ghanem, Fatih Porikli, Richard Hartley: Face Super-resolution Guided by Facial Component Heatmaps. ECCV, 2018.

Xin Yu, Basura Fernando, Richard Hartley: Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes. CVPR, 2018.

Xin Yu, Fatih Porikli: Imagining the Unimaginable Faces by Deconvolutional Networks. IEEE Transactions on Image Processing, 2018.

Fatima Shiri, Xin Yu, Fatih Porikli, Richard Hartley, Piotr Koniusz: Identity-preserving Face Recovery from Portraits. WACV, 2018.

2017

Xin Yu, Fatih Porikli: Hallucinating Very Low-Resolution Unaligned and Noisy Face Images by Transformative Discriminative Autoencoders. CVPR, 2017. (spotlight)

Xin Yu, Fatih Porikli: Face Hallucination with Tiny Unaligned Images by Transformative Discriminative Neural Networks.AAAI, 2017. (oral)

Han Yan, Xin Yu, Yu Zhang, Shunli Zhang, Xiaolin Zhao, and Li Zhang: Single Image Depth Estimation with Normal Guided Scale Invariant Deep Convolutional Fields. IEEE Transactions on Circuits and Systems for Video Technology. 2017

Fatima Shiri, Xin Yu, Piotr Koniusz, Fatih Porikli: Face Destylization. DICTA 2017.

Lincheng Li, Xin Yu, Shunli Zhang, Xiaolin Zhao, Li Zhang: 3D Cost Aggregation with Multiple Minimum Spanning Trees for Stereo Matching. Applied Optics, 2017.

2016

Xin Yu, Fatih Porikli: Ultra-Resolving Face Images by Discriminative Generative Networks.ECCV 2016.

Lincheng Li, Shunli Zhang, Xin Yu, Li Zhang: PMSC: PatchMatch-Based Superpixel Cut for Accurate Stereo Matching.IEEE Transactions on Circuit and System for Video Technolgy, 2016.

before 2016

Xin Yu, Shunli Zhang, Xiaolin Zhao, and Li Zhang: Removing Blur Kernel Noise via Hybrid‘p Norm Regularization. Journal of Electronic Imaging. 24(1), 013011, 2015.

Shunli Zhang, Xin Yu, Yao Sui, and Li Zhang: Object Tracking with Multi-View Support Vector Machines.IEEE Transactions on Multimedia. 17(3):265-278, 2015.

Shunli Zhang, Sui Yao, Zhao Sicong, Xin Yu, Zhang Li: Multi-local-task learning with global regularization for object tracking.Pattern Recognition, 48(12):3881-3894, 2015.

Shunli Zhang, Yao Sui, Xin Yu, Sicong Zhao, Li Zhang: Hybrid support vector machines for robust object tracking.Pattern Recognition, 48(8):2474-2488, 2015.

Yao Sui, Shunli Zhang, Xin Yu, Sicong Zhao, Li Zhang: Self-Expressive Tracking. Pattern Recognition. 48.9: 2872-2884, 2015.

Xin Yu, Xiaolin Zhao, Yao Sui, and Li Zhang: Handling noise in single image defocus map estimation by using directional filters.Optics Letters. 39(21): 6281-6284, 2014.

Xin Yu, Feng Xu, Shunli Zhang, Li Zhang: Efficient Patch-wise Non-uniform Deblurring for a Single Image.IEEE Transactions on Multimedia. 16(6):1510-1524, 2014.

Hui Wu, Xin Yu, Yao Sui, Li Zhang: Recover 3D Structure of Outdoor Scenes from a Single Image. Journal of Image and Graphic. 2012(07).

Xiaolin Zhao, Xin Yu, Liguo Sun, Kangqiao Hu, Guijin Wang, and Li Zhang: Non-rigid Object Tracking as Salient Region Segmentation and Association.IEICE Transactions on Information and Systems, 94(4):934-937, 2011.