Home

Zhe Lin

Ph.D. University of Maryland, College Park

Senior Principal Research Scientist / Manager in GenAI

Adobe Research

Adobe Systems Incorporated

Office: Adobe Seattle

Email: limcher2001 'at' gmail 'dot' com

Email (c): zlin 'at' adobe 'dot' com

URL (c): https://research.adobe.com/person/zhe-lin/

[DBLP] [Google Scholar] [LinkedIn]

[Internship/Full-time Opportunities] We are hiring self-motivated graduate student interns anytime throughout the year, so please feel free to contact me if you are interested in working with me on a research project in computer vision, imaging, and generative models.

Bio: I am a researcher in Imaging and Languages Org, Adobe Research. I received a Ph.D. degree in Electrical and Computer Engineering from University of Maryland at College Park in May 2009. Prior to that, I obtained a M.S. degree in Electrical Engineering and Computer Science from Korea Advanced Institute of Science and Technology in August 2004, and a B.Eng. degree in automatic control from University of Science and Technology of China. I have been a member of Adobe Research since May 2009. My research interests include computer vision, image and video processing, generative modeling and artificial intelligence.

Professional services:

Area Chair for CVPR 2022
Area Chair for ACM MM 2020
Area Chair for ECCV 2020
Area Chair for CVPR 2020
Area Chair for ICCV 2019
Area Chair for CVPR 2019
Area Chair for WACV 2018
Reviewers for CVPR, ICCV, ECCV, PAMI, IJCV since 2009
CVPR 2016 Tutorial on Recent Techniques for Image Search
Guest Editor for Pattern Recognition Journal in 2015

Award/Honor:

GenFill/GenExpand technology in Photoshop, Top AI Invention by TIMES, 2023
Distinguished inventor: first employee at Adobe to hold 100th and 200th patents
"Mask-aware Transformer" selected as a Best Paper Finalist in CVPR 2022
Best Reviewer Award for ICCV 2021
"SmartEye" selected as a Best Paper Honorable Mention in CHI 2019
ImageNet Challenge (ILSVRC 2014), Top 1 in classification/localization track
ImageNet Challenge (ILSVRC 2013), Top 6 in classification
PixelNuggets image search demo, PC Magzine Technical Excellence Award, 2011
Siemens Best Paper Award at ISVC 2008, Las Vegas, NV
The best performer at CLEAR 2007 Research Competition, Baltimore, MD

Publications:

Lu Qi, Jason Kuen, Weidong Guo, Jiuxiang Gu, Zhe Lin, Bo Du, Yu Xu, Ming-Hsuan Yang, AIMS: All-Inclusive Multi-Level Segmentation, NeurIPS 2023 (spotlight).
Lu Qi, Jason Kuen, Weidong Guo, Tiancheng Shen, Jiuxiang Gu, Jiaya Jia, Zhe Lin, Ming-Hsuan Yang, High Quality Entity Segmentation, ICCV 2023 (oral).
Lingzhi Zhang, Zhengjie Xu, Connelly Barnes, Yuqian Zhou, Qing Liu, He Zhang, Sohrab Amirghodsi, Zhe Lin, Eli Shechtman, Jianbo Shi, Perceptual Artifacts Localization for Image Synthesis Tasks, ICCV 2023.
Qiucheng Wu, Yujian Liu, Handong Zhao, Trung Bui, Zhe Lin, Yang Zhang, Shiyu Chang, Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synthesis, ICCV 2023.
Jeya Maria Jose Valanarasu, He Zhang, Jianming Zhang, Yilin Wang, Zhe Lin, Jose Echevarria, Yinglan Ma, Zijun Wei, Kalyan Sunkavalli, Vishal M. Patel, Interactive Portrait Harmonization, ICLR 2023.
Yu Zeng, Zhe Lin, Jianming Zhang, Qing Liu, John Collomosse, Jason Kuen, Vishal M. Patel, SceneComposer: Any-Level Semantic Image Synthesis, CVPR 2023 (spotlight).
Shaoan Xie, Zhifei Zhang, Zhe Lin, Tobias Hinz, Kun Zhang, SmartBrush: Diffusion-based Multi-modal Image Inpainting, CVPR 2023 (spotlight).
Yizhi Song, Zhifei Zhang, Zhe Lin, Scott Cohen, Brian Price, Jianming Zhang, Soo Ye Kim, Daniel Aliaga, ObjectStitch: Object Compositing with Diffusion Model, CVPR 2023.
Sijie Zhu, Zhe Lin, Scott Cohen, Jason Kuen, Zhifei Zhang, Chen Chen, TopNet: Transformer-based Object Placement Network for Image Compositing, CVPR 2023.
Chuong Huynh, Yuqian Zhou, Zhe Lin, Connelly Barnes, Eli Shechtman, Sohrab Amirghodsi, Abhinav Shrivastava, Single-click Based Distractor Selection for Photo Cleaning, CVPR 2023.
Mang Tik Chiu, Xuaner Zhang, Zijun Wei, Yuqian Zhou, Eli Shechtman, Connelly Barnes, Zhe Lin, Florian Kainz, Sohrab Amirghodsi, Humphrey Shi, Automatic High Resolution Wire Segmentation and Removal, CVPR 2023.
Qiucheng Wu, Yujian Liu, Handong Zhao, Ajinkya Kale, Trung Bui, Tong Yu, Zhe Lin, Yang Zhang, Shiyu Chang, Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models, CVPR 2023.
Lu Qi, Jason Kuen, Yi Wang, Jiuxiang Gu, Hengshuang Zhao, Zhe Lin, Philip H. S. Torr, Jiaya Jia, Open-World Entity Segmentation, TPAMI.
Jeya Maria Jose Valanarasu, He Zhang, Jianming Zhang, Yilin Wang, Zhe Lin, Jose Echevarria, Yinglan Ma, Zijun Wei, Kalyan Sunkavalli, Vishal M. Patel,
Interactive Portrait Harmonization, ICLR 2023.
Lingzhi Zhang, Yuqian Zhou, Connelly Barnes, Sohrab Amirghodsi, Zhe Lin, Eli Shechtman, Jianbo Shi, Perceptual Artifacts Localization for Inpainting, ECCV 2022, oral.
Haitian Zheng, Zhe Lin, Jingwan Lu, Scott Cohen, Eli Shechtman, Connelly Barnes, Jianming Zhang, Ning Xu, Sohrab Amirghodsi, Jiebo Luo, Image Inpainting with Cascaded Modulation GAN and Object-Aware Training, ECCV 2022.
Sijie Zhu, Zhe Lin, Scott Cohen, Jason Kuen, Zhifei Zhang, Chen Chen, GALA: Toward Geometry-and-Lighting-Aware Object Search for Compositing, ECCV 2022.
Khoi Pham, Kushal Kafle, Zhe Lin, Zhihong Ding, Scott Cohen, Quan Tran, Abhinav Shrivastava, Improving Closed and Open-Vocabulary Attribute Prediction using Transformers, ECCV 2022.
Lu Qi, Jason Kuen, Zhe Lin, Jiuxiang Gu, Fengyun Rao, Dian Li, Weidong Guo, Zhen Wen, Ming-Hsuan Yang, Jiaya Jia, CA-SSL: Class-Agnostic Semi-Supervised Learning for Detection and Segmentation, ECCV 2022.
Yuchen Liu, Zhixin Shu, Yijun Li, Zhe Lin, Richard Zhang, Sun-Yuan Kung, 3D-FM GAN: Towards 3D-Controllable Face Manipulation, ECCV 2022.
Cusuh Ham, Gemma Canet Tarres, Tu Bui, James Hays, Zhe Lin, John P. Collomosse, CoGS: Controllable Generation and Search from Sketch and Style, ECCV 2022.
Yichen Sheng, Yifan Liu, Jianming Zhang, Wei Yin, A. Cengiz Öztireli, He Zhang, Zhe Lin, Eli Shechtman, Bedrich Benes, Controllable Shadow Generation Using Pixel Height Maps, ECCV 2022.
Lingzhi Zhang, Connelly Barnes, Kevin Wampler, Sohrab Amirghodsi, Eli Shechtman, Zhe Lin, Jianbo Shi, Inpainting at Modern Camera Resolution by Guided PatchMatch with Auto-Curation, ECCV 2022.
Dan Ruta, Andrew Gilbert, Pranav Aggarwal, Naveen Marri, Ajinkya Kale, Jo Briggs, Chris Speed, Hailin Jin, Baldo Faieta, Alex Filipkowski, Zhe Lin, John P. Collomosse, StyleBabel: Artistic Style Tagging and Captioning, ECCV 2022.
Haitian Zheng, Zhe Lin, Jingwan Lu, Scott Cohen, Jianming Zhang, Ning Xu, Jiebo Luo, Semantic Layout Manipulation with High-resolution Sparse Attention, TPAMI.
Dan Ruta, Andrew Gilbert, Saeid Motiian, Baldo Faieta, Zhe Lin, John P. Collomosse, HyperNST: Hyper-Networks for Neural Style Transfer, ECCV 2022 VISART Workshop.
Sangryul Jeon, Zhifei Zhang, Zhe Lin, Scott Cohen, Zhihong Ding, Kwanghoon Sohn, COAT: Correspondence-driven Object Appearance Transfer. BMVC 2022.
Bo Sun, Jason Kuen, Zhe Lin, Philippos Mordohai, Simon Chen, PRN: Panoptic Refinement Network, WACV 2023.
Zhankui He, Handong Zhao, Zhaowen Wang, Zhe Lin, Ajinkya Kale, Julian Mcauley, Query-aware Sequential Recommendation, CIKM 2022.
Yu Zeng, Zhe Lin, Vishal Patel, SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches, CVPR 2022.
Wenbo Li, Zhe Lin, Zhou Kun, Lu Qi, Yi Wang, Jiaya Jia, MAT: Mask-Aware Transformer for Large Hole Image Inpainting, CVPR 2022 (oral).
Haoyu Ma, Handong Zhao, Zhe Lin, Ajinkya Kale, Zhangyang Wang, Tong Yu, Jiuxiang Gu, Sunav Choudhary, Xiaohui Xie, Causal CLIP Fine-tuning for Fashion Product Retrieval, CVPR 2022.
Soo Ye Kim, Jianming Zhang, Simon Niklaus, Yifei Fan, Simon Chen, Zhe Lin, Munchurl Kim, Layered Depth Refinement with Mask Guidance, CVPR 2022.
Chenglin Yang, Yilin Wang, Jianming Zhang, He Zhang, Zijun Wei, Zhe Lin, Alan Yuille, Lite Vision Transformer with Enhanced Self-Attention, CVPR 2022.
Tiancheng Shen, Yuechen Zhang, Lu Qi, Jason Kuen, Xingyu Xie, Jianlong Wu, Zhe Lin, Jiaya Jia, High Quality Segmentation for Ultra High-resolution Images, CVPR 2022.
Dat Huynh, Jason Kuen, Zhe Lin, Jiuxiang Gu, Ehsan Elhamifar, Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labeling, CVPR 2022.
Yu Zeng, Zhe Lin, Huchuan Lu, Vishal Patel, CR-Fill: Generative Image Inpainting with Auxiliary Contexutal Reconstruction, ICCV 2021.
Yifan Jiang, He Zhang, Jianming Zhang, Yilin Wang, Zhe Lin, Kalyan Sunkavalli, Simon Chen, Sohrab Amirghodsi, Sarah Kong, Zhangyang Wang, SSH: A Self-Supervised Framework for Image Harmonization, ICCV 2021.
Dan Ruta, Saeid Motiian, Baldo Faieta, Zhe Lin, Hailin Jin, Alex Filipkowski, Andrew Gilbert, John Collomosse, ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity, ICCV 2021.
Alireza Zaeemzadeh, Shabnam Ghadar, Baldo Faieta, Zhe Lin, Nazanin Rahnavard, Mubarak Shah, Ratheesh Kalarot, Face Image Retrieval with Attribute Manipulation, ICCV 2021.
Wentao Jiang, Ning Xu, Jiayun Wang, Chen Gao, Jing Shi, Zhe Lin, Si Liu, Language-Guided Global Image Editing via Cross-Modal Cyclic Mechanism, ICCV 2021.
Zhankui He, Handong Zhao, Zhaowen Wang, Zhe Lin, Ajinkya Kale, Julian McAuley, Locker: Locally Constrained Self-Attentive Sequential Recommendation, CIKM 2021.
Xin Yuan, Zhe Lin, Jason Kuen, Jianming Zhang, Yilin Wang, Michael Maire, Baldo Faieta, Ajinkya Kale, Multimodal Contrastive Training for Visual Representation Learning, CVPR 2021.
Qihang Yu, Jianming Zhang, He Zhang, Yilin Wang, Zhe Lin, Ning Xu, Yutong Bai, Alan Yuille, Mask Guided Matting via Progressive Refinement Network, CVPR 2021.
Yuchen Liu, Zhixin Shu, Yijun Li, Zhe Lin, Sun-Yuan Kung, Content-Aware GAN Compression, CVPR 2021.
Multi-Scale Aligned Distillation for Low-Resolution Detection, CVPR 2021.
Khoi Pham, Kushal Kafle, Zhe Lin, Zhihong Ding, Scott Cohen, Quan Tran, Abhinav Shrivastava, Learning to Predict Visual Attributes in the Wild, CVPR 2021.
Liqian Ma, Zhe Lin, Connelly Barnes, Alexei Efros, Jingwan Lu, Unselfie: Translating Selfies to Neutral-pose Portraits in the Wild, ECCV 2020.
Shikun Liu, Zhe Lin, Yilin Wang, Jianming Zhang, Edward Johns, Shape Adaptor: A Learnable Resizing Module, ECCV 2020.
Kenan E. Ak, Ning Xu, Zhe Lin, Yilin Wang, Incorporating Reinforced Adversarial Learning in Autoregressive Image Generation, ECCV 2020.
Lu Zhang, Jianming Zhang, Zhe Lin, Radomir Mech, Huchuan Lu, Unsupervised Video Object Segmentation with Joint Hotspot Tracking, ECCV 2020.
Xihui Liu, Zhe Lin, Jianming Zhang, Handong Zhao, Quan Tran, Xiaogang Wang, Hongsheng Li, Open-Edit: Open-Domain Image Manipulation with Open-Vocabulary Instructions, ECCV 2020.
Yu Zeng, Zhe Lin, Jimei Yang, Jianming Zhang, Eli Shechtman, Huchuan Lu, High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling, ECCV 2020.
Ping Hu, Fabian Caba Heilbron, Oliver Wang, Zhe Lin, Stan Sclaroff, Federico Perazzi, Temporally Distributed Networks for Fast Video Semantic Segmentation, CVPR 2020.
Chenyun Wu, Zhe Lin, Scott Cohen, Trung Bui, Subhransu Maji, PhraseCut: Language-based Image Segmentation in the Wild, CVPR 2020.
Lijun Wang, Jianming Zhang, Oliver Wang, Zhe Lin, Huchuan Lu, SDC-Depth: Semantic Divide-and-Conquer Network for Monocular Depth Estimation, CVPR 2020.
Ke Xian, Jianming Zhang, Oliver Wang, Long Mai, Zhe Lin, Zhiguo Cao, Structure-Guided Ranking Loss for Single Image Depth Prediction, CVPR 2020.
Zhuowan Li, Quan Tran, Long Mai, Zhe Lin, Alan Yuille, Context-Aware Group Captioning via Self-Attention and Contrastive Features, CVPR 2020.
Zijun Wei, Jianming Zhang, Zhe Lin, Joon-Young Lee, Niranjan Balasubramanian, Minh Hoai, Dimitris Samaras, Learning Visual Emotion Representations from Web Data, CVPR 2020.
Xiaowei Jia, Handong Zhao, Zhe Lin, Ajinkya Kale, Vipin Kumar, Personalized Image Retrieval with Sparse Graph Representation Learning, KDD 2020.
Xuanli He, Quan Hung Tran, Gholamreza Haffari, Walter Chang, Zhe Lin, Trung Bui, Franck Dernoncourt, Nhan Dam, Scene Graph Modification Based on Natural Language Commands, EMNLP 2020.
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas Huang, Free-Form Image Inpainting with Gated Convolution, ICCV 2019 (oral).
Jason Kuen, Federico Perazzi, Zhe Lin, Jianming Zhang, Yap-Peng Tan, Scaling Object Detection by Transferring Classification Weights, ICCV 2019 (oral).
Lu Zhang, Zhe Lin, Jianming Zhang, Huchuan Lu, You He, Fast Video Object Segmentation via Dynamic Targeting Network, ICCV 2019.
Yi Zeng, Pingping Zhang, Jianming Zhang, Zhe Lin, Huchuan Lu, Towards High-Resolution Salient Object Detection, ICCV 2019.
Yulun Zhang, Chen Fang, Yilin Wang, Zhaowen Wang, Zhe Lin, Yun Fu, Jimei Yang, Multimodal Style Transfer via Graph Cuts, ICCV 2019.
Xin Ye, Zhe Lin, Joon-Young Lee, Jianming Zhang, Shibin Zheng, Yezhou Yang, GAPLE: Generalizable Approaching Policy LEarning for Robotic Object Searching in Indoor Environment, IROS 2019 and IEEE Robotics and Automation Letters.
Ajinkya Kale, Baldo Faieta, Zhe Lin, Trung Bui, Tracy King, Multi-modal Correlated Tag Propagation For Boosting Image Search Relevance, KDD 2019 DCCL Workshop.
Hao Tan, Franck Dernoncourt, Zhe Lin, Trung Bui, and Mohit Bansal, Modeling Visual Relationships in Language, ACL 2019.
Pranav Aggarwal, Zhe Lin, Baldo Faieta, and Saeid Motiian, Multitask Text-to-Visual Embedding with Titles and Clickthrough Data. Language and Vision Workshop, in conjunction with CVPR 2019.
Siyuan Qiao, Zhe Lin, Jianming Zhang, and Alan Yuille, Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization CVPR 2019.
Zhifei Zhang, Zhaowen Wang, Zhe Lin, Hairong Qi, Image Super-Resolution by Neural Texture Transfer, CVPR 2019.
Siyuan Qiao, Zhe Lin, Jianming Zhang, and Alan Yuille, Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization, CVPR 2019 (Oral)
Wei Xiong, Jiahui Yu, Zhe Lin, Jimei Yang, Xin Lu, Connelly Barnes, Jiebo Luo, Foreground-aware Image Inpainting, CVPR 2019.
Jiuxiang Gu, Handong Zhao, Zhe Lin, Sheng Li, Jianfei Cai, Mingyang Ling, Scene Graph Generation with External Knowledge and Image Reconstruction, CVPR 2019.
Lu Zhang, Jianming Zhang, Zhe Lin, Huchuan Lu, You He, CapSal: Leveraging Captioning to Boost Semantics for Salient Object Detection, CVPR 2019.
Yingcong Chen, Xiaohui Shen, Zhe Lin, Xin Lu, I-Ming Pao, Jiaya Jia, Semantic Component Decomposition for Face Attribute Manipulation, CVPR 2019.
Shuai Ma, Zijun Wei, Feng Tian, Xiangmin Fan, Jianming Zhang, Xiaohui Shen, Zhe Lin, Jin Huang, Radomír Měch, Dimitris Samaras, Hongan Wang, SmartEye: Assisted Instant Photo Taking via the Integration of User Preferences into the View Proposal Network, CHI 2019. (Best Paper Honorable Mention)
Xin Ye, Zhe Lin, Yezhou Yang, Robot Learning of Manipulation Activities with Overall Planning through Precedent Graph, Robotics and Autonomous Systems, 116 (2019), 126-135.
Lijun Wang, Xiaohui Shen, Jianming Zhang, Oliver Wang, Zhe Lin, Chih-Yao Hsieh, Sarah Kong, Huchuan Lu, DeepLens: Shallow Depth of Field Effect from a Single Image, SIGGRAPH Asia, 2018.
Zijun Wei, Boyu Wang, Minh Nguyen, Jianming Zhang, Zhe Lin, Xiaohui Shen, Radomir Mech, Dimitris Samaras, Sequence-to-Segment Networks for Segment Detection, NeurIPS 2018.
Mengtian Li, Zhe Lin, Ersin Yumer, Radomir Mech, Deva Ramanan, Photo-Sketching: Inferring Contour Drawing from Images, WACV 2019.
Jae-Pil Heo, Zhe Lin, Sung-Eui Yoon, Distance Encoded Product Quantization for Approximate K-Nearest Neighbor Search in High-Dimensional Space, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018.
Xin Ye, Zhe Lin, Haoxiang LI, Shibin Zheng, Yezhou Yang, Active Object Perceiver: Recognition-guided Policy Learning for Object Searching on Mobile Robots, IROS 2018.
Yuhang Song, ChaoYang, Zhe Lin, Xiaofeng Liu, Hao Li, Qin Huang, C.-C. Jay Kuo, Contextual Based Image Inpainting: Infer, Match and Translate, ECCV 2018.
Yufei Wang, Zhe Lin, Xiaohui Shen, Jianming Zhang, Scott Cohen, ConceptMask: Large-Scale Segmentation from Semantic Concepts, ECCV 2018.
Hengshuang Zhao, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Brian Price, Jiaya Jia, Compositing-Aware Image Search, ECCV 2018.
Wei-Chih Hung, Jianming Zhang, Xiaohui Shen, Zhe Lin, Joon-Young Lee, Ming-Hsuan Yang, Learning to Blend Photos, ECCV 2018.
Paul Hongsuck Seo, Zhe Lin, Scott Cohen, Xiaohui Shen, Bohyung Han, Progressive Attention Networks for Visual Attributes Prediction, BMVC 2018.
Ning Yu, Xiaohui Shen, Zhe Lin, Radomir Mech, Connelly Barnes, Learning to Detect Multiple Photographic Defects, WACV 2018.
Jayant Kumar, Zhe Lin, Vipul Dalal, Scaling Fine-Grained Classification to Multiple Objects in a Scene, Fine-Grained Recognition Workshop, in conjunction with CVPR 2018.
Jiahui Yu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Thomas Huang, Generative Image Inpainting with Contextual Attention, CVPR 2018.
Licheng Yu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Mohit Bansal, Tamara L. Berg, MattNet: Modular Attention Network for Referring Expression Comprehension, CVPR 2018.
Jason Kuen, Xiangfei Kong, Zhe Lin, Gang Wang, Jianxiong Yin, Simon See, Yap-Peng Tan, Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks, CVPR 2018.
Zijun Wei, Jianming Zhang, Xiaohui Shen, Zhe Lin, Radomir Mech, Min Hoai, Dimitris Samaras, Good View Hunting: Learning Photo Composition from 1 Million View Pairs, CVPR 2018.
Shanghang Zhang, Xiaohui Shen, Zhe Lin, Radomir Mech, Joao Costeira, Jose Moura, Learning to Understand Image Blur, CVPR 2018.
Jianbo Ye, Xin Lu, Zhe Lin, and James Z. Wang, Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers, ICLR 2018.
Xiaojie Jin, Huaxin Xiao, Xiaohui Shen, Jimei Yang, Zhe Lin, Yunpeng Chen, Zequn Jie, Jiashi Feng, Shuicheng Yan, Predicting Scene Parsing and Motion Dynamics in the Future, NIPS 2017.
Jianming Zhang, Sarah Adel Bargal, Zhe Lin, Xiaohui Shen, Jon Brandt, Stan Sclaroff. Top-down Neural Attention by Excitation Backprop, IJCV, 2017.
Jian Ren, Xiaohui Shen, Zhe Lin, Radomir Mech. Personalized Image Aesthetics, ICCV 2017.
Chenxi Liu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Alan Yulle. Recurrent Multimodal Interaction for Referring Image Segmentation, ICCV 2017.
Xiaojie Jin, Xin Li, Huaxin Xiao, Xiaohui Shen, Zhe Lin, Jimei Yang, Yunpeng Chen, Jian Dong, Luoqi Liu, Zequn Jie, Jiashi Feng, Shuicheng Yan. Video Scene Parsing with Predictive Feature Learning, ICCV 2017.
Xin Li, Zequn Jie, Changsong Liu, Wei Wang, Jimei Yang, Xiaohui Shen, Zhe Lin, Chen Qiang, Shuicheng Yan, Jiashi Feng. FoveaNet: Perspective-aware Urban Scene Parsing, ICCV 2017, oral presentation.
Wei-Chih Hung, Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, Ming-Hsuan Yang. Scene Parsing with Global Context Embedding, ICCV 2017.
Yufei Wang, Zhe Lin, Xiaohui Shen, Radomir Mech, Gavin Miller, Garrison Cottrell. Recognizing and Curating Photo Albums via Event-Specific Image Importance, BMVC 2017, oral presentation.
Zhou Ren, Hailin Jin, Zhe Lin, Chen Fang, Alan Yulle. Multiple Instance Visual-Semantic Embedding, BMVC 2017, oral presentation.
Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, Ming-Hsuan Yang. Deep Image Harmonization, CVPR 2017.
Long Mai, Hailin Jin, Zhe Lin, Chen Fang, Jonathan Brandt, Feng Liu. Spatial-Semantic Image Search by Visual Feature Synthesis, CVPR 2017, spotlight presentation.
Chao Yang, Xin Lu, Eli Shechtman, Oliver Wang, Hao Li. High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis, CVPR 2017.
Yufei Wang, Garrison Cottrell, Zhe Lin, Scott Cohen, Xiaohui Shen. Skeleton Key: Image Captioning by Skeleton-Attribute Decomposition, CVPR 2017.
Jianming Zhang, Shugao Ma, Mehrnoosh Sameki, Stan Sclaroff, Margrit Betke, Zhe Lin, Xiaohui Shen, Brian Price, Radomir Mech, Salient Object Subtizing, IJCV, 2016.
Jianming Zhang, Zhe Lin, Jon Brandt, Xiaohui Shen, Stan Sclaroff, Top-down Neural Attention by Excitation Backprop, ECCV 2016, oral presentation.
Shu Kong, Xiaohui Shen, Zhe Lin, Radomir Mech, Charles Fowlkes, Photo Aesthetics Ranking Network with Attributes and Content Adaptation, ECCV 2016.
Yi-hsuan Tsai, Xiaohui Shen Zhe Lin, Kalyan Sunkavalli, Ming-Hsuan Yang, Sky is Not the Limit: Semantic-Aware Sky Replacement, SIGGRAPH 2016.
Zhou Ren, Hailin Jin, Zhe Lin, Chen Fang, Alan Yulle, Joint Image-Text Representation by Gaussian Visual-Semantic Embedding, ACM Multimedia 2016.
Jianming Zhang, Stan Sclaroff, Zhe Lin, Xiaohui Shen, Brian Price, Radomir Mech, Unconstrained Salient Object Detection via Proposal Subset Optimization, CVPR 2016, spotlight presentation.
Joon-Young Lee, Kalyan Sunkavalli, Zhe Lin, Xiaohui Shen, In-So Kweon, Automatic Content-Aware Color and Tone Stylization, CVPR 2016, spotlight presentation.
Jae-Pil Heo, Zhe Lin, Xiaohui Shen, Jon Brandt, Sung-eui Yoon, Shortlist Selection with Residual-Aware Distance Estimator for K-Nearest Neighbor Search, CVPR 2016.
Haoxiang Li, Jon Brandt, Zhe Lin, Xiaohui Shen, Gang Hua, A Multi-Level Contextual Model For Person Recognition in Photo Albums, CVPR 2016.
Yufei Wang, Zhe Lin, Xiaohui Shen, Radomir Mech, Gavin Miller, Gary Cottrell, Event-specific Image Importance, CVPR 2016.
Xiang Yu, Shaoting Zhang, Zhe Lin, Dimitris Metaxas, Nonlinear Hierarchical Part-based Regression for Unconstrained Face Alignment, IJCAI 2016.
Jianming Zhang, Stan Sclaroff, Zhe Lin, Xiaohui Shen, Brian Price, Radomir Mech, Minimum Barrier Salient Object Detection at 80FPS, ICCV 2015, to appear (oral).
Xin Lu, Zhe Lin, Xiaohui Shen, Radomir Mech, James Wang, Deep Multiple Instance Network, ICCV 2015.
Peng Wang, Xiaohui Shen, Zhe Lin, Scott Cohen, Brian Price, Joint Part and Object Segmentation using Deep Learned Potentials, ICCV 2015.
Haoxiang Li, Zhe Lin, Xiaohui Shen, Jon Brandt, Gang Hua, A Convolutional Neural Network Cascade for Face Detection, CVPR 2015.
Peng Wang, Xiaohui Shen, Zhe Lin, Scott Cohen, Brian Price, Alan Yuille, Towards Unified Depth and Semantic Prediction from a Single Image, CVPR 2015.
Jimei Yang, Brian Price, Scott Cohen, Zhe Lin, Ming-Hsuan Yang, PatchCut: Data-Driven Object Segmentation via Local Shape Transfer, CVPR 2015.
Chen Fang, Hailin Jin, Jianchao Yang, Zhe Lin, Collaborative Feature Learning from Social Media, CVPR 2015.
Jianming Zhang, Shugao Ma, Mehrnoosh Sameki, Stan Sclaroff, Margrit Betke, Zhe Lin, Xiaohui Shen, Brian Price, Radomir Mech, Salient Object Subtizing, CVPR 2015.
Xin Lu, Zhe Lin, Hailin Jin, Jianchao Yang, James Wang, Rating Pictorial Aesthetics using Deep Learning, IEEE Trans. Image Processing 2015
Jiong Yang, Junsong Yuan, Xiaohui Shen, Brian Price, Zhe Lin, Fast Appearance Modeling for Automatic Primary Video Object Segmentation, IEEE Trans. Image Processing 2015
Zhuolin Jiang, Zhe Lin, Haibin Ling, Pavan Turaga, Ling Shao, Fatih Porikli, Discriminative Feature Learning from Big Data for Visual Recognition, Pattern Recognition, Special Issue Editorial
Xin Lu, Zhe Lin, Hailin Jin, Jianchao Yang, Image Specific Prior Adaptation for Denoising, IEEE Trans. Image Processing 2015
Shuang Li, Huchuan Lu, Zhe Lin, Xiaohui Shen, Brian Price, Adaptive Metric Learning for Saliency Detection, IEEE Trans. Image Processing, accepted 2015.
Armin Samii, Radomir Mech, Zhe Lin, Data-driven automatic cropping using semantic composition search, Computer Graphics Forum (CGF), doi: 10.1111/cgf.12465, Oct. 2014.
Jungho Kim, Zhe Lin, In-So Kweon. Rao-Blackwellized particle filtering with Gaussian mixture models for robust visual tracking. Computer Vision and Image Understanding (CVIU) 125: 128-137, 2014.
Xiaohui Shen, Zhe Lin, Jonathan Brandt, Ying Wu: Spatially-Constrained Similarity Measurefor Large-Scale Object Retrieval. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 36(6): 1229-1241, 2014.
Jiong Yang, Gangqiang Zhao, Junsong Yuan, Xiaohui Shen, Zhe Lin, Brian Price, Jon Brandt, Discovering Primary Objects in Videos by Saliency Fusion and Iterative Appearance Estimation, IEEE Trans. Circuits and Systems for Video Technology, 2015.
Zhe Lin, Zhuolin Jiang, Larry S. Davis: Prototype-Based Methods for Human Movement Modeling. Encyclopedia of Computer Vision (ECV), A Reference Guide 2014: 651-654, 2014.
Xin Lu, Zhe Lin, Hailin Jin: Tree-based Locally Linear Regression for Image Denoising , WACV 2015, to appear.
Zhaowen Wang, Jianchao Yang, Zhe Lin, Jon Brandt: - Scalable Similarity Learning using Large Margin Neighborhood Embedding, WACV 2015.
Peng Wang, Zhe Lin, Radomir Mech: Learning an Aesthetic Photo Cropping Cascade, WACV 2015.
Chen Fang, Zhe Lin, Radomir Mech, Xiaohui Shen, Automatic Image Cropping using Visual Composition, Boundary Simplicity and Content Preservation Models, ACM MM 2014, to appear.
Xin Lu, Zhe Lin, Hailin Jin, Jianchao Yang, James Z. Wang, RAPID: Rating Pictorial Aesthetics using Deep Learning, ACM MM 2014, to appear.
Haoxiang Li, Gang Hua, Xiaohui Shen, Zhe Lin, Jon Brandt, Eigen PEP for Video Face Recognition, ACCV 2014.
Brandon M. Smith, Jonathan Brandt, Zhe Lin, Li Zhang: Nonparametric Context Modeling of Local Appearance for Pose- and Expression-Robust Facial Landmark Localization, CVPR 2014.
Haoxiang Li, Zhe Lin, Jonathan Brandt, Xiaohui Shen, Gang Hua: Efficient Boosted Exemplar-Based Face Detection, CVPR 2014.
Jae-Pil Heo, Zhe Lin, Sung-Eui Yoon: Distance Encoded Product Quantization, CVPR 2014.
Xiang Yu, Zhe Lin, Jonathan Brandt, Dimitris N. Metaxas: Consensus of Regression for Occlusion-Robust Facial Feature Localization. ECCV 2014.
Thomas Paine, Hailin Jin, Jianchao Yang, Zhe Lin, Thomas S. Huang: GPU Asynchronous Stochastic Gradient Descent to Speed Up Neural Network Training, ICLR 2014 Workshop.
Xiaoyuan Yu, Jianchao Yang, Zhe Lin, Jiangping Wang, Tianjiang Wang, Thomas Huang. Subcategory-aware Object Detection. IEEE Signal Processing Letters (SPL), accepted for publication, Nov. 2013.
Xiaohui Shen, Zhe Lin, Jon Brandt, Ying Wu. Spatially-Constrained Similarity Measure for Large-Scale Object Retrieval. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI), 2013.
Zhuolin Jiang, Zhe Lin, Larry Davis. Label Consistent K-SVD: Learning A Discriminative Dictionary for Recognition, IEEE Trans. Pattern Anal. Mach. Intell. (PAMI), Vol.35, No.1, Nov 2013.
Zhuolin Jiang, Zhe Lin, Larry S. Davis: A unified tree-based framework for joint action localization, recognition and segmentation. Computer Vision and Image Understanding (CVIU) 117(10): 1345-1355, 2013.
Feng Zhou, Jonathan Brandt, Zhe Lin, Example-baed Graph Matching for Robust Facial Landmark Localization, ICCV 2013.
Weilin Huang, Zhe Lin, Jianchao Yang, Jue Wang, Text localization in natural images using stroke feature transform and text covariance descriptors, ICCV 2013.
Haoxiang Li, Gang Hua, Zhe Lin, Jonathan Brandt, Jianchao Yang, Probabilistic elastic part model for unsupervised face detector adaptation, ICCV 2013.
Haoxiang Li, Gang Hua, Zhe Lin, Jonathan Brandt, Jianchao Yang, Probabilistic Elastic Matching for Pose Variant Face Verification, CVPR 2013.
Zhuoyuan Chen, Hailin Jin, Zhe Lin, Scott Cohen, Ying Wu, Large Displacement Optical Flow from Nearest Neighbor Fields, CVPR 2013.
Brandon Smith, Li Zhang, Jonathan Brandt, Zhe Lin, Jianchao Yang, Exemplar-based Face Parsing, CVPR 2013.
Xiaohui Shen, Zhe Lin, Jonathan Brandt, Ying Wu, Detecting and Aligning Faces by Image Retrieval, CVPR 2013.
Jianchao Yang, Zhe Lin, Scott Cohen, Fast Image Super-resolution based on In-Place Example Regression, CVPR 2013.
Jungho Kim, Jihong Min, In So Kweon, Zhe Lin, Fusing Multiple Independent Estimates via Spectral Clustering for Robust Visual Tracking, IEEE Signal Processing Letters (SPL), Volume, Issue 8, pages 527-530, Aug. 2012.
Jianchao Yang, Zhaowen Wang, Zhe Lin, and Thomas Huang, Coupled Dictionary Training for Image Super-Resolution, IEEE Transactions on Image Processing (TIP), 21(8):3467-3478, 2012.
Zhuolin Jiang, Zhe Lin and Larry S. Davis, Class Consistent k-means: Application to Face and Action Recognition, Journal of Computer Vision and Image Understanding (CVIU), Volume 116, Issue 6, Pages 730-741, June 2012.
Zhuolin Jiang, Zhe Lin, and Larry S. Davis, Recognizing Human Actions by Learning and Matching Shape-Motion Prototype Trees, IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), Vol.34, No.3, 2012.
Vuong Le, Jonathan Brandt, Lubomir Bourdev, Zhe Lin, Interactive Facial Feature Localization, ECCV 2012.
Xiaohui Shen, Zhe Lin, Jonathan Brandt, Ying Wu, Mobile Product Image Search by Automatic Query Object Extraction, ECCV 2012.
Alper Ayvaci, Hailin Jin, Zhe Lin, Scott Cohen, Stefano Soatto, Video Upscaling via Spatio-Temporal Self-Similarity, ICPR 2012.
Zhe Lin, Gang Hua, Larry S. Davis, Multi-scale Shared Features for Cascade Object Detection, ICIP 2012.
Xiaohui Shen, Zhe Lin, Jonathan Brandt, Shai Avidan and Ying Wu, Object Retrieval and Localization with Spatially-Constrained Similarity Measure and k-NN Re-ranking, CVPR 2012.
Jianchao Yang, Zhaowen Wang, Zhe Lin, Xianbiao Shu and Thomas S. Huang, Bilevel Sparse Coding for Coupled Feature Spaces, CVPR 2012.
Zhuolin Jiang, Zhe Lin and Larry S. Davis, Learning A Discriminative Dictionary for Sparse Coding via Label-Consistent K-SVD, CVPR 2011.
Zhe Lin and Larry S. Davis, Shape-based Human Detection and Segmentation via Hierarchical Part-Template Matching, IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), Vol.32, No.4, 2010.
Zhe Lin and Jonathan Brandt, A Localized Bag-of-Features Model for Large-Scale Object Retrieval, ECCV 2010.
Zhuolin Jiang, Zhe Lin and Larry S. Davis, A Tree-based Approach to Integrated Action Localization, Recognition, and Segmentation, ECCV 2010 Workshop on Human Motion.
Zhe Lin, Zhuolin Jiang, and Larry S. Davis, Recognizing Actions by Shape-Motion Prototype Trees, ICCV 2009.
Zhe Lin, Gang Hua, and Larry S. Davis, Multiple Instance Feature for Robust Part-based Object Detection, CVPR 2009.
Zhe Lin and Larry S. Davis, Learning Pairwise Dissimilarity Profiles for Appearance Recognition in Visual Surveillance, ISVC 2008.
Zhe Lin and Larry S. Davis, A Pose-Invariant Descriptor for Human Detection and Segmentation, ECCV 2008.
Zhe Lin, Larry S. Davis, David Doermann and Daniel DeMenthon, Hierarchical Part-Template Matching for Human Detection and Segmentation, ICCV 2007.
Zhe Lin, Larry S. Davis, David Doermann, Daniel DeMenthon, Simultaneous Appearance Modeling and Segmentation for Matching People under Occlusion, ACCV 2007.
Zhe Lin, Larry S. Davis, David Doermann and Daniel DeMenthon, An Interactive Approach to Pose-Assisted and Appearance-based Segmentation of Humans, ICCV 2007 Workshop.
Son Tran, Zhe Lin, David Harwood and Larry Davis, UMD\_VDT, an Integration of Detection and Tracking Methods for Multiple Human Tracking, CLEAR-Evaluation 2007.
Zhe Lin, Sungho Kim and In So Kweon, Recognition-based Indoor Topological Navigation Using Robust Invariant Features, IROS 2005.
Zhe Lin and In So Kweon, Robust Invariant Features for Object Recognition and Mobile Robot Navigation, MVA 2005.