Haibin Huang

Haibin Huang

Senior Staff Research Scientist

Kuaishou Technology (Kwai Inc.)

3000 El Camino Real BLDG 5-220, Palo Alto, CA 94306

jackiehuanghaibin at gmail dot com

CV | Google Scholar | GitHub



About Me

I'm currently a Senior Staff Research Scientist at Kuaishou Technology (Kwai Inc.). Previously I was a Research Scientist at Megvii Research. I obtained my PhD in Computer Science from UMass Amherst. During my Ph.D., I worked in the Computer Graphics Research Group with Prof. Evangelos Kalogerakis and Prof. Rui Wang. Before joining UMass Amherst, I obtained my bachelor's and master's degrees in Department of Mathematics , Zhejiang University

My research focuses on visual content analysis and creation. I am interested in developing computer vision, computer graphics, and machine learning techniques that help people to easily create and manipulate digital contents.

[2023/05 Update] We have openings for both full time research scientists and research interns, in vision, graphics and related areas, please feel free to drop me an email if you are interested.

Work Experience

 

Staff Research Scientist, Kwai Inc.

Nov 2019 ~ Present
 

Research Scientist, Megvii(Face++) Research US

October 2017 ~ Nov 2019

Publications

 
Multi-Modal Face Stylization with a Generative Prior
Mengtian Li, Yi Dong, Minxuan Lin, Haibin Huang, Pengfei Wan, Chongyang Ma
PG 2023
[ Project page ] [ Paper] [ Code]

 
ProSpect: Prompt Spectrum of Staged Diffusion Models for Visual Attribute-aware Image Generation
Yuxin Zhang, Weiming Dong, Fan Tang, Nisha Huang, Haibin Huang, Chongyang Ma, Tong-Yee Lee, Oliver Deussen, Changsheng Xu
SIGGRAPHASIA 2023
[ Project page ] [ Paper]

 
Towards Practical Capture of High-Fidelity Relightable Avatars
Haotian Yang, Mingwu Zheng, Wanquan Feng, Haibin Huang, Yu-Kun Lai, Pengfei Wan, Zhongyuan Wang, Chongyang Ma
SIGGRAPHASIA 2023 (Conference)
[ Project page ] [ Paper]

 
Explicit Motion Disentangling for Efficient Optical Flow Estimation
Changxing Deng, Ao Luo, Haibin Huang, Shaodan Ma, Jiangyu Liu,Shuaicheng Liu
ICCV 2023
[ Project page ] [ Paper]

 
3D Keypoint Estimation using Implicit Representation Learning
Xiangyu Zhu, Dong Du, Haibin Huang, Chongyang Ma, Xiaoguang Han
SGP 2023
[ Project page ] [ Paper]

 
A Unified Arbitrary Style Transfer Framework via Adaptive Contrastive Learning
Yuxin Zhang, Fan Tang, Weiming Dong, Haibin Huang, Chongyang Ma, Tong-Yee Lee, Changsheng Xu
TOG 2023
[ Project page ] [ Paper]

 
HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modeling
Yujian Zheng, Zirong Jin, Moran Li, Haibin Huang, Chongyang Ma, Shuguang Cui, Xiaoguang Han
CVPR 2023 (Highlight)
[ Project page ] [ Paper]

 
Semi-Weakly Supervised Object Kinematic Motion Prediction
Gengxin Liu, Qian Sun, Haibin Huang, Chongyang Ma, Yulan Guo,, Li Yi, Hui Huang, Ruizhen Hu
CVPR 2023
[ Project page ] [ Paper]

 
Inversion-Based Style Transfer with Diffusion Models
Yuxin Zhang, Nisha Huang, Fan Tang, Haibin Huang, Chongyang Ma, Weiming Dong, Changsheng Xu
CVPR 2023
[ Project page ] [ Paper]

 
Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance
Xueyi Liu, Ji Zhang, Ruizhen Hu, Haibin Huang, He Wang, Li Yi
ICLR 2023
[ Project page ] [ Paper]

 
Emotion-Aware Music Driven Movie Montage
Wuqin Liu, Minxuan Lin, Haibin Huang, Chongyang Ma,Yu Song, Weiming Dong, Changsheng Xu
CVM 2023
[ Project page ] [ Paper]

 
Implicit Neural Deformation for Multi-View Face Reconstruction
Moran Li, Haibin Huang, Yi Zheng, Mengtian Li, Nong Sang, Chongyang Ma
PG 2022
[ Project page ] [ Paper]

 
LitAR: Visually Coherent Lighting for Mobile Augmented Reality
Yiqin Zhao, Chongyang Ma, Haibin Huang, Tian Guo
IMWUT
[ Project page ] [ Paper]

 
D2C-SR: A Divergence to Convergence Approach for Image Super-Resolution
Youwei Li, Haibin Huang, Lanpeng Jia, Haoqiang Fan, Shuaicheng Liu
ECCV 2022
[ Project page ] [ Paper]

 
Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learning
Yuxin Zhang, Fan Tang, Weiming Dong, Haibin Huang, Chongyang Ma, Tong-Yee Lee, Changsheng Xu
SIGGRAPH 2022 (Conference)
[ Project page ] [ Paper]

 
Deep Constrained Least Squares for Blind Image Super-Resolution
Ziwei Luo, Haibin Huang, Lei Yu, Youwei Li, Haoqiang Fan, Shuaicheng Liu
CVPR 2022
[ Project page ] [ Paper]

 
Task-Aware Sampling Layer for Point-Wise Analysis
Yiqun Lin, Lichang Chen, Haibin Huang, Chongyang Ma, Xiaoguang Han, Shuguang Cui
TVCG 2022
[ Project page ] [ Paper]

 
Point cloud completion on structured feature map with feedback network
Zejia Su, Haibin Huang, Chongyang Ma, Hui Huang, Ruizhen Hu
CVMJ 2022
[ Project page ] [ Paper]

 
UprightRL: Upright Orientation Estimation of 3D Shapes via Reinforcement Learning
Luanmin Chen, Juzhan Xu, Chuan Wang, Haibin Huang, Hui Huang, Ruizhen Hu
PG 2021
[ Project page ] [ Paper]

 
HPNet: Deep Primitive Segmentation Using Hybrid Representations
Siming Yan, Zhenpei Yang, Chongyang Ma, Haibin Huang, Etienne Vouga, Qixing Huang
ICCV 2021
[ Project page ] [ Paper]

 
Scene Synthesis via Uncertainty-Driven Attribute Synchronization
Haitao Yang, Zaiwei Zhang, Siming Yan, Haibin Huang, Chongyang Ma, Yi Zheng, Chandrajit Bajaj, Qixing Huang
ICCV 2021
[ Project page ] [ Paper]

 
FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation
Yisheng He, Haibin Huang, Haoqiang Fan, Qifeng Chen, Jian Sun
CVPR 2021 (Oral presentation)
[ Project page ] [ Paper]

 
NBNet: Noise Basis Learning for Image Denoising with Subspace Projection
Shen Cheng, Yuzhi Wang, Haibin Huang, Donghao Liu, Haoqiang Fan, Shuaicheng Liu
CVPR 2021
[ Project page ] [ Paper]

 
Arbitrary Video Style Transfer via Multi-Channel Correlation
Yingying Deng, Fan Tang, Weiming Dong, Haibin Huang, Chongyang Ma, Changsheng Xu
AAAI 2021
[ Project page ] [ Paper]

 
SAM: Squeeze-and-Mimic Networks for Conditional Visual Driving Policy Learning
Albert Zhao, Tong He, Yitao Liang, Haibin Huang, Guy Van den Broeck, Stefano Soatto
CORL 2020
[ Project page ] [ Paper]

 
Practical Deep Raw Image Denoising on Mobile Devices
Yuzhi Wang, Haibin Huang, Qin Xu, Jiaming Liu, Yiqun Liu, Jue Wang
ECCV 2020 (Spotlight presentation)
[ Project page ] [ Paper]

 
FPConv: Learning Local Flattening for Point Convolution
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han
CVPR 2020
[ Project page ] [ Paper]

 
PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation
Yisheng He, Wei Sun, Haibin Huang, Jianran Liu, Haoqiang Fan, Jian Sun
CVPR 2020
[ Project page ] [ Paper]

 
When AWGN-based Denoiser Meets Real Noises
Yuqian Zhou, Jianbo Jiao, Haibin Huang, Yang Wang, Jue Wang, Honghui Shi, Thomas Huang
AAAI 2020
[ Project page ] [ Paper]

 
Disentangled Image Matting
Shaofan Cai, Xiaoshuai Zhang, Haoqiang Fan, Haibin Huang, Jiangyu Liu, Jiaming Liu, Jiaying Liu, Jue Wang, Jian Sun
ICCV 2019
[ Project page ] [ Paper]

 
Semi-supervised Skin Detection by Network with Mutual Guidance
Yi He*, Jiayuan Shi*, Chuan Wang, Haibin Huang, Jiaming Liu, Guanbin Li, Risheng Liu, Jue Wang
ICCV 2019
[ Project page ] [ Paper]

 
Learning Raw Image Denoising with Bayer Pattern Unification and Bayer Preserving Augmentation
Jiaming Liu, Chi-Hao Wu, Yuzhi Wang, Qin Xu, Yuqian Zhou,Haibin Huang, Chuan Wang, Shaofan Cai, Yifan Ding, Haoqiang Fan, Jue Wang
CVPRW(NTIRE 2019)
[ Project page ] [ Paper]

 
GIF2Video: Color Dequantization and Temporal Interpolation of GIF images
Yang Wang, Haibin Huang, Chuan Wang, Tong He, Jue Wang, Minh Hoai
CVPR 2019
[ Project page ] [ Paper]

 
GeoNet: Deep Geodesic Networks for Point Cloud Analysis
Tong He, Haibin Huang, Li Yi, Yuqian Zhou, Chihao Wu, Jue Wang, Stefano Soatto
CVPR 2019 (Oral presentation)
[ Project page ] [ Paper]

 
Video Inpainting by Jointly Learning Temporal Structure and Spatial Details
Chuan Wang, Haibin Huang, Xiaoguang Han, Jue Wang
AAAI 2019
[ Project page ] [ Paper]

 
Deep Part Induction from Articulated Object Pairs
Li Yi, Haibin Huang, Difan Liu, Evangelos Kalogerakis, Hao Su, Leonidas Guibas
SIGGRAPH Asia 2018
[ Project (Code) ][ Paper ]

 
Global-to-Local Generative Model for 3D Shapes
Hao Wang*, Nadav Schor*, Ruizhen Hu, Haibin Huang, Daniel Cohen-Or, Hui Huang
SIGGRAPH Asia 2018
[ Project page ] [ Paper]

 
Learning Local Shape Descriptors from Part Correspondences With Multi-view Convolutional Networks
Haibin Huang, Evangelos Kalogerakis, Siddhartha Chaudhuri, Duygu Ceylan, Vladimir Kim, Ersin Yumer
TOG 2018. (also presented at SIGGRAPH 2018)
[ Project page ] [ Paper] [ Code ]

 
Learning to Group Discrete Graphical Patterns
Zhaoliang Lun*, Changqing Zou*, Haibin Huang, Evangelos Kalogerakis, Ping Tan, Marie-Paule Cani, Hao Zhang
SIGGRAPH Asia 2017
[ Project page ] [ Paper]

 
High Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inference
Xiaoguang Han*, Zhen Li*, Haibin Huang, Evangelos Kalogerakis, Yizhou Yu
ICCV 2017. (Spotlight presentation)
[ Project page ] [ Paper] [ Code ]

 
Synthesizing 3D Shapes via Modeling Multi-View Depth Maps and Silhouettes with Deep Generative Networks
Amir Arsalan Soltani, Haibin Huang, Jiajun Wu, Tejas Kulkarni, Joshua Tenenbaum
CVPR 2017
[ Project page ] [ Paper] [ Code ]

 
Shape Synthesis from Sketches via Procedural Models and Convolutional Networks
Haibin Huang, Evangelos Kalogerakis, M. Ersin Yumer , Radomir Mech
TVCG 2017
[ Project page ] [ Paper] [ Code ]

 
Analysis and synthesis of 3D shape families via deep-learned generative models of surfaces
Haibin Huang, Evangelos Kalogerakis, Benjamin Marlin
Computer Graphics Forum (SGP 2015)
[Project page ] [ Paper 7MB ] [ Code ] [ Slides Video ]

 
Analogy-Driven 3D Style Transfer
Chongyang Ma, Haibin Huang, Alla Sheffer, Evangelos Kalogerakis, Rui Wang
Computer Graphics Forum (Eurographics 2014)
[Project page ] [ Paper 17MB ] [ Video 28MB Youtube ] [ Slides 8MB ]

 
Point Sampling with General Noise Spectrum
Yahan Zhou, Haibin Huang, Li-Yi Wei, Rui Wang
SIGGRAPH 2012
[ paper (27M) ] [ paper (11M) ] [ Supp ] [ source code]

Thesis

 
Deep-learned Generative Representations of 3D Shape Families
Haibin Huang
Umass Amherst, August 2017

Professional Activities

Journal editorial board

  • The Visual Computer Associate Editor 2022--present

    • Program committee

  • Computational Visual Media (CVM) 2023
  • Shape Modeling International (SMI) 2020 - 2023
  • Uncertainty in Artificial Intelligence (UAI) 2019

    • Paper reviewer

  • Transactions on Graphics
  • Transactions on Pattern Analysis and Machine Intelligence
  • SIGGRAPH
  • SIGGRAPH ASIA
  • ACM Symposium on User Interface Software and Technology (UIST)
  • Neural Information Processing Systems (NeurIPS)
  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • IEEE International Conference on Computer Vision (ICCV)
  • European Conference on Computer Vision (ECCV)
  • Eurographics
  • Pacific Graphics
  • Computer Graphics Forum
  • AAAI Conference on Artificial Intelligence (AAAI)