About me

  • I am now an Associate Professor at National Laboratory of Pattern Recognition (NLPR), Institute of Automation Chinese Academic of Sciences (CASIA).
  • My research interest includes machine learning and pattern recognition, especially 3D face/body reconstruction, face recognition, and neural network interpretability.
  • Looking for talents working on 3D face/body reconstruction, biometrics, and AI fundamental. If you are interested, please send me an email with your CV. (欢迎报考研究生的同学联系我。课题组常年招收博士后(北京/香港)和优秀实习生。)


News!

  • Mar. 2024: We won the WACV 2024 Face Recognition Challenge in the Era of Synthetic Data (FRCSyn). Congrats to all collaborators!
  • Dec. 2023: We won the Best Paper 1st Runner Up in CCBR 2023. Congrats to YangTe!
  • Oct. 2023: I am awarded the IAPR Young Biometrics Investigator Award (YBIA). Thanks IAPR TC4 committee [Link].
  • Mar. 2023: My paper (first author) is accepted by TBIOM, and one paper is accepted by TIP.
  • Mar. 2023: Four papers are accepted by CVPR. Congrats to all collaborators!
  • Feb. 2023: We won the Best Poster Paper in CCBR 2022. Congrats to Tianshuo!
  • Feb. 2023: My paper (first author) is accepted by T-PAMI.
  • May. 2022: I am selected by Baidu Xueshu 2022 Global Top Chinese Young Scholars in AI. (百度学术2022年全球华人AI青年学者榜单
  • Apr. 2022: I am supported by Tencent AI Lab Rhino-Bird Focused Research Program. (腾讯AI Lab犀牛鸟专项研究计划)
  • Apr. 2022: My paper (first author) is accepted by T-PAMI.
  • Mar. 2022: One paper working on Capsule Network accepted by CVPR 2022.
  • Jan. 2022: One paper accepted by ICLR 2022.
  • Jan. 2022: Obtain Second Class Prize of the Science and Technology Award, Chinese Institute of Electronics. (中国电子学会科学技术二等奖)


Education

  • Ph.D in Institute of Automation, Chinese Academic of Sciences, 2017, supervised by Prof. Stan Z. Li
  • B.S. in College of Computer Science, Sichuan University, 2012


Work experience

  • 2019~now: Associate Professor
    • National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
  • 2017~2019: Assistant Professor
    • National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences


Selected Publications


 

Face Forgery Detection by 3D Decomposition and Composition Search,
Xiangyu Zhu, Hongyan Fei, Bin Zhang, Tianshuo Zhang, Xiaoyu Zhang, Stan Z. Li, Zhen Lei
IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2023.
[PDF]


 

Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Images,
Chang Yu, Xiangyu Zhu (corresponding author), Xiaomei Zhang, Zhaoxiang Zhang, Zhen Lei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[PDF]


 

MVP-Human Dataset for 3D Clothed Human Avatar Reconstruction from Multiple Frames,
Xiangyu Zhu, Tingting Liao, Xiaomei Zhang, Jiangjing Lyu, Zhiwen Chen, Yunfeng Wang, Kan Guo, Qiong Cao, Stan Z. Li, Zhen Lei
IEEE Transactions on Biometrics, Behavior, and Identity Science (TBIOM), 2023.
[PDF][Github]


 

Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape,
Xiangyu Zhu, Chang Yu, Di Huang, Zhen Lei, Hao Wang, Stan Z. Li
IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2022.
[PDF]


 

HP-Capsule: Unsupervised Face Part Discovery by Hierarchical Parsing Capsule Network,
Chang Yu, Xiangyu Zhu, Xiaomei Zhang, Zidu Wang, Zhaoxiang Zhang, Zhen Lei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[PDF]


 

Face Forgery Detection by 3D Decomposition,
Xiangyu Zhu, Hao Wang, Hongyan Fei, Zhen Lei, Stan Z. Li.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Oral, 2021.
[PDF]


 

Beyond 3DMM Space: Towards Fine-grained 3D Face Reconstruction,
Xiangyu Zhu, Fan Yang, Di Huang, Chang Yu, Hao Wang, Jianzhu Guo, Zhen Lei, Stan Z. Li.
In European Conference on Computer Vision (ECCV), 2020.
[PDF][Github]


 

Towards Fast, Accurate and Stable 3D Dense Face Alignment,
Jianzhu Guo, Xiangyu Zhu, Yang Yang, Fan Yang, Zhen Lei, Stan Z. Li. (co-first author).
In European Conference on Computer Vision (ECCV), 2020.
[PDF] [Github]


 

Large-scale Bisample Learning on ID versus Spot Face Recognition,
Xiangyu Zhu, Hao Liu, Zhen Lei, Hailin Shi, Fan Yang, Dong Yi, Guojun Qi, Stan Z. Li.
Special issue on Deep Learning for Face Analysis. International Journal of Computer Vision (IJCV),2019.
[PDF][Project]


 

Face Alignment In Full Pose Range: A 3D Total Solution,
Xiangyu Zhu, Xiaoming Liu, Zhen Lei, Stan Z. Li.
IEEE transactions on pattern analysis and machine intelligence (T-PAMI), 2017, 41(1): 78-92.
[PDF][Supplemental Material][Github]


 

Face Alignment Across Large Poses: A 3D Solution,
Xiangyu Zhu, Zhen Lei, Xiaoming Liu, Hailin Shi, Stan Z. Li.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Oral, 2021.
[PDF][Supplemental Material][Github][300W-LP][AFLW2000-3D]


 

High-Fidelity Pose and Expression Normalization for Face Recognition in the Wild,
Xiangyu Zhu, Zhen Lei, Junjie Yan, Dong Yi, Stan Z. Li.
In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR).Boston, June 7-12, 2015.
[PDF][Supplemental Material][Project]



Honors & Awards

  • IEEE Senior Member
  • IAPR Young Biometrics Investigator Award 2023 (YBIA) [Link]
  • 2024 The Champion of WACV 2024 Face Recognition Challenge in the Era of Synthetic Data (FRCSyn).
  • 2023 CCBR Best Paper 1st Runner Up.
  • 2022 CCBR Best Poster Paper Award.
  • 2022 Baidu Xueshu 2022 Global Top Chinese Young Scholars in AI. (百度学术2022年全球华人AI青年学者榜单
  • 2022 Tencent AI Lab Rhino-Bird Focused Research Program. (腾讯AI Lab犀牛鸟专项研究计划)
  • 2021 Second Class Prize of the Science and Technology Award, Chinese Institute of Electronics. (中国电子学会科学技术二等奖)
  • 2021 Young Elite Scientist Sponsorship Program by Beijing Association for Science and Technology. (北京科协青年人才托举工程)
  • 2020 Member of the Youth Innovation Promotion Association, Chinese Academy of Sciences. (中国科学院青年创新促进会)
  • 2019 Best Doctoral Dissertation Finalist, China Society of Image and Graphics (CSIG).
  • 2019 The Champion of ICCV19 DeepGlint-Large Track in Light Weight Face Recognition Challenge.
  • 2018 ICME Best Student Paper Award Runner-up.
  • 2017 The Winner of FG2017 facial micro-expression recognition competition.
  • 2017 CCBR Best Student Paper Award.
  • 2017 National scholarship in Chinese Academy of Sciences.
  • 2011 National scholarship in Sichuan University.