Publications
2024
FRCSyn Challenge at WACV 2024: Face Recognition Challenge in the Era of Synthetic Data,
Winner on the Main Track and the Balacned Track,
Weisong Zhao, Xiangyu Zhu, Zheyu Yan, Xiao-Yu Zhang, Jinlin Wu, Zhen Lei
IEEE/CVF Winter Conference on Applications of Computer Vision Workshop (WACV), 2024.
[PDF]
2023
Face Forgery Detection by 3D Decomposition and Composition Search,
Xiangyu Zhu, Hongyan Fei, Bin Zhang, Tianshuo Zhang, Xiaoyu Zhang, Stan Z. Li, Zhen Lei
IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2023.
[PDF]
MVP-Human Dataset for 3D Clothed Human Avatar Reconstruction from Multiple Frames,
Xiangyu Zhu, Tingting Liao, Xiaomei Zhang, Jiangjing Lyu, Zhiwen Chen, Yunfeng Wang, Kan Guo, Qiong Cao, Stan Z. Li, Zhen Lei
IEEE Transactions on Biometrics, Behavior, and Identity Science (TBIOM), 2023.
[PDF][Github]
Masked Face Transformer,
Weisong Zhao, Xiangyu Zhu, Kaiwen Guo, Haichao Shi, Xiao-Yu Zhang, and Zhen Lei
IEEE Transactions on Information Forensics and Security (TIFS), 2023.
[PDF]
Dynamic Face Expression Generation with Efficient Neural Radiation Field,
Te Yang, Xiangyu Zhu (corresponding author), Zhen Lei
Chinese Conference on Biometric Recognition (CCBR), 2023.
Best Paper 1st Runner up
EmoTalk: Speech-driven emotional disentanglement for 3D face animation,
Ziqiao Peng, Haoyu Wu, Zhenbo Song, Hao Xu, Xiangyu Zhu, Jun He, Hongyan Liu, Zhaoxin Fan
Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
[PDF]
Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Images,
Chang Yu, Xiangyu Zhu (corresponding author), Xiaomei Zhang, Zhaoxiang Zhang, Zhen Lei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[PDF]
Intrinsic Physical Concepts Discovery with Object-Centric Predictive Models,
Qu Tang, Xiangyu Zhu, Zhen Lei, ZhaoXiang Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[PDF]
OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering,
Zhiyuan Ma, Xiangyu Zhu, Guojun Qi, Zhen Lei, Lei Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[PDF]
High-Fidelity Clothed Avatar Reconstruction from a Single Image,
Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, Xudong Liu,Guo-Jun Qi, Yong Zhang, Xuan Wang, Xiangyu Zhu, Zhen Lei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Grouped Knowledge Distillation For Deep Face Recognition,
Weisong Zhao, Xiangyu Zhu, Kaiwen Guo, Xiao-Yu Zhang, Zhen Lei
Association for the Advancement of Artificial Intelligence (AAAI), 2023.
[PDF]
Cross-Architecture Distillation for Face Recognition,
Weisong Zhao, Xiangyu Zhu, Zhixiang He, Xiao-Yu Zhang, Zhen Lei
ACM Multimedia (ACM MM), 2023.
[PDF]
SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces,
Ziqiao Peng, Yihao Luo, Yue Shi, Hao Xu, Xiangyu Zhu, Hongyan Liu, Jun He, Zhaoxin Fan
ACM Multimedia (ACM MM), 2023.
[PDF]
Modeling Spoof Noise by De-spoofing Diffusion and its Application in Face Anti-spoofing,
Bin Zhang, Xiangyu Zhu (corresponding author), Xiaoyu Zhang, Zhen Lei
IEEE International Joint Conference on Biometrics (IJCB), 2023.
[PDF]
Spoof-Guided Image Decomposition for Face Anti-spoofing,
Bin Zhang, Xiangyu Zhu, Xiaoyu Zhang, Shukai Chen, Peng Li, Zhen Lei
Pattern Recognition and Computer Vision (PRCV), 2023. (Oral)
[PDF]
2022
Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape,
Xiangyu Zhu, Chang Yu, Di Huang, Zhen Lei, Hao Wang, Stan Z. Li
IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2022.
[PDF]
HP-Capsule: Unsupervised Face Part Discovery by Hierarchical Parsing Capsule Network,
Chang Yu, Xiangyu Zhu, Xiaomei Zhang, Zidu Wang, Zhaoxiang Zhang, Zhen Lei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[PDF]
Object Dynamics Distillation for Scene Decomposition and Representation,
Qu Tang, Xiangyu Zhu, Zhen Lei, Zhaoxiang Zhang,
International Conference on Learning Representations (ICLR) , 2022.
[PDF]
Deconfounding Physical Dynamics with Global Causal Relation and Confounder Transmission for Counterfactual Prediction,
Zongzhao Li, Xiangyu Zhu, Zhen Lei, Zhaoxiang Zhang,
36th Annual AAAI Conference on Artificial Intelligence (AAAI), 2022.
[PDF]
Face Forgery Detection by Multi-dimensional Image Decomposition,
Tianshuo Zhang, Xiangyu Zhu, Feng Pan, Ke Xiang, and Zhen Lei
The 16th Chinese Conference on Biometric Recognition(CCBR), 2022.
Best Poster Paper Award
[PDF]
2021
Face Forgery Detection by 3D Decomposition,
Xiangyu Zhu, Hao Wang, Hongyan Fei, Zhen Lei, Stan Z. Li.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[PDF]
Decomposed Meta Batch Normalization for Fast Domain Adaptation in Face Recognition,
Jianzhu Guo, Xiangyu Zhu, Zhen Lei, Stan Z Li.
IEEE Transactions on Information Forensics and Security (TIFS), 2021.
[PDF]
Multi-initialization Optimization Network for Accurate 3D Human Pose and Shape Estimation,
Zhiwei Liu*, Xiangyu Zhu*, Ming Tang, Zhen Lei, Jinqiao Wang. (co-first author)
ACM International Conference on Multimedia (MM), 2021.
[PDF]
3D Context-Aware PIFu for Clothed Human Reconstruction,
Tingting Liao, Xiangyu Zhu, Zhen Lei, and Stan Z. Li.
Chinese Conference on Biometrics Recognition (CCBR), 2021.
[PDF]
2020
Domain Balancing: Face Recognition on Long-Tailed Domains,
Dong Cao, Xiangyu Zhu, Xingyu Huang, Jianzhu Guo, Zhen Lei (co-first author).
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[PDF]
Learning Meta Face Recognition in Unseen Domains,
Jianzhu Guo, Xiangyu Zhu, Chenxu Zhao, Dong Cao, Zhen Lei, Stan Z. Li.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[PDF]
Deep spatial gradient and temporal depth learning for face anti-spoofing,
Zezheng Wang, Zitong Yu, Chenxu Zhao, Xiangyu Zhu, Yunxiao Qin, Qiusheng Zhou, Feng Zhou, Zhen Lei.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[PDF]
Learning Meta Model for Zero-and Few-shot Face Anti-spoofing,
Yunxiao Qin, Chenxu Zhao, Xiangyu Zhu, Zezheng Wang, Zitong Yu, Tianyu Fu, Feng Zhou, Jingping Shi, Zhen Lei.
AAAI Conference on Artificial Intelligence (AAAI). 2020.
[PDF]
Fast Adapting without Forgetting for Face Recognition,
Hao Liu, Xiangyu Zhu, Zhen Lei, Dong Cao, Stan Z Li.
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)，2020.
[PDF]
Out-of-Distribution Detection for Reliable Face Recognition,
Chang Yu, Xiangyu Zhu, Zhen Lei, Stan Z Li.
IEEE Signal Processing Letters (SPL)，2020.
[PDF]
Prior-knowledge and attention based meta-learning for few-shot learning,
Yunxiao Qin, Weiguo Zhang, Chenxu Zhao, Zezheng Wang, Xiangyu Zhu, Jingping Shi, Guojun Qi, Zhen Lei.
Knowledge-Based Systems，2020.
[PDF]
2019
Efficient Face Alignment with Fast Normalization and Contour Fitting Loss,
Zhiwei Liu, Xiangyu Zhu, Ming Tang, Zhen Lei, Jinqiao Wang.
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2019, 15: 89.
[PDF]
Semantic Alignment: Finding Semantically Consistent Ground-Truth for Facial Landmark Detection,
Zhiwei Liu, Xiangyu Zhu, Guosheng Hu, Haiyun Guo, Ming Tang, Zhen Lei, Neil M. Robertson, Jinqiao Wang. (co-first author)
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2019: 3467-3476.
[PDF]
AdaptiveFace: Adaptive Margin and Sampling for Face Recognition,
Hao Liu, Xiangyu Zhu, Zhen Lei, Stan Z. Li.
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2019: 3467-3476.
[PDF]
Improving Face Anti-Spoofing by 3D Virtual Synthesis,
Jianzhu Guo, Xiangyu Zhu, Jinchuan Xiao, Zhen Lei, Genxun Wan, Stan Z Li.
IAPR International Conference on Biometrics (ICB), 2019.
[PDF]
FLDet: A CPU Real-time Joint Face and Landmark Detector,
Chubin Zhuang, Shifeng Zhang, Zhen Lei, Xiangyu Zhu, Jinqiao Wang.
IAPR International Conference on Biometrics (ICB), 2019.
[PDF]
Pose-Weighted Gan for Photorealistic Face Frontalization,
Sufang Zhang, Qinghai Miao, Xiangyu Zhu, Yingying Chen, Zhen Lei, Jinqiao Wang.
IEEE International Conference on Image Processing (ICIP). IEEE, 2019: 2384-2388.
[PDF]
Dense Facial Landmark Localization: database and annotation tool,
Lei Ju, Xiangyu Zhu, Zhen Lei, Xinfang Cui, Wankou Yang, Changyin Sun.
34rd Youth Academic Annual Conference of Chinese Association of Automation (YAC). IEEE, 2019: 625-630.
[PDF]
3DMA: A Multi-modality 3D Mask Face Anti-spoofing Database,
Jinchuan Xiao, Yinhang Tang, Jianzhu Guo, Yang Yang, Xiangyu Zhu, Zhen Lei, Stan Z Li.
16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). 2019: 1-8.
[PDF]
Grand Challenge of 106-Point Facial Landmark Localization,
Yinglu Liu, Hao Shen, Yue Si, Xiaobo Wang, Xiangyu Zhu, Hailin Shi, et al.
In 2019 IEEE International Conference on Multimedia and Expo (ICME) Workshop. 2019.
[PDF]
2018
Detecting face with densely connected face proposal network,
Shifeng Zhang, Xiangyu Zhu, Zhen Lei, Xiaobo Wang, Hailin Shi, Stan Z Li.
Neurocomputing, 2018, 284: 119-127.
[PDF]
Co-Referenced Subspace Clustering,
Xiaobo Wang, Zhen Lei, Hailin Shi, Xiaojie Guo, Xiangyu Zhu, Stan Li.
IEEE International Conference on Multimedia and Expo (ICME), San Diego, USA, July 23-27, 2018. (Best Student Paper Award Runner up).
[PDF]
Single Shot Attention-Based Face Detector,
Chubin Zhuang, Shifeng Zhang, Xiangyu Zhu, Zhen Lei, Stan Z. Li.
CCF Chinese Conference on Biometric Recognition (CCBR), Urumqi, China, Aug. 11-12, 2018.
[PDF]
2017
Face Alignment In Full Pose Range: A 3D Total Solution,
Xiangyu Zhu, Xiaoming Liu, Zhen Lei, Stan Z. Li.
IEEE transactions on pattern analysis and machine intelligence (T-PAMI), 2017, 41(1): 78-92.
[PDF][Supplemental Material][Github]
Cross-Modality Face Recognition via Heterogeneous Joint Bayesian,
Hailin Shi, Xiaobo Wang, Dong Yi, Zhen Lei, Xiangyu Zhu, Stan Z. Li.
IEEE Signal Processing Letters (SPL), 24(1): 81-85, 2017.
[PDF]
S3FD: Single Shot Scale-invariant Face Detector,
Shifeng Zhang, Xiangyu Zhu, Zhen Lei, Hailin Shi, Xiaobo Wang, Stan Z. Li.
In Proceedings of IEEE International Conference on Computer Vision (ICCV), Venice, Oct. 22-29, 2017.
[PDF]
FaceBoxes: A CPU Real-time Face Detector with High Accuracy,
Shifeng Zhang, Xiangyu Zhu, Zhen Lei, Hailin Shi, Xiaobo Wang, and Stan Z. Li.
In Proceedings of the IAPR/IEEE International Joint Conference on Biometrics (IJCB), Denver, Colorado, USA, October 1-4, 2017.
[PDF]
Detecting Face with Densely Connected Face Proposal Network,
Shifeng Zhang, Xiangyu Zhu, Zhen Lei, Hailin Shi, Xiaobo Wang, Stan Z. Li.
In Proceedings of the 12th Chinese Conference on Biometrics (CCBR). ShenZhen, China, Oct. 28-29, 2017. (Best Student Paper Award)
[PDF]
Multi-modality Network with Visual and Geometrical Information for Micro Emotion Recognition,
Jianzhu Guo, Shuai Zhou, Jinlin Wu, Jun Wan, Xiangyu Zhu, Zhen Lei, Stan Z. Li.
Winner of Joint Challenge on Dominant and Complementary Emotion Recognition Using Micro Emotion Features and Head, in conjunction with FG2017, Washington, DC. May 30 –June 3, 2017.
[PDF][PDF]
2016
Face Alignment Across Large Poses: A 3D Solution,
Xiangyu Zhu, Zhen Lei, Xiaoming Liu, Hailin Shi, Stan Z. Li.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021, (Oral).
[PDF][Supplemental Material][Github]
Learning Discriminative Features with Class Encoder,
Hailin Shi, Xiangyu Zhu, Zhen Lei, Shengcai Liao, Stan Z. Li.
In Workshop on Robust Features for Computer Vision, in conjunction with CVPR2016. Las Vegas, June 26-July 1, 2016.
[PDF]
2015
High-Fidelity Pose and Expression Normalization for Face Recognition in the Wild,
Xiangyu Zhu, Zhen Lei, Junjie Yan, Dong Yi, Stan Z. Li.
In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR).Boston, June 7-12, 2015.
[PDF][Supplemental Material][Project]
Discriminative 3D Morphable Model Fitting,
Xiangyu Zhu, Junjie Yan, Dong Yi, Zhen Lei, Stan Z. Li.
In Proceedings of 11th IEEE International Conference on Automatic Face and Gesture Recognition 2015 (FG). Ljubljana, Slovenia, May 4-8, 2015.
[PDF]
Object Detection by Labeling Superpixels,
Junjie Yan, Yinan Yu, Xiangyu Zhu, Zhen Lei, Stan Z. Li.
In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR).Boston, June 7-12, 2015.
[PDF]
Person Re-identification by Local Maximal Occurrence Representation and Metric Learning,
Shengcai Liao, Yang Hu, Xiangyu Zhu, Stan Z. Li.
In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR).Boston, June 7-12, 2015.
[PDF]
2014
Robust 3D Morphable Model Fitting by Sparse SIFT Flow,
Xiangyu Zhu, Dong Yi, Zhen Lei, Stan Z. Li.
In Proceedings of International Conference on Pattern Recognition (ICPR). Sweden, August 24-28, 2014.
[PDF]