AI Researcher at Netease Fuxi AI Lab
About Me
I am currently a senior artificial intelligence researcher and director of the Visual Computing Group at Netease Fuxi AI Lab (opens new window) as of 2017 after receiving my PhD from Wuhan University (opens new window). My research interests include 3d face/hair/body/object/scene reconstruction, expression/motion generation and differentiable renderer etc. I focused on frontier research and technology transformation of computer vision and computer graphics in online games. My work has been published by top journals/conferences (TPAMI, CVPR, ICCV, ECCV, AAAI, SIGGRAPH etc) and successfully applied to a number of important games (Justice PC (opens new window), Ghosts PC (opens new window), Ghosts Mobile (opens new window), Revelation PC (opens new window), Revelation Mobile (opens new window) etc) in NetEase.
I am hiring interns.
News
[Dec. 02, 2021] 1 paper accepted by AAAI 2022
[Jul. 23, 2021] 1 paper accepted by ICCV 2021
[Jul. 04, 2021] 1 paper accepted by ACMMM 2021
[Jun. 24, 2021] Our program "Character Auto-creation V2" won the NetEase Thunder Fire Innovation Award 2021
[Apr. 29, 2021] 1 paper accepted by IJCAI 2021
[Mar. 06, 2021] 1 paper accepted by ICME 2021 (Oral)
[Mar. 01, 2021] 1 paper accepted by CVPR 2021 (Oral)
[Dec. 02, 2020] 5 papers accepted by AAAI 2021
[Oct. 27, 2020] Our program "Character Auto-creation V1" won the NetEase Best Technology Innovation Award 2020
[Sep. 06, 2020] 1 paper accepted by TPAMI
[Jul. 26, 2020] 4 papers accepted by ACMMM 2020
[Jul. 03, 2020] 1 paper accepted by ECCV 2020 (Oral)
[Mar. 06, 2020] 1 paper accepted by CVPR 2020
[Nov. 11, 2019] 2 papers accepted by AAAI 2020
[Jul. 23, 2019] 1 paper accepted by ICCV 2019
[Mar. 26, 2019] 1 paper accepted by SIGGRAPH 2019
Professional Activities
Invited Talks
TechBeat sharing 2021 (opens new window) (Online), AAAI Series Work, Video (opens new window)
TechBeat sharing 2020 (opens new window) (Online), Research and Application of Game Character Auto-Creation, Video (opens new window)
MSRA CVPR paper sharing session 2020 (opens new window) (Online), 3D Face Reconstruction Using GCNs, Video (opens new window)
NVIDIA GTC 2018 (opens new window) (Suzhou), Deep Neural Network for Game Animation, PPT (opens new window), Video (opens new window)
Young Technology Developers Conference 2017 (opens new window) (Peking University), Artificial Intelligence in Game
Conference Committees
ICCV: 2019 (opens new window) (Seoul)
ECCV: 2020 (opens new window)
Siggraph: 2018 (opens new window) (Vancouver), 2019 (opens new window) (Los Angeles)
AAAI: 2019, 2020 (opens new window)
GDC: 2019 (opens new window) (San Francisco), 2020 (opens new window)
ISPRS: 2016 (opens new window) (Prague)
Projects
Virtual Character Creation
Bone-based Game Character Auto-creation from RGB images
3D Face Reconstruction from RGB images
3D Hair Reconstruction from RGB images
3D Body Reconstruction from RGB images
2D Cartoon Character Auto-creation from RGB images
Automatic Skin Binding
Virtual Character Drive
Human Facial Expression Transfer from RGB videos
Human Motion Transfer from RGB videos
Human Motion Embedding and Generation
Publications (Selected)
( * for corresponding author, † for equal contribution author, Full list (opens new window))
A Unified Framework for Real Time Motion Completion
Yinglin Duan, Yue Lin, Zhengxia Zou, Yi Yuan, Zhehui Qian, Bohan Zhang
the Association for the Advance of Artificial Intelligence (AAAI), 2022
RFNet: Recurrent Forward Network for Dense Point Cloud Completion
Tianxin Huang, Hao Zou, Jinhao Cui, Xuemeng Yang, Mengmeng Wang, Xiangrui Zhao, Jiangning Zhang, Yi Yuan, Yifan Xu, Yong Liu
International Conference on Computer Vision (ICCV), 2021
ZiGAN:Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach
Qi Wen, Shuang Li, bingfeng han, Yi Yuan*
ACM Multimedia (ACMMM), 2021
Automatic Translation of Music-to-Dance for In-Game Characters
Yinglin Duan†, Tianyang Shi†, Zhipeng Hu, Zhengxia Zou, Changjie Fan, Yi Yuan*, Xi Li
International Joint Conference on Artificial Intelligence (IJCAI), 2021
Stylized Neural Painting
Zhengxia Zou, Tianyang Shi, Shuang Qiu, Yi Yuan, Zhenwei Shi
Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)
[PDF (opens new window)] [arXiv (opens new window)] [Code (opens new window)]
Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlation
Jilin Tang, Yi Yuan*, Tianjia Shao, Yong Liu, Mengmeng Wang, Kun Zhou
the Association for the Advance of Artificial Intelligence (AAAI), 2021
In-game Residential Home Planning via Visual Context-aware Global Relation Learning
Lijuan Liu, Yin Yang, Yi Yuan*, Tianjia Shao, He Wang, Kun Zhou
the Association for the Advance of Artificial Intelligence (AAAI), 2021
HR-Depth : High Resolution Self-Supervised Monocular Depth Estimation
Xiaoyang Lyu, Liang Liu, Mengmeng Wang, Xin Kong, Lina Liu, Yong Liu*, Xinxin Chen, Yi Yuan
the Association for the Advance of Artificial Intelligence (AAAI), 2021
One-shot Face Reenactment Using Appearance Adaptive Normalization
Guangming Yao†, Tianjia Shao†, Yi Yuan*, Shuang Li, Shanqi Liu, Yong Liu, Mengmeng Wang, Kun Zhou
the Association for the Advance of Artificial Intelligence (AAAI), 2021
MeInGame: Create a Game Character Face from a Single Portrait
Jiangke Lin, Yi Yuan*, Zhengxia Zou
the Association for the Advance of Artificial Intelligence (AAAI), 2021
[PDF (opens new window)] [arXiv (opens new window)] [Code (opens new window)]
Neural Rendering for Game Character Auto-creation
Tianyang Shi†, Zhengxia Zou†, Zhenwei Shi, Yi Yuan*
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020
Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer
Xinhui Song, Tianyang Shi, Zunlei Feng, Mingli Song, Jackie Lin, Chuanjie Lin, Changjie Fan, Yi Yuan*
ACM Multimedia (ACMMM), 2020
Neutral Face Game Character Auto-Creation via PokerFace-GAN
Tianyang Shi, Zhengxia Zou, Xinhui Song, Zheng Song, Changjian Gu, Changjie Fan, Yi Yuan*
ACM Multimedia (ACMMM), 2020
Mesh Guided One-shot Face Reenactment Using Graph Convolutional Networks
Guangming Yao†, Yi Yuan†, Tianjia Shao*, Kun Zhou
ACM Multimedia (ACMMM), 2020
Dynamic Future Net: Diversified Human Motion Generation
WenHeng Chen, He Wang, Yi Yuan*, Tianjia Shao, Kun Zhou
ACM Multimedia (ACMMM), 2020
Ladybird: Quasi-Monte Carlo Sampling for Deep Implicit Field Based 3D Reconstruction with Symmetry
Yifan Xu†, Tianqi Fan†, Yi Yuan*, Gurprit Singh
European Conference on Computer Vision (ECCV), 2020 (Oral)
Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks
Jiangke Lin, Yi Yuan*, Tianjia Shao, Kun Zhou
Computer Vision and Pattern Recognition (CVPR), 2020
[PDF (opens new window)] [arXiv (opens new window)] [Code (opens new window)] [Video (opens new window)]
Fast and Robust Face-to-Parameter Translation for Game Character Auto-creation
Tianyang Shi, Zhengxia Zou, Yi Yuan*, Changjie Fan
the Association for the Advance of Artificial Intelligence (AAAI), 2020
FDN: Feature Decoupling Network for Head Pose Estimation
Hao Zhang, Mengmeng Wang, Yong Liu, Yi Yuan
the Association for the Advance of Artificial Intelligence (AAAI), 2020
Face-to-Parameter Translation for Game Character Auto-Creation
Tianyang Shi, Yi Yuan*, Changjie Fan, Zhengxia Zou, Zhenwei Shi*, Yong Liu
International Conference on Computer Vision (ICCV), 2019
NeuroSkinning: Automatic Skin Binding for Production Characters with Deep Graph Networks
Lijuan Liu, Youyi Zheng*, Di Tang, Yi Yuan, Changjie Fan, Kun Zhou*
ACM Transactions on Graphics (SIGGRAPH), 2019 (Oral)
[PDF (opens new window)] [Data (opens new window)] [Video (opens new window)]
Patents
- CN113160848, 2021 announcement
- CN113112577, 2021 announcement
- CN112991445, 2021 announcement
- CN112991152, 2021 announcement
- CN112990283, 2021 announcement
- CN112973122, 2021 announcement
- CN112967251, 2021 announcement
- CN112862807, 2021 announcement
- CN112861806, 2021 announcement
- CN112802075, 2021 announcement
- CN112800869, 2021 announcement
- CN112785494, 2021 announcement
- CN112669447, 2021 announcement
- CN112508776, 2021 announcement
- CN112419487, 2021 announcement
- CN112365576, 2021 announcement
- CN112200236, 2021 announcement
- CN112190934, 2021 announcement
- CN111898701, 2020 announcement
- CN111882643, 2020 announcement
- CN111803956, 2020 announcement
- CN111632374, 2020 announcement
- CN111540021, 2020 announcement
- CN111524171, 2020 announcement
- CN111524232, 2020 announcement
- CN111389008, 2020 announcement
- CN111369440, 2020 announcement
- CN111275779, 2020 announcement
- US20200202111A1 announcement
- CN110852974, 2020 announcement
- CN110717977, 2020 announcement
- CN110717928, 2020 announcement
- CN110704657, 2020 announcement
- CN110427899, 2019 announcement
- CN110415322, 2019 announcement
- CN110288681, 2019 announcement
- CN110188688, 2019 announcement
- CN110102051, 2019 announcement
- CN110009716, 2019 announcement
- CN109993819, 2019 announcement
- CN109840019, 2019 announcement
- CN109821239, 2019 announcement
- CN109902767, 2019 announcement certificate
- CN109636886, 2018 announcement certificate
Awards & Honors
NetEase Thunder Fire Innovation Award, 2021
NetEase Best Technology Innovation Award, 2020
Excellent Graduate Student of Wuhan University, 2017
National Scholarship for Doctoral Students, 2016
Academic Scholarship, 2016
National Scholarship for Doctoral Students, 2015
Academic Scholarship, 2015