Yi Yuan (袁 燚)

AI Researcher at Netease Fuxi AI Lab

scholar
github
email

About Me

I am currently a senior artificial intelligence researcher and director of the Visual Computing Group at Netease Fuxi AI Lab (opens new window) as of 2017 after receiving my PhD from Wuhan University (opens new window). My research interests include 3d face/hair/body/object/scene reconstruction, expression/motion generation and differentiable renderer etc. I focused on frontier research and technology transformation of computer vision and computer graphics in online games. My work has been published by top journals/conferences (TPAMI, CVPR, ICCV, ECCV, AAAI, SIGGRAPH etc) and successfully applied to a number of important games (Justice PC (opens new window), Ghosts PC (opens new window), Ghosts Mobile (opens new window), Revelation PC (opens new window), Revelation Mobile (opens new window) etc) in NetEase.

I am hiring interns.

News

  • [Jul. 23, 2021] 1 paper accepted by ICCV 2021

  • [Jul. 04, 2021] 1 paper accepted by ACMMM 2021

  • [Jun. 24, 2021] Our program "Character Auto-creation V2" won the NetEase Thunder Fire Innovation Award 2021

  • [Apr. 29, 2021] 1 paper accepted by IJCAI 2021

  • [Mar. 06, 2021] 1 paper accepted by ICME 2021 (Oral)

  • [Mar. 01, 2021] 1 paper accepted by CVPR 2021 (Oral)

  • [Dec. 02, 2020] 5 papers accepted by AAAI 2021

  • [Oct. 27, 2020] Our program "Character Auto-creation V1" won the NetEase Best Technology Innovation Award 2020

  • [Sep. 06, 2020] 1 paper accepted by TPAMI

  • [Jul. 26, 2020] 4 papers accepted by ACMMM 2020

  • [Jul. 03, 2020] 1 paper accepted by ECCV 2020 (Oral)

  • [Mar. 06, 2020] 1 paper accepted by CVPR 2020

  • [Nov. 11, 2019] 2 papers accepted by AAAI 2020

  • [Jul. 23, 2019] 1 paper accepted by ICCV 2019

  • [Mar. 26, 2019] 1 paper accepted by SIGGRAPH 2019

Professional Activities

Invited Talks

Conference Committees

Projects

Virtual Character Creation

  • Bone-based Game Character Auto-creation from RGB images

  • 3D Face Reconstruction from RGB images

  • 3D Hair Reconstruction from RGB images

  • 3D Body Reconstruction from RGB images

  • 2D Cartoon Character Auto-creation from RGB images

  • Automatic Skin Binding

Virtual Character Drive

  • Human Facial Expression Transfer from RGB videos

  • Human Motion Transfer from RGB videos

  • Human Motion Embedding and Generation

Publications (Selected)

( * for corresponding author, † for equal contribution author, Full list (opens new window))

RFNet: Recurrent Forward Network for Dense Point Cloud Completion

Tianxin Huang, Hao Zou, Jinhao Cui, Xuemeng Yang, Mengmeng Wang, Xiangrui Zhao, Jiangning Zhang, Yi Yuan, Yifan Xu, Yong Liu

International Conference on Computer Vision (ICCV), 2021

ZiGAN:Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach

Qi Wen, Shuang Li, bingfeng han, Yi Yuan*

ACM Multimedia (ACMMM), 2021

Automatic Translation of Music-to-Dance for In-Game Characters

Yinglin Duan†, Tianyang Shi†, Zhipeng Hu, Zhengxia Zou, Changjie Fan, Yi Yuan*, Xi Li

International Joint Conference on Artificial Intelligence (IJCAI), 2021

Stylized Neural Painting

Zhengxia Zou, Tianyang Shi, Shuang Qiu, Yi Yuan, Zhenwei Shi

Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)

[PDF (opens new window)] [arXiv (opens new window)] [Code (opens new window)]

Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlation

Jilin Tang, Yi Yuan*, Tianjia Shao, Yong Liu, Mengmeng Wang, Kun Zhou

the Association for the Advance of Artificial Intelligence (AAAI), 2021

[PDF (opens new window)] [arXiv (opens new window)]

In-game Residential Home Planning via Visual Context-aware Global Relation Learning

Lijuan Liu, Yin Yang, Yi Yuan*, Tianjia Shao, He Wang, Kun Zhou

the Association for the Advance of Artificial Intelligence (AAAI), 2021

[PDF (opens new window)] [arXiv (opens new window)]

HR-Depth : High Resolution Self-Supervised Monocular Depth Estimation

Xiaoyang Lyu, Liang Liu, Mengmeng Wang, Xin Kong, Lina Liu, Yong Liu*, Xinxin Chen, Yi Yuan

the Association for the Advance of Artificial Intelligence (AAAI), 2021

[PDF (opens new window)] [arXiv (opens new window)]

One-shot Face Reenactment Using Appearance Adaptive Normalization

Guangming Yao†, Tianjia Shao†, Yi Yuan*, Shuang Li, Shanqi Liu, Yong Liu, Mengmeng Wang, Kun Zhou

the Association for the Advance of Artificial Intelligence (AAAI), 2021

[PDF (opens new window)] [arXiv (opens new window)]

MeInGame: Create a Game Character Face from a Single Portrait

Jiangke Lin, Yi Yuan*, Zhengxia Zou

the Association for the Advance of Artificial Intelligence (AAAI), 2021

[PDF (opens new window)] [arXiv (opens new window)] [Code (opens new window)]

Neural Rendering for Game Character Auto-creation

Tianyang Shi†, Zhengxia Zou†, Zhenwei Shi, Yi Yuan*

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020

[PDF (opens new window)]

Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer

Xinhui Song, Tianyang Shi, Zunlei Feng, Mingli Song, Jackie Lin, Chuanjie Lin, Changjie Fan, Yi Yuan*

ACM Multimedia (ACMMM), 2020

[PDF (opens new window)] [arXiv (opens new window)]

Neutral Face Game Character Auto-Creation via PokerFace-GAN

Tianyang Shi, Zhengxia Zou, Xinhui Song, Zheng Song, Changjian Gu, Changjie Fan, Yi Yuan*

ACM Multimedia (ACMMM), 2020

[PDF (opens new window)] [arXiv (opens new window)]

Mesh Guided One-shot Face Reenactment Using Graph Convolutional Networks

Guangming Yao†, Yi Yuan†, Tianjia Shao*, Kun Zhou

ACM Multimedia (ACMMM), 2020

[PDF (opens new window)] [arXiv (opens new window)]

Dynamic Future Net: Diversified Human Motion Generation

WenHeng Chen, He Wang, Yi Yuan*, Tianjia Shao, Kun Zhou

ACM Multimedia (ACMMM), 2020

[PDF (opens new window)] [arXiv (opens new window)]

Ladybird: Quasi-Monte Carlo Sampling for Deep Implicit Field Based 3D Reconstruction with Symmetry

Yifan Xu†, Tianqi Fan†, Yi Yuan*, Gurprit Singh

European Conference on Computer Vision (ECCV), 2020 (Oral)

[PDF (opens new window)] [arXiv (opens new window)]

Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks

Jiangke Lin, Yi Yuan*, Tianjia Shao, Kun Zhou

Computer Vision and Pattern Recognition (CVPR), 2020

[PDF (opens new window)] [arXiv (opens new window)] [Code (opens new window)] [Video (opens new window)]

Fast and Robust Face-to-Parameter Translation for Game Character Auto-creation

Tianyang Shi, Zhengxia Zou, Yi Yuan*, Changjie Fan

the Association for the Advance of Artificial Intelligence (AAAI), 2020

[PDF (opens new window)] [arXiv (opens new window)]

FDN: Feature Decoupling Network for Head Pose Estimation

Hao Zhang, Mengmeng Wang, Yong Liu, Yi Yuan

the Association for the Advance of Artificial Intelligence (AAAI), 2020

[PDF (opens new window)]

Face-to-Parameter Translation for Game Character Auto-Creation

Tianyang Shi, Yi Yuan*, Changjie Fan, Zhengxia Zou, Zhenwei Shi*, Yong Liu

International Conference on Computer Vision (ICCV), 2019

[PDF (opens new window)] [arXiv (opens new window)]

NeuroSkinning: Automatic Skin Binding for Production Characters with Deep Graph Networks

Lijuan Liu, Youyi Zheng*, Di Tang, Yi Yuan, Changjie Fan, Kun Zhou*

ACM Transactions on Graphics (SIGGRAPH), 2019 (Oral)

[PDF (opens new window)] [Data (opens new window)] [Video (opens new window)]

Patents

Awards & Honors

  • NetEase Thunder Fire Innovation Award, 2021

  • NetEase Best Technology Innovation Award, 2020

  • Excellent Graduate Student of Wuhan University, 2017

  • National Scholarship for Doctoral Students, 2016

  • Academic Scholarship, 2016

  • National Scholarship for Doctoral Students, 2015

  • Academic Scholarship, 2015