• Hi!
    I'm Yang Zhou

    I am a research scientist at Adobe Research, specializing in video generation, visual effects, and developing applications for digital avatars.

    I completed my Ph.D. study in the Computer Graphics Research Group at UMass Amherst, advised by Prof. Evangelos Kalogerakis. I obtained my master's degree from Georgia Institute of Technology and my master & bachelor's degree from Shanghai Jiao Tong University, advised by Prof. Weiyao Lin.

    I work in the areas of computer vision, computer graphics and deep learning. In particular, I am interested in using deep learning techniques to help artists, stylists and animators to make better design. In particular, I am interested in the field of video generation, digital human and characters, audio-visual learning, and 3D generation.

    Download CV

Recent

News

► [NEW!] [Oct. 2024] 2 papers accepted by NeurIPS 2024.

► [NEW!] [July 2024] 2 papers accepted by ECCV 2024.

► [NEW!] [Jan. 2024] 1 papers accepted by 3DV 2024.

► [NEW!] [Nov. 2023] Our video super-resolution project #ProjResUp was presented at Adobe Max 2023 (Sneak Peak) [Youtube Link] [Press]

► [NEW!] [Nov. 2023] Our paper 3D generation foundation model "LRM: Large Reconstruction Model for Single Image to 3D" has been accepted by ICLR 2023.

► [Oct. 2023] 2 papers accepted by ICCV 2023.

► [Oct. 2022] 1 paper accepted by SIGGRAPH ASIA 2022.

► [Oct. 2022] 2 papers accepted by ECCV 2022.

► [Jun. 2022] 2 papers accepted by CVPR 2022.

► [May 2021] Start my new journey at Adobe Research as a full-time research scientist.

► [Mar. 2021] Gave a talk on deep learning architectures for character animation at Intelligent Graphics Lab, Chinese Academy of Sciences.

► [Nov. 2020] Our summer intern project #OnTheBeatSneak was presented at Adobe MAX 2020 (Sneak Peek). [Quick Look] [Full Youtube Link] [Press]

► [Aug. 2020] Our paper MakeItTalk accepted by SIGGRAPH ASIA 2020. [Video]

► [Apr. 2020] Our paper RigNet accepted by SIGGRAPH 2020. [Video]

► [Nov. 2019] Our summer intern project #SweetTalkSneak was presented at Adobe MAX 2019 (Sneak Peek). [Youtube Link] [Press]

► [Aug. 2019] Our paper on Animation Skeleton Prediction accepted by 3DV 2019.

► [Jul. 2019] Our paper SceneGraphNet accepted by ICCV 2019.

► [Jun. 2019] Joined Adobe CIL (Seattle) as a summer intern.

► [Jun. 2018] Joined Wayfair Next Research as a summer intern and fall co-op intern.

► [Apr. 2018] Our paper VisemeNet accepted by SIGGRAPH 2018. [Video]

Academia

Publications

.

Video Generation and Visual Effects

1     Progressive Autoregressive Video Diffusion Models
Desai Xie, Zhan Xu, Yicong Hong, Hao Tan, Difan Liu, Feng Liu, Arie Kaufman, Yang Zhou
Arxiv 2024
PDF   Project  
1     Customize-a-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models
Ren, Yixuan, Yang Zhou, Jimei Yang, Jing Shi, Difan Liu, Feng Liu, Mingi Kwon, and Abhinav Shrivastava
ECCV 2024
PDF   Project  
1     HARIVO: Harnessing Text-to-Image Models for Video Generation
Mingi Kwon, Seoung Wug Oh, Yang Zhou, Joon-Young Lee, Difan Liu, Haoran Cai, Baqiao Liu, Feng Liu, Youngjung Uh
ECCV 2024
PDF   Project  
1     VideoGigaGAN: Towards Detail-Rich Video Super-Resolution
Xu, Yiran, Taesung Park, Richard Zhang, Yang Zhou, Eli Shechtman, Feng Liu, Jia-Bin Huang, and Difan Liu
Arxiv 2024
PDF   Project  
1     Jump Cut Smoothing for Talking Heads
Wang, Xiaojuan, Taesung Park, Yang Zhou, Eli Shechtman, and Richard Zhang
Arxiv 2024
PDF   Project  
1     ActAnywhere: Subject-Aware Video Background Generation
Pan, Boxiao, Zhan Xu, Chun-Hao Paul Huang, Krishna Kumar Singh, Yang Zhou, Leonidas J. Guibas, and Jimei Yang
NeurIPS 2024
PDF   Project  
1     Audio-driven Neural Gesture Reenactment with Video Motion Graphs
Yang Zhou, Jimei Yang, Dingzeyu Li, Jun Saito, Deepali Aneja, and Evangelos Kalogerakis
CVPR 2022
PDF   Project  

Digital Human and Characters

1     Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM
Weng, Zhenzhen, Jingyuan Liu, Hao Tan, Zhan Xu, Yang Zhou, Serena Yeung-Levy, and Jimei Yang
Arxiv 2024
PDF   Project  
1     GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistency
Taheri, Omid, Yi Zhou, Dimitrios Tzionas, Yang Zhou, Duygu Ceylan, Soren Pirk, and Michael J. Black.
3DV 2024
PDF   Project  
1     ContactGen: Generative Contact Modeling for Grasp Generation
Liu, Shaowei, Yang Zhou, Jimei Yang, Saurabh Gupta, and Shenlong Wang
ICCV 2023
PDF   Project  
1     MoRig: Motion-Aware Rigging of Character Meshes from Point Clouds
Zhan Xu, Yang Zhou, Li Yi, and Evangelos Kalogerakis
SIGGRAPH ASIA 2022
PDF   Project  
1     Skeleton-free Pose Transfer for Stylized 3D Characters
Zhouyingcheng Liao, Jimei Yang, Jun Saito, Gerard Pons-Moll, and Yang Zhou
ECCV 2022
PDF   Project  
1     Learning Visibility for Robust Dense Human Body Estimation
Chun-Han Yao, Jimei Yang, Duygu Ceylan, Yi Zhou, Yang Zhou, and Ming-Hsuan Yang
ECCV 2022
PDF   Project  
1     APES: Articulated Part Extraction from Sprite Sheets
Zhan Xu, Matthew Fisher, Yang Zhou, Deepali Aneja, Rushikesh Dudhat, Li Yi, and Evangelos Kalogerakis
CVPR 2022
PDF   Project  
1     MakeItTalk: Speaker-Aware Talking-Head Animation
Yang Zhou, Xintong Han, Eli Shechtman, Jose Echevarria, Evangelos Kalogerakis, and Dingzeyu Li
SIGGRAPH ASIA 2020
PDF   Project   Video 1   Video 2  
1     RigNet: Neural Rigging for Articulated Characters
Zhan Xu, Yang Zhou, Evangelos Kalogerakis, Chris Landreth, and Karan Singh
SIGGRAPH 2020
PDF   Project  
1     Predicting Animation Skeletons for 3D Articulated Models via Volumetric Nets
Zhan Xu, Yang Zhou, Evangelos Kalogerakis, and Karan Singh.
3DB 2019
PDF   Project  
1     VisemeNet: Audio-Driven Animator-Centric Speech Animation
Yang Zhou, Zhan Xu, Chris Landreth, Subhransu Maji, Evangelos Kalogerakis, and Karan Singh
SIGGRAPH 2018
PDF   Project  

3D Object and Scene Synthesis

1     DMesh: A Differentiable Mesh Representation
Sanghyun Son, Matheus Gadelha, Yang Zhou, Zexiang Xu, Ming Lin, Yi Zhou
NeurIPS 2024
PDF   Project  
1     LRM: Large Reconstruction Model for Single Image to 3D
Hong, Yicong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan
ICLR 2024
PDF   Project  
1     Learning Navigational Visual Representations with Semantic Map Supervision
Hong, Yicong, Yang Zhou, Ruiyi Zhang, Franck Dernoncourt, Trung Bui, Stephen Gould, and Hao Tan
ICCV 2023
PDF  
1     SceneGraphNet: Neural Message Passing for 3D Indoor Scene Augmentation
Yang Zhou, Zachary While, and Evangelos Kalogerakis
ICCV 2019
PDF   Project  
Work

Experience

Adobe, Inc | Media Intelligent Lab

May 2021 | Research Scientist

Working on various research projects including video generation, digital human, 3D generation, etc.

Adobe, Inc | Media Intelligent Lab

June, 2020 | Intern

Collaborate with researchers on 3D facial/skeleton animations based on deep learning approaches.

Our intern project #OnTheBeatSneak was presented at Adobe MAX 2020 (Sneak Peek).

[Quick Look] [Full Youtube Link] [Press]

Adobe, Inc | Creative Intelligence Lab

June, 2019 | Intern

Collaborate with researchers on audio-driven cartoon and real human facial animations and lip-sync technologies based on deep learning approaches.

Our intern project #SweetTalk was presented at Adobe MAX 2019 (Sneak Peek).

[Youtube Link] [Press]

Wayfair, Inc | Wayfair Next Research

June, 2018 | Research Intern

Working on 3D scene systhesis based on deep learning approaches.

NetEase Game, Inc

June, 2015 | Management Trainee

Working on mobile game design, especially on profit models and user-experiences.

Best way to

Contact Me

Best way to reach me is to send an Email