About

I am a fourth-year Ph.D. student in Computer Vision at the University of Michigan, advised by Andrew Owens. Before that, I was a Master's student in UMich ECE (2021) and I did my bachelor's degree at UM-SJTU Joint Institute from Shanghai Jiao Tong University (2019).
My primary research interest lies in Computer Vision and Deep Learning. I have spent wonderful years in computer vision group @ Michigan. During my Ph.D. I have been fortunate to intern at Meta Codec Avatars Lab and SODA (Sound Design AI) Group of Adobe Research. I am honored to collaborate with Prof. David Fouhey and Prof. Alex Wong.

I'm currently seeking full-time opportunities starting in Summer 2025. Please feel free to reach out if you have any openings!

Google Scholar  ·  GitHub  ·  CV  ·  Twitter  ·  Bluesky


News


Research

Audio in Metaverse
Multimodal Learning
Self-Supervision

My research so far has focused on audio-visual learning, multimodal learning (vision, audio, language, touch) and computer vision with self-supervision. Still, I am open to other topics as well.


Work Experience

Adobe Research,   May 2024 ~ Nov. 2024
Research Scientist Intern
Host: Prem Seetharaman, Bryan Russell, and Justin Salamon





Publication

  (* indicates equal contribution)

Video-Guided Foley Sound Generation with Multimodal Controls
Ziyang Chen, Prem Seetharaman, Bryan Russell, Oriol Nieto, David Bourgin, Andrew Owens, Justin Salamon
arXiv 2024
project page  ·  paper  ·  bibtex

Images that Sound: Composing Images and Sounds on a Single Canvas
Ziyang Chen, Daniel Geng, Andrew Owens
NeurIPS 2024
CVPR 2024 AI Art Gallery
project page  ·  paper  ·  code  ·  bibtex

Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark
Ziyang Chen, Israel D. Gebru, Christian Richardt, Anurag Kumar, William Laney, Andrew Owens, Alexander Richard
CVPR 2024 (Highlight -- 2.8% accept rate)
project page  ·  paper  ·  dataset  ·  bibtex



Profession

Reviewer:

  • Conference: WACV 2023, CVPR 2023, ICCV 2023, CVPR 2024, SIGGRAPH 2024, ECCV 2024, NeurIPS 2024
  • Journal: IJCV

Teaching Assistant:

  • VE312 Digital Integrated Circuits, Fall 2018, UM-SJTU Joint Institute. With Yaping Dan.
  • VE311 Electronic Circuits, Summer 2019, UM-SJTU Joint Institute. With Chang-Ching Tu.

Misc

- I have many genius friends and this Link will redirect you to one of them.