人物經歷
2015年博士畢業於香港科技大學,2013年-2015年在微軟雷德蒙德研究院和
微軟亞洲研究院聯合培養。
研究方向
主要成就
近五年代表性論文,
#指導學生
Yi Ren#, Yangjun Ruan, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao*, Tie-Yan Liu: FastSpeech: Fast, Robust and Controllable Text to Speech. NeurIPS 2019
Zhu Zhang#, Zhou Zhao*, Zhijie Lin, Jieming Zhu, Xiuqiang He: Counterfactual Contrastive Learning for Weakly-Supervised Vision-Language Grounding. NeurIPS 2020
Yi Ren#, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao*, Tie-Yan Liu: Almost Unsupervised Text to Speech and Automatic Speech Recognition. ICML 2019
Yi Ren#, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao*, Tie-Yan Liu, FastSpeech 2: Fast and High-Quality End-to-End Text to Speech, ICLR 2021
Zhu Zhang#, Chang Zhou, Jianxin Ma, Zhijie Lin, Jingren Zhou, Hongxia Yang, Zhou Zhao*, Learning to Rehearse in Long Sequence Memorization, ICML 2021
Tao Jin#, Zhou Zhao*, Generalizable Multi-linear Attention Network, NeurIPS 2021
Yi Ren#, Jinglin Liu#, Zhou Zhao*, PortaSpeech: Portable and High-Quality Generative Text-to-Speech, NeurIPS 2021
Luping Liu#, Yi Ren#, Zhijie Lin#, Zhou Zhao*, Pseudo Numerical Methods for Diffusion Models on Manifolds, ICLR 2022
Jinglin Liu, Chengxi Li, Yi Ren, Feiyang Chen, Zhou Zhao*: DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism. AAAI 2022
Rongjie Huang#,Yi Ren#, Jinglin Liu#, Chenye Cui#, Zhou Zhao*, GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech, NeurIPS 2022
Zijian Zhang#, Zhou Zhao*, Zhijie Lin, Unsupervised Representation Learning from Pre-trained Diffusion Probabilistic Models, NeurIPS 2022
Ziyue Jiang#, Zhe Su#, Zhou Zhao*, Qian Yang, Yi Ren, Jinglin Liu, Zhenhui Ye, Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech, NeurIPS 2022
Yang Zhao#, Chen Zhang, Haifeng Huang#, Haoyuan Li#, Zhou Zhao*, Towards Effective Multi-Modal Interchanges in Zero-Resource Sounding Object Localization, NeurIPS 2022
Lichao Zhang#, Ruiqi Li#, Shoutong Wang#, Liqun Deng, Jinglin Liu#, Yi Ren#, Jinzheng He#, Rongjie Huang#, Jieming Zhu, Xiao Chen, Zhou Zhao*, M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus, NeurIPS 2022
Zhenhui Ye#, Ziyue Jiang#, Yi Ren#, Jinglin Liu#, Jinzheng He#, Zhou Zhao*,GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis, ICLR 2023
Rongjie Huang#, Jinglin Liu#, Huadai Liu#, Yi Ren#, Lichao Zhang#, Jinzheng He#, Zhou Zhao*, TranSpeech: Speech-to-Speech Translation With Bilateral Perturbation, ICLR 2023
Rongjie Huang#, Jiawei Huang#, Dongchao Yang, Yi Ren#, Luping Liu#, Mingze Li#, Zhenhui Ye#, Jinglin Liu#, Xiang Yin, Zhou Zhao*, Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models, ICML 2023
Yan Xia, Hai Huang, Jieming Zhu, Zhou Zhao*, Achieving Cross-Modal Generalization with Multimodal Unified Representation, NeurIPS 2023
Zehan Wang, Yang Zhao, Xize Cheng, Haifeng Huang, Jiageng Liu, Aoxiong Yin, Li Tang, Linjun Li, Yongqi Wang, Ziang Zhang, Zhou Zhao*, Connecting Multi-Modal Contrastive Representations, NeurIPS 2023
Haoyi Duan, Yan Xia, Mingze Zhou, Li Tang, Jieming Zhu, Zhou Zhao*, Cross-Modal Prompts: Adapting Large Pre-Trained Models for Audio-Visual Downstream Tasks, NeurIPS 2023
Liya Hu, Zhiang Dong, Jingyuan Chen, Guifeng Wang, Zhihua Wang, Zhou Zhao, Fei Wu, PTADisc: A Diverse, Immense, Student-Centered and Cross-Course Dataset for Personalized Learning, NeurIPS 2023
獲獎記錄
2018年浙江大學信息學部青年創新獎獲得者。